Large language models (LLMs) are trained on large amounts of text from the internet, books, forums and other sources in a process called pre-training. This gives them great versatility, but also comes with a hidden challenge: human language data contains biases, misinformation and unsafe patterns, such as hate speech, toxic or discriminatory content. When models learn from such data, they not only gain useful knowledge but also inherit these problems. On top of this, LLMs tend to be statistically overconfident (Guo et al., 2017; Minderer et al., 2021), meaning they assign higher probabilities to their predictions, due to the way that they interpret data (Xu et al., 2024). They often present information with certainty, even when the output is false. This combination of biased training data and overconfidence can lead to hallucinations, biased answers or unsafe outputs, such as toxic content or instructions for harmful behavior.

Creativity is often considered as an “intuition” or “talent” and can’t be easily interpreted in a logical way (Wu et al. 2021). The creative industries often refer to graphic design, film, music, video games, fashion, advertising, media or entertainment industries (Howkins 2002), related to the extraordinary thinking by supreme creative individuals (Weisberg 2006). However, creativity actually lies in all creative activities, from the arts to science, from everyday life to industry production. Today, creativity is considered to be a crucial competency (Binkley et al. 2012). Boden (2004), who pioneered the field of philosophy of cognitive science, offers the definition “Creativity is the ability to come up with ideas or artefacts that are new, surprising and valuable”. With the help of language, people used the creative process in art and technology, making creativity “one of the most striking features of the human species”, since at least 40,000 years ago (Carruthers 2002, p. 226). Creativity in today’s sense is at the heart of human endeavour, shaping various fields including education, art and healthcare (Esling and Devis 2020; Farina et al. 2024; Tredinnick and Laybats 2023).

For as long as we have written history, humans have been fascinated by the idea of thinking about thinking. The ancient Greeks saw self-reflection as a path to wisdom: Socrates urged his students to “know thyself”, while Aristotle suggested that the mind could even grasp its own activity. Centuries later, philosophers and logicians took this further, asking whether knowing something also means knowing that you know it. In the 1960s, Jaakko Hintikka captured this in a famous principle of logic: if an agent knows a fact, it should also know that it knows it. Fast forward to today, and this same idea has found new life in artificial intelligence, where researchers explore how machines might be designed not just to think, but to reflect on their own thinking.