A recent study revealed that ChatGBT, an AI-based chatbot, can match the top 1% of human thinkers.
The study, conducted by the University of Montana, stated that the researchers used the “Torrance” test for creative thinking (TTCT) of the “ChatGPT” engine and scored 8 responses. They also collected responses from 24 University of Montana students. These scores were compared with 2,700 students nationally who took the test.
The study showed that all responses were recorded by an education service that was unaware of sending the AI responses.
In fact, the answers of Chat GBT outperformed the majority of students nationally, and the AI’s answers were as creative as those of the most creative real people who took the test, according to the study.
“The results were surprising,” study author and assistant clinical professor at the University of Montana College of Business Eric Guzik told ScienceDaily.com. “For me, creativity is about doing things differently… One of the definitions of entrepreneurship that I like is being an entrepreneur who thinks differently. So, AI may help us apply creative thinking to business and the innovation process, and that’s cool.”
New and amazing responses
The TTCT has two different assessments: one is verbal and the other is pictorial. Both measure divergent thinking, or the thought process used to generate creative ideas.
In the verbal assessment, test takers are presented with pictures or verbal prompts and asked to respond in written form. For example, they might be shown a picture of an event and asked to hypothesize an outcome. Or they may be shown a product and asked for ways to improve it, and their answers are used for evaluation Three mental characteristics:
Fluency: the number of related ideas
Originality: the unusualness of ideas
Flexibility: variety of different types of ideas
Metaphorical evaluation requires the test-taker to elicit his or her answers. For example, they may be asked to complete a picture. Besides fluency and originality, the figurative test assesses following skills:
Elaboration: Add ideas beyond the minimum requirements
Resistance to premature closure: A person’s ability to tolerate ambiguity enough to elicit a creative response
Abstract Titles: The ability to name a character creatively
In the study, ChatGBT responses had the highest percentage of fluency and originality. Response scores fell to 97% when it came to flexibility.
“We’ve all been exploring with (ChatGPT) and we noticed that it was doing some interesting things that we didn’t expect. Some of the responses were new and surprising. That’s when we decided to test it to see how creative it really was,” said Guzik. Guzik doesn’t want to overestimate the impact AI could have on the economy, but believes it will become an engine for innovation.
