<?xml version="1.0" encoding="UTF-8"?><feed
	xmlns="http://www.w3.org/2005/Atom"
	xmlns:thr="http://purl.org/syndication/thread/1.0"
	xml:lang="en-US"
	>
	<title type="text">Benjamin Riley | The Verge</title>
	<subtitle type="text">The Verge is about technology and how it makes us feel. Founded in 2011, we offer our audience everything from breaking news to reviews to award-winning features and investigations, on our site, in video, and in podcasts.</subtitle>

	<updated>2026-10-05T10:16:05+00:00</updated>

	<link rel="alternate" type="text/html" href="https://www.theverge.com/author/benjaminriley" />
	<id>https://www.theverge.com/authors/benjaminriley/rss</id>
	<link rel="self" type="application/atom+xml" href="https://www.theverge.com/authors/benjaminriley/rss" />

	<icon>https://platform.theverge.com/wp-content/uploads/sites/2/2025/01/verge-rss-large_80b47e.png?w=150&amp;h=150&amp;crop=1</icon>
		<entry>
			
			<author>
				<name>Benjamin Riley</name>
			</author>
			
			<title type="html"><![CDATA[Our minds aren’t equipped to handle AI]]></title>
			<link rel="alternate" type="text/html" href="https://www.theverge.com/ai-artificial-intelligence/1003794/ai-education-computational-model-thought" />
			<id>https://www.theverge.com/?p=1003794</id>
			<updated>2026-10-05T06:16:05-04:00</updated>
			<published>2026-10-05T06:00:00-04:00</published>
			<category scheme="https://www.theverge.com" term="AI" /><category scheme="https://www.theverge.com" term="Report" /><category scheme="https://www.theverge.com" term="Science" />
							<summary type="html"><![CDATA[Norbert Wiener, godfather of cybernetics, once said, “The thought of every age is reflected in its technique.” For the past century, our thought has been reflected in our computers, including by those in the AI industry. Google’s Demis Hassabis calls the brain “a biological approximation to a Turing machine.” Elon Musk puts it more bluntly, [&#8230;]]]></summary>
			
							<content type="html">
											<![CDATA[

						
<figure>

<img alt="3D illustration of a tray of junk food featuring the logos of various AI companies." data-caption="" data-portal-copyright="Pedro Nekoi for The Verge" data-has-syndication-rights="1" src="https://platform.theverge.com/wp-content/uploads/sites/2/2026/10/268726_Cognitive_hotdogs_PENEKOI_115fb1.jpg?quality=90&#038;strip=all&#038;crop=0,0,100,100" />
	<figcaption>
		</figcaption>
</figure>
<!-- Verge looping video (lede). Paste into the story; script finds the Duet lede shell. -->


<p class="has-drop-cap wp-block-paragraph">Norbert Wiener, godfather of cybernetics, once said, “The thought of every age is reflected in its technique.” For the past century, our thought has been reflected in our computers, including by those in the AI industry. <a href="https://www.amacad.org/publication/daedalus/ai-ultimate-tool-science-conversation-demis-hassabis">Google’s Demis Hassabis calls</a> the brain “a biological approximation to a Turing machine.” <a href="https://whatsuptesla.com/2026/02/14/transcript-elon-musk-interview-part-6/">Elon Musk puts it</a> more bluntly, declaring that “people should just think of the brain as a biological computer.” (Musk’s brain often worries me.)</p>

<p class="wp-block-paragraph">But humans are more complex than a straightforward comparison to computers&nbsp;gives us credit for — and far more than most of the AI industry seems to appreciate. And as their products push ever deeper into culture, this helps explain why they’re making such a mess. AI, it turns out, is something like a cognitive version of a hot dog: It appeals to us in the moment, but undermines the health and sustainability of cognitive systems we’ve evolved over several millennia.</p>

<p class="wp-block-paragraph">To understand the problem, we’ll need a little neuroscience and the entirety of human evolutionary history.</p>

<p class="wp-block-paragraph">The idea that brains are computers traces back to Alan Turing. It posits thought as a three-step process, functionally an algorithm: Our minds take in information from the world (input), manipulate it in some fashion (computation), and then enact behavior (output). Perception leads to cognition, which in turn leads to action. In slightly more elaborate terms, it looks something like this chart:</p>
<img src="https://platform.theverge.com/wp-content/uploads/sites/2/2026/10/268726_Cognitive_hotdogs_CVirginia_GRAPHIC_2B.png?quality=90&amp;strip=all&amp;crop=0,0,100,100" alt="This graphic illustrates the classic computational model of the mind. On the left is &quot;perception&quot;, the input that humans take in; centered is &quot;cognition,&quot; the processing of that input in some fashion; and on the right is &quot;action,&quot; the output that results from computational processing. The flow is from left to right -- input to cognition to output." title="This graphic illustrates the classic computational model of the mind. On the left is &quot;perception&quot;, the input that humans take in; centered is &quot;cognition,&quot; the processing of that input in some fashion; and on the right is &quot;action,&quot; the output that results from computational processing. The flow is from left to right -- input to cognition to output." data-has-syndication-rights="1" data-caption="" data-portal-copyright="" />
<p class="wp-block-paragraph">In many ways, this model has been productive. Imagining our brains as computers, technologists have pushed actual computing from simple adding machines to artificial neural networks and generative AI, seeking ever more detailed mirrors of our own minds.&nbsp;</p>

<p class="wp-block-paragraph">But this mirror’s image, while not exactly wrong, is warped and limited. John von Neumann, a seminal figure in developing computers and computer science, <a href="https://link.springer.com/chapter/10.1007/978-3-0348-9252-0_17">doubted</a> that the computational model could possibly capture the “exceptional complexity of the human nervous system.” That is, our nervous systems evolved to help us navigate the large ecological system that we call “the world.” And we act upon the world to exercise control over it (as best we can).</p>

<p class="wp-block-paragraph">The computational approach looks at the end product of our minds and tries to “reverse engineer” how they function. But instead of working backward, we might instead examine the long arc of evolutionary history to build our model from the ground up. This is the approach favored by Paul Cisek, a neuroscientist at the University of Montreal, who’s patiently developed a biological model of brain and nervous system development spanning millions of years.&nbsp;</p>

<p class="wp-block-paragraph">Cisek contends that rather than information processors, our brains are better understood as <em>feedback-control systems</em>. Our bodies don’t just receive input, they take action to adjust what that input is, contingent on what options are available. As Cisek himself is quick to note, this is not a new idea — writing at the turn of the 20th century, philosopher John Dewey described the mind as a circuit, “more truly termed organic than reflex, because the motor response determines the stimulus, just as truly as sensory stimulus determines movement.&#8221;&nbsp;</p>

<p class="wp-block-paragraph">What exactly is the difference between the two approaches?&nbsp;</p>

<p class="wp-block-paragraph">Here’s a classic example from baseball: catching a fly ball in the outfield. According to the computational model, solving this problem must involve some complicated and subconscious mental calculus wherein the outfielder estimates the ball’s velocity, calculates the effect of gravity, and undertakes untold other mathematical procedures to “compute” where the ball will go.&nbsp;</p>

<p class="wp-block-paragraph">In contrast, the feedback-control approach suggests a simple heuristic — essentially, “keep the ball in the same position within your visual field, and then move to maintain that situation.” We take action to adjust the stimulus we receive.</p>

<p class="wp-block-paragraph">This is not only more true to the experiences of anyone who’s played center field, it also avoids separating out the mental process from physical movement, and avoids invoking the use of complex calculations that the computational model requires. Humans are more dynamic than that. <sup>.</sup></p>

<p class="wp-block-paragraph">This approach also neatly maps to the biological architecture of brains as they’ve evolved over time. From ancient fish to amphibians to mammals to primates and eventually modern humans, what we observe is that new behaviors emerge in response to new environmental possibilities. When dinosaurs died off, for example, this meant some nocturnal creatures could move about the world in the daytime with less risk of being eaten, giving rise to a variety of new capacities. The history of our nervous system, Cisek <a href="https://www.cisek.org/pavel/Pubs/Cisek2019.pdf">observes</a>, is one of “continuous extension of control further and further into the world.” (His forthcoming book will explore all this in greater detail, and yes, I’m hoping this essay puts subtle pressure on him to finish it.)</p>

<p class="wp-block-paragraph">This leads to an alternative and very different diagram than the one above. We can both lay out a map of behaviors and abilities as they emerged over time <em>and</em> we can overlay the specific physical components of the brain to these capabilities, like so:</p>
<img src="https://platform.theverge.com/wp-content/uploads/sites/2/2026/10/268726_Cognitive_hotdogs_CVirginia_GRAPHIC_1D.png?quality=90&amp;strip=all&amp;crop=0,0,100,100" alt="This graphic illustrates how cognitive capabilities emerged over evolutionary time and resulted in new components to the brain. For example, simple forms of life possessed a hindbrain that provided basic sensorimotor control. Later, animals developed more complex behaviors, such as spatial memory, that relate to the hippocampus. Other forms of cognition and behavior emerged later still, such as gaze control, that relate to the cerebral cortex. The flow is from top to bottom -- new capabilities evolve in response to new environmental conditions." title="This graphic illustrates how cognitive capabilities emerged over evolutionary time and resulted in new components to the brain. For example, simple forms of life possessed a hindbrain that provided basic sensorimotor control. Later, animals developed more complex behaviors, such as spatial memory, that relate to the hippocampus. Other forms of cognition and behavior emerged later still, such as gaze control, that relate to the cerebral cortex. The flow is from top to bottom -- new capabilities evolve in response to new environmental conditions." data-has-syndication-rights="1" data-caption="" data-portal-copyright="" />
<p class="wp-block-paragraph">Instead of moving from left to right as in the computational model, this model should be seen as unfolding from top to bottom over evolutionary time. For example, a long time ago, as vertebrate animals developed more mobility, it became useful to have specialized systems for exploration — by using landmarks, say, or navigating at night. This led to the development of what we now call the hippocampus. Importantly, this also led our ancestors to remember important moments of scurrying from one spot to another, leading to the development of &#8220;episodic memory&#8221; of past experiences.</p>

<p class="wp-block-paragraph">We can’t do anything remotely like this with the computational model of the mind; it simply does not sync up to observable neuroscientific structures. What’s more, it obscures that so much of what brains are doing involves controlling living organisms’ interactions within their environments. As such, Cisek suggests we need to dramatically shift the paradigm we’re using to understand the relationship between our brains and behavior, moving away from algorithmic input-outputs and toward more dynamic feedback systems.&nbsp;</p>

<p class="wp-block-paragraph">Thus far, our story of human development has largely centered on feedback from the physical world. But one of humanity’s most important “feedback loops” arises from our profoundly <em>social </em>dispositions. The computational model, it turns out, doesn’t account for this well either — and neither does the AI industry. We’ve spent thousands of years building institutions and norms for learning from and communicating with each other, and over the course of less than a decade, Big Tech companies have systematically worked to dismantle them.&nbsp;</p>

<p class="wp-block-paragraph">How? Again, we’ll need some historical context.</p>

<p class="wp-block-paragraph">At some point around many hundreds of thousands of years ago, our distant ancestors did something incredible: They learned to imitate each other. Mimicking gestures and body movements allowed us to pass along successful practices — like chipping away at a stone tool — and coordinate more complex activities through shared ritualistic behaviors, which in turn <a href="https://aeon.co/essays/how-culture-works-with-evolution-to-produce-human-cognition">shaped our cognition</a>. It was the dawn of human culture.</p>

<figure class="wp-block-pullquote"><blockquote><p>We’ve spent thousands of years building institutions and norms for learning from and communicating with each other, and Big Tech companies are systematically working to dismantle them</p></blockquote></figure>

<p class="wp-block-paragraph">Humans soon progressed to imitating sounds and, in turn, to oral language. As we’ve <a href="https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems">covered previously</a>, language is not the same as thought, but it enables us to <em>communicate</em> our thoughts to each other. At some point, our wandering hunter-gatherer ancestors also started to settle down into non-transient communities, developing complex agricultural practices that allowed us to cultivate food rather than migrating to find it.</p>

<p class="wp-block-paragraph">Finally, we started to use <a href="https://www.britannica.com/topic/cuneiform">written marks</a> to represent our spoken languages and other abstract ideas. We became capable of transmitting complex ideas across generations. Formal education, a process of ensuring knowledge is shared among a human group, <a href="https://www.britannica.com/topic/education/Education-in-the-earliest-civilizations">emerged</a> not long after. And so too in time did practices and institutions that collectivized human decision-making, such as “markets” and “law” and “democracy.”&nbsp;</p>

<p class="wp-block-paragraph">Each claim I’ve just made is contestable, and cries out for far more detail than I can provide here. But this process is <em>continuous</em> with our biological evolution, in the sense that both foster an ever broader range of control over the world around us.&nbsp;</p>

<p class="wp-block-paragraph">And sometimes this cultural change creates unintended consequences that hurt instead of help.</p>

<p class="wp-block-paragraph">Human diets are perhaps the most obvious example. In our hunter-gatherer days, fatty foods were rare but precious to aid survival — just watch <em>Alone </em>if you doubt this — and we evolved to seek them out and store them in our bodies once found. But then we culturally developed the practice of farming and other agricultural techniques that, give or take 10,000 years, have made fatty foods plentiful today — if you want a hot dog, there’s plenty available.&nbsp;</p>

<figure class="wp-block-pullquote"><blockquote><p>AI clogs up our capacity to develop the knowledge we need to navigate the world</p></blockquote></figure>

<p class="wp-block-paragraph">And that’s the problem. Hot dogs are a danger to our physical bodies, clogging our arteries with excessive fat we no longer need to store internally. AI poses a similar sort of danger to our cognitive capabilities, by clogging our capacity to develop the knowledge we need – in our heads – to navigate the world. It’s a cognitive hot dog.</p>

<p class="wp-block-paragraph">The occasional hot dog won’t harm anyone, but it sure will if it becomes a regular meal at lunch or dinner. The same is true for AI — the harm is not from its occasional use, but making it part of our mental diet.</p>

<p class="wp-block-paragraph">Yet that is exactly what Big Tech hyperscalers are trying to do.</p>

<p class="wp-block-paragraph">In a July 2025 podcast about “how AI is transforming education,” OpenAI VP of education Leah Belsky <a href="https://open.spotify.com/episode/6TVeKDl7oddWDi5UNqmlNL">boasted</a> that “learners” made up more than half of the 900 million average monthly users of ChatGPT. The service was “the world’s largest learning platform,” she said. More recently, Anthropic announced a new initiative called “<a href="https://www.anthropic.com/news/claude-for-teachers">Claude for Teachers</a>,” providing free access to premium models to practicing classroom educators.&nbsp;&nbsp;</p>

<p class="wp-block-paragraph">These efforts will not benefit students, nor teachers. In fact, it’s the most obvious example of how AI weakens systems that we rely on to develop our cognition, for the benefit of convenience.&nbsp;</p>

<p class="wp-block-paragraph">François Chollet, formerly a software engineer at Google, has memorably <a href="https://fchollet.substack.com/p/ai-is-cognitive-automation-not-cognitive">described</a> AI as a tool of “cognitive automation,” which he defines as “encoding human abstractions in a piece of software, then using that software to automate tasks normally performed by humans.” Last year, an interdisciplinary group of scholars <a href="https://henryfarrell.net/wp-content/uploads/2025/03/Science-Accepted-Version.pdf">argued</a> persuasively that we should view generative AI in the form of large language models not “primarily as intelligent agents, but as a new kind of <em>cultural and social technology</em>, allowing humans to take advantage of information other humans have accumulated” (emphasis added).&nbsp;</p>

<p class="wp-block-paragraph">AI enthusiasts have made no shortage of predictions about the advantages of this, and they’ve largely dismissed the disadvantages as comparable to previous forms of automation, such as computers, calculators, and even the written word. (I’ve had citations to Plato’s alleged opposition to writing thrown at me so many times I’ve <a href="https://buildcognitiveresonance.substack.com/p/plato-was-an-ai-skeptic">addressed them in a separate piece</a> — he was a writer!)</p>

<figure class="wp-block-pullquote"><blockquote><p>Never before have we developed and broadly deployed something so explicitly intended to supplant human thinking</p></blockquote></figure>

<p class="wp-block-paragraph">Whatever the effects of these earlier technologies, never before have we developed and broadly deployed something so explicitly intended to supplant human thinking —&nbsp;that’s what AI evangelists themselves argue.&nbsp;</p>

<p class="wp-block-paragraph">Look at education. ChatGPT may be the world’s largest learning platform, but students are using it en masse to <em>avoid</em> the effortful thinking that’s necessary to build their durable knowledge. <a href="https://hechingerreport.org/proof-points-ai-in-teaching/">Evidence</a> <a href="https://www.insidehighered.com/news/faculty/learning-assessment/2026/07/08/brown-professor-suspects-most-his-class-used-ai-cheat">continues</a> <a href="https://scale.stanford.edu/sites/default/files/The%20Evidence%20Base%20on%20AI%20in%20K-12%20Report.pdf">to</a> <a href="https://www.chalkbeat.org/2026/04/09/sal-khan-reflects-on-ai-in-schools-and-khanmigo/">mount</a> <a href="https://arxiv.org/pdf/2603.12471">demonstrating</a> the <a href="https://www.brookings.edu/articles/a-new-direction-for-students-in-an-ai-world-prosper-prepare-protect/">negative</a> <a href="https://arxiv.org/pdf/2605.21629">impact</a> of <a href="https://www.nytimes.com/2026/05/27/opinion/writing-creativity-ai.html?unlocked_article_code=1.llA.sICh.ggCiSv-zlDge&amp;smid=url-share">AI</a> tools within education settings (and Gen Z generally <a href="https://www.theverge.com/ai-artificial-intelligence/920401/gen-z-ai">hates it</a>). A recent <a href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6868618">study</a> from China revealed that thousands of students essentially stopped doing their homework once they started using AI (which substantially harmed their learning). There’s even <a href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6097646">evidence</a> that when students use large language models for supposed learning purposes, they become habituated to relaxing their judgment and critical thinking in other contexts.&nbsp;</p>

<p class="wp-block-paragraph">No other species’ brain and body develops over such an extended period as ours, and historically, we’ve complemented that with unique cultural institutions that transmit knowledge from one generation to the next. We should be zealously protective of this uniquely human endeavor, yet instead many university and school administrators, to say nothing of the Big Tech hyperscalers, are engaged in full-throated efforts to push AI as deep and as fast as they can into our education ecosystems.</p>

<p class="wp-block-paragraph">If we <em>only </em>see the mind as a computer, AI might seem advantageous to learning — this is why many dream of building AI tutors. But already such efforts are <a href="https://www.chalkbeat.org/2026/04/09/sal-khan-reflects-on-ai-in-schools-and-khanmigo/">failing</a>, because our minds are more than just input-output devices. They exist, or rather <em>we </em>exist, within a broader cognitive ecosystem where we must make choices about how we choose to expend our cognitive energy. We do so to extend our agency, our control — however limited it may be — over our world.</p>

<figure class="wp-block-pullquote"><blockquote><p>If we <em>only </em>see the mind as a computer, AI might seem advantageous to learning —&nbsp;but this model is wrong</p></blockquote></figure>

<p class="wp-block-paragraph">But this poses a challenge. Effortful thinking is hard, and if we’re offered technological off-ramps, we’ll take them — what some researchers <a href="https://arxiv.org/pdf/2609.03344">recently called cognitive delegation</a>. As cognitive delegation spreads, they warn, “the social environment that supports autonomous reasoning can weaken” — and as it does, such delegation “becomes still easier and more attractive.”&nbsp;</p>

<p class="wp-block-paragraph">The researchers recommend a program of cognitive <em>immunization</em> from AI, one that preserves “the practices and institutions that keep human cognition active: unaided problem solving, verification, critical discussion, [and] periods of deliberate disengagement” from AI usage.&nbsp;</p>

<p class="wp-block-paragraph">We call such institutions “schools.”&nbsp;</p>

<p class="wp-block-paragraph">Policy levers will need to be pulled as well. I find it <em>very</em> interesting that Norway <a href="https://www.reuters.com/technology/norway-imposes-near-ban-ai-elementary-school-2026-06-19/">recently banned</a> essentially all uses of AI in school for students under the age of 13. In the US, a major teachers’ union has likewise <a href="https://www.nytimes.com/2026/05/27/technology/ai-screens-schools-weingarten.html?eafs_enabled=false">called</a> for prohibiting chatbots in elementary schools, and major school districts such as <a href="https://www.nytimes.com/2026/09/03/us/lausd-schools-ban-ai-artificial-intelligence.html">Los Angeles</a> and <a href="https://www.cnn.com/2026/09/02/tech/new-york-city-classroom-ai-ban">New York City</a> have recently implemented bans as well. (Disclosure: I’ve provided informal advice to Schools Beyond Screens, an organization that pushed for these bans.) They won’t be the last to do so, or so I hope.</p>

<p class="wp-block-paragraph">The good news, if it can be called that, is that resistance is growing — perhaps you’ve seen the <a href="https://www.youtube.com/shorts/adZayNdKK60">many videos</a> of college graduates booing commencement speakers praising AI? That’s no doubt in part due to job concerns, but I suspect many recognize the harm that AI has inflicted on their own cognitive development. Certainly, this is true for the students at the Oberlin Luddite Club, who wrote an <a href="https://oberlinreview.org/35718/opinions/luddite-club-implores-oberlin-to-opt-out-of-ai/">open letter</a> to their university president criticizing that institution’s embrace of AI: “As you embark on your year of AI, we’ll embark on our own year of self-actualization — of realizing the fruits of our labor, and of embracing human imperfection and raw inquiry.” Right on.</p>

<p class="wp-block-paragraph">The control systems in our brains are the product of millions of years of biological evolution and several millennia of cultural evolution. We need to pull up from the computational model of the mind to see the full picture of what makes us human, and to appreciate our profoundly social nature, the driver of human culture. We have shown remarkable resiliency as a species, but gorging on cognitive hot dogs isn’t good for any of us.&nbsp;</p>

<p class="wp-block-paragraph">Eat healthy, and <em>think </em>healthy.</p>
						]]>
									</content>
			
					</entry>
			<entry>
			
			<author>
				<name>Benjamin Riley</name>
			</author>
			
			<title type="html"><![CDATA[Large language mistake]]></title>
			<link rel="alternate" type="text/html" href="https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems" />
			<id>https://www.theverge.com/?p=827820</id>
			<updated>2026-05-09T10:57:48-04:00</updated>
			<published>2025-11-25T07:00:00-05:00</published>
			<category scheme="https://www.theverge.com" term="AI" /><category scheme="https://www.theverge.com" term="Features" /><category scheme="https://www.theverge.com" term="Report" /><category scheme="https://www.theverge.com" term="Science" />
							<summary type="html"><![CDATA[“Developing superintelligence is now in sight,” says Mark Zuckerberg, heralding the “creation and discovery of new things that aren&#8217;t imaginable today.” Powerful AI “may come as soon as 2026 [and will be] smarter than a Nobel Prize winner across most relevant fields,” says Dario Amodei, offering the doubling of human lifespans or even “escape velocity” [&#8230;]]]></summary>
			
							<content type="html">
											<![CDATA[

						
<figure>

<img alt="A red-and-green image of a human head with an empty cartoon speech bubble inside" data-caption="" data-portal-copyright="Image: Cath Virginia / The Verge, Getty Images" data-has-syndication-rights="1" src="https://platform.theverge.com/wp-content/uploads/sites/2/2025/11/258108_language_is_not_intelligence_CVirginia37.jpg?quality=90&#038;strip=all&#038;crop=0,0,100,100" />
	<figcaption>
		</figcaption>
</figure>
<p class="has-drop-cap has-text-align-none wp-block-paragraph">“Developing superintelligence is now in sight,” <a href="https://www.meta.com/superintelligence/?srsltid=AfmBOordifyF0yEAoSvgERn-1kSfAWRL9lMWOGQGF_B0fKHcWf7onC_L">says</a> Mark Zuckerberg, heralding the “creation and discovery of new things that aren&#8217;t imaginable today.” Powerful AI “may come as soon as 2026 [and will be] smarter than a Nobel Prize winner across most relevant fields,” <a href="https://www.darioamodei.com/essay/machines-of-loving-grace">says</a> Dario Amodei, offering the doubling of human lifespans or even “escape velocity” from death itself. “We are now confident we know how to build AGI,” <a href="https://blog.samaltman.com/reflections">says</a> Sam Altman, referring to the industry’s holy grail of artificial general intelligence — and soon superintelligent AI “could massively accelerate scientific discovery and innovation well beyond what we are capable of doing on our own.”</p>

<p class="has-text-align-none wp-block-paragraph">Should we believe them? Not if we trust the science of human intelligence, and simply look at the AI systems these companies have produced so far.</p>

<p class="has-text-align-none wp-block-paragraph">The common feature cutting across chatbots such as OpenAI’s ChatGPT, Anthropic’s Claude, Google’s Gemini, and whatever Meta is calling its AI product this week are that they are all primarily “large <em>language</em> models.” Fundamentally, they are based on gathering an extraordinary amount of linguistic data (much of it codified on the internet), finding correlations between words (more accurately, sub-words called “tokens”), and then predicting what output should follow given a particular prompt as input. For all the alleged complexity of generative AI, at their core they really are models of language.</p>

<p class="has-text-align-none wp-block-paragraph">The problem is that according to current neuroscience, human thinking is largely independent of human language — and we have little reason to believe ever more sophisticated modeling of language will create a form of intelligence that meets or surpasses our own. Humans use language to communicate the results of our capacity to reason, form abstractions, and make generalizations, or what we might call our intelligence. We use language to think, but that does not <em>make </em>language the same as thought. Understanding this distinction is the key to separating scientific fact from the speculative science fiction of AI-exuberant CEOs.</p>

<p class="has-text-align-none wp-block-paragraph">The AI hype machine relentlessly promotes the idea that we’re on the verge of creating something as intelligent as humans, or even “superintelligence” that will dwarf our own cognitive capacities. If we gather tons of data about the world, and combine this with ever more powerful computing power (read: Nvidia chips) to improve our statistical correlations, then presto, we’ll have AGI. Scaling is all we need.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">But this theory is seriously scientifically flawed. LLMs are simply tools that emulate the communicative function of language, not the separate and distinct cognitive process of thinking and reasoning, no matter how many data centers we build.</p>

<figure class="wp-block-pullquote"><blockquote><p>We use language to think, but that does not <em>make </em>language the same as thought</p></blockquote></figure>

<p class="has-text-align-none wp-block-paragraph">Last year, three scientists published a <a href="https://gwern.net/doc/psychology/linguistics/2024-fedorenko.pdf">commentary</a> in the journal <em>Nature</em> titled, with admirable clarity, “Language is primarily a tool for communication rather than thought.” Co-authored by Evelina Fedorenko (MIT), Steven T. Piantadosi (UC Berkeley) and Edward A.F. Gibson (MIT), the article is a tour de force summary of decades of scientific research regarding the relationship between language and thought, and has two purposes: one, to tear down the notion that language gives rise to our ability to think and reason, and two, to build up the idea that language evolved as a cultural tool we use to share our thoughts with one another.</p>

<p class="has-text-align-none wp-block-paragraph">Let’s take each of these claims in turn.</p>

<p class="has-text-align-none wp-block-paragraph">When we contemplate our own thinking, it often feels as if we are thinking&nbsp;<em>in</em>&nbsp;a particular language, and therefore&nbsp;<em>because of</em>&nbsp;our language.&nbsp;But if it were true that language is essential to thought, then taking away language should likewise take away our ability to think. This does not happen. I repeat: <em>Taking away language does not take away our ability to think</em>. And we know this for a couple of empirical reasons.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">First, using advanced functional magnetic resonance imaging (fMRI), we can see different parts of the human brain activating when we engage in different mental activities. As it turns out, when we engage in various cognitive activities — solving a math problem, say, or trying understand what is happening in the mind of another human — different parts of our brains “light up” as part of networks that are distinct from our linguistic ability:&nbsp;</p>
<img src="https://platform.theverge.com/wp-content/uploads/sites/2/2025/11/Screenshot-2025-11-24-at-2.11.48%E2%80%AFPM.png?quality=90&amp;strip=all&amp;crop=0,0,100,100" alt="A set of images of the brain, with different parts lighting up, labeled “language network,” “multiple demand network,” and “theory of mind network,” all of which support different functions." title="A set of images of the brain, with different parts lighting up, labeled “language network,” “multiple demand network,” and “theory of mind network,” all of which support different functions." data-has-syndication-rights="1" data-caption="" data-portal-copyright="&lt;a href=&quot;https://gwern.net/doc/psychology/linguistics/2024-fedorenko.pdf&quot; data-type=&quot;link&quot; data-id=&quot;https://gwern.net/doc/psychology/linguistics/2024-fedorenko.pdf&quot;&gt;Nature&lt;/a&gt;" />
<p class="has-text-align-none wp-block-paragraph">Second, studies of humans who have lost their language abilities due to brain damage or other disorders demonstrate conclusively that this loss does not fundamentally impair the general ability to think. “The evidence is unequivocal,” Fedorenko et al. state, that “there are many cases of individuals with severe linguistic impairments … who nevertheless exhibit intact abilities to engage in many forms of thought.” These people can solve math problems, follow nonverbal instructions, understand the motivation of others, and engage in reasoning — including formal logical reasoning and causal reasoning about the world.</p>

<p class="has-text-align-none wp-block-paragraph">If you’d like to independently investigate this for yourself, here’s one simple way: Find a baby and watch them (when they’re not napping). What you will no doubt observe is a tiny human curiously exploring the world around them, playing with objects, making noises, imitating faces, and otherwise learning from interactions and experiences. “Studies suggest that children learn about the world in much the same way that scientists do—by conducting experiments, analyzing statistics, and forming intuitive theories of the physical, biological and psychological realms,” the cognitive scientist Alison Gopnik <a href="https://alisongopnik.com/Papers_Alison/sciam-Gopnik.pdf">notes</a>, all before learning how to talk. Babies may not yet be able to use language, but of course they are thinking! And every parent knows the joy of watching their child’s cognition emerge over time, at least until the teen years.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">So, scientifically speaking, language is only one aspect of human thinking, and much of our intelligence involves our non-linguistic capacities. Why then do so many of us intuitively feel otherwise?&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">This brings us to the second major claim in the <em>Nature</em> article by Fedorenko et al., that language is primarily a tool we use to share our thoughts with one another — an “efficient communication code,” in their words. This is evidenced by the fact that, across the wide diversity of human languages, they share certain common features that make them “easy to produce, easy to learn and understand, concise and efficient for use, and robust to noise.”</p>

<figure class="wp-block-pullquote"><blockquote><p>Even parts of the AI industry are growing critical of LLMs</p></blockquote></figure>

<p class="has-text-align-none wp-block-paragraph">Without diving too deep into the linguistic weeds here, the upshot is that human beings, as a species, benefit tremendously from using language to share our knowledge, both in the present and across generations. Understood this way, language is what the cognitive scientist Cecilia Heyes calls a “<a href="https://www.educationnext.org/cognitive-gadgets-theory-might-change-your-mind-literally/">cognitive gadget</a>” that “enables humans to learn from others with extraordinary efficiency, fidelity, and precision.”&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">Our cognition<em> improves</em> because of language — but it’s not created or defined by it.</p>

<p class="has-text-align-none wp-block-paragraph">Take away our ability to speak, and we can still think, reason, form beliefs, fall in love, and move about the world; our range of what we can experience and think about remains vast.</p>

<p class="has-text-align-none wp-block-paragraph">But take away language from a large language model, and you are left with literally nothing at all.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">An AI enthusiast might argue that human-level intelligence doesn’t need to necessarily function in the same way as human cognition. AI models have surpassed human performance in activities like chess using processes that differ from what we do, so perhaps they could become superintelligent through some unique method based on drawing correlations from training data.</p>

<p class="has-text-align-none wp-block-paragraph">Maybe! But there’s no obvious reason to think we can get to <em>general</em> intelligence — not improving narrowly defined tasks —through text-based training. After all, humans possess all sorts of knowledge that is not easily encapsulated in linguistic data — and if you doubt this, think about how you know how to ride a bike.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">In fact, within the AI research community there is growing awareness that LLMs are, in and of themselves, insufficient models of human intelligence. For example, Yann LeCun, a Turing Award winner for his AI research and a <a href="https://www.wsj.com/tech/ai/yann-lecun-ai-meta-0058b13c">prominent skeptic of LLMs</a>, left his role at Meta last week to found an AI startup developing what are dubbed world models: “​​systems that understand the physical world, have persistent memory, can reason, and can plan complex action sequences.” And recently, a group of prominent AI scientists and “thought leaders” — including Yoshua Bengio (another Turing Award winner), former Google CEO Eric Schmidt, and noted AI skeptic Gary Marcus — <a href="https://www.agidefinition.ai/paper.pdf">coalesced</a> around a working definition of AGI as “AI that can match or exceed the cognitive <em>versatility</em> and proficiency of a well-educated adult” (emphasis added). Rather than treating intelligence as a “monolithic capacity,” they propose instead we embrace a model of both human and artificial cognition that reflects “a complex architecture composed of many distinct abilities.”</p>

<p class="has-text-align-none wp-block-paragraph">They argue intelligence looks something like this:</p>
<img src="https://platform.theverge.com/wp-content/uploads/sites/2/2025/11/Screenshot-2025-11-24-at-2.09.06%E2%80%AFPM.png?quality=90&amp;strip=all&amp;crop=0,0,100,100" alt="A chart that looks like a spiderweb, with different axes labeled “speed,” “knowledge,” “reading &amp; writing,” “math,” “reasoning,” “working memory,” “memory storage,” “memory retrieval,” “visual,” and “auditory.”" title="A chart that looks like a spiderweb, with different axes labeled “speed,” “knowledge,” “reading &amp; writing,” “math,” “reasoning,” “working memory,” “memory storage,” “memory retrieval,” “visual,” and “auditory.”" data-has-syndication-rights="1" data-caption="" data-portal-copyright="&lt;a href=&quot;https://www.agidefinition.ai/paper.pdf&quot; data-type=&quot;link&quot; data-id=&quot;https://www.agidefinition.ai/paper.pdf&quot;&gt;Center for AI Safety&lt;/a&gt;" />
<p class="has-text-align-none wp-block-paragraph">Is this progress? Perhaps, insofar as this moves us past the silly quest for more training data to feed into server racks. But there are still some problems. Can we really aggregate individual cognitive capabilities and deem the resulting sum to be general intelligence? How do we define what weights they should be given, and what capabilities to include and exclude? What exactly do we mean by “knowledge” or “speed,” and in what contexts? And while these experts agree simply scaling language models won’t get us there, their proposed paths forward are all over the place — they’re offering a better goalpost, not a roadmap for reaching it.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">Whatever the method, let’s assume that in the not-too-distant future, we succeed in building an AI system that performs admirably well across the broad range of cognitive challenging tasks reflected in this spiderweb graphic. Will we have achieved building an AI system that possesses the sort of intelligence that will lead to transformative scientific discoveries, as the Big Tech CEOs are promising? Not necessarily. Because there’s one final hurdle: Even replicating the way humans <em>currently</em> think doesn’t guarantee AI systems can make the cognitive leaps humanity achieves.&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph">We can credit Thomas Kuhn and his book <em>The Structure of Scientific Revolutions</em> for our notion of “scientific paradigms,” the basic frameworks for how we understand our world at any given time. He argued these paradigms “shift” not as the result of iterative experimentation, but rather when new questions and ideas emerge that no longer fit within our existing scientific descriptions of the world. Einstein, for example, conceived of relativity before any empirical evidence confirmed it. Building off this notion, the philosopher Richard Rorty contended that it is when scientists and artists become dissatisfied with existing paradigms (or vocabularies, as he called them) that they create <em>new</em> metaphors that give rise to new descriptions of the world — and if these new ideas are useful, they then become our common understanding of what is true. As such, he argued, “common sense is a collection of dead metaphors.”</p>

<p class="has-text-align-none wp-block-paragraph">As currently conceived, an AI system that spans multiple cognitive domains could, supposedly, predict and replicate what a generally intelligent human would do or say in response to a given prompt. These predictions will be made based on electronically aggregating and modeling whatever existing data they have been fed. They could even incorporate new paradigms into their models in a way that appears human-like. But they have no apparent reason to become dissatisfied with the data they’re being fed — and by extension, to make great scientific and creative leaps.</p>

<p class="has-text-align-none wp-block-paragraph">Instead, the most obvious outcome is nothing more than a common-sense repository. Yes, an AI system might remix and recycle our knowledge in interesting ways. But that’s all it will be able to do. It will be forever trapped in the vocabulary we’ve encoded in our data and trained it upon —&nbsp;a dead-metaphor machine. And actual humans — thinking and reasoning and using language to communicate our thoughts to one another — will remain at the forefront of transforming our understanding of the world.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</p>

<p class="has-text-align-none wp-block-paragraph"><em>Benjamin Riley is the founder of </em><a href="https://www.cognitiveresonance.net/"><em>Cognitive Resonance</em></a><em>, a new venture dedicated to helping people understand human cognition and generative AI. Portions of this essay initially appeared on the Cognitive Resonance </em><a href="https://buildcognitiveresonance.substack.com/"><em>Substack</em></a><em>.&nbsp;</em></p>
						]]>
									</content>
			
					</entry>
	</feed>
