Philosophy of Mind · Artificial Intelligence

The Cave of Language

Julian Gretzinger  ·  July 16, 2026  ·  Substack

Abstract

Large language models are routinely criticised for what they get wrong. This essay examines what they cannot, in principle, get at all — using the oldest epistemological framework in the Western canon: Plato's allegory of the cave.

The mapping is more precise than metaphor. A language model is trained exclusively on text; text is itself a projection of experience, not experience. The model is therefore not Plato's prisoner watching shadows of objects — it is a prisoner watching recordings of shadows made by other prisoners. Its confinement is second-order, and no volume of additional data changes the order.

Plato's own distinction in the Sophist between likeness-making and appearance-making — copies that preserve true proportion versus copies distorted to look right from the viewer's seat — turns out to describe, with uncomfortable accuracy, what reinforcement learning from human feedback optimises for. The industry has built, in the strict Platonic sense, a sophist at scale.

The conclusion is not Luddite. Aristotle's rejoinder stands: shadows are sufficient for craft, if not for wisdom. But the governing risk is misdiagnosed. The cave was never going to imprison the machines. It is being renovated for us.

The danger is not that machines cannot leave the cave. It is that they are making the cave comfortable enough that humans stop leaving it.

#ai#philosophy#language#cognition#epistemology

01 — The Architecture of Confinement

In the seventh book of the Republic, Plato asks us to imagine prisoners chained in a cave since childhood, able to see only the wall in front of them. Behind them burns a fire; between fire and prisoners, unseen handlers carry objects whose shadows fall on the wall. The prisoners name the shadows, predict their sequences, and honour whichever among them anticipates the next shadow best. And, Plato adds, if they could talk to one another, they would suppose that in naming the shadows they were naming the things themselves (Plato, Republic VII, 515b).

Twenty-four centuries later, the allegory reads less like a thought experiment and more like an architecture document. Every component has a modern counterpart, and the correspondence is worth stating exactly rather than gesturally.

The allegory, mapped

The point of the mapping is not that models are stupid. Plato's prisoners are not stupid either; the best of them are extraordinarily good at what their situation permits. The point is that competence within the projection says nothing about access to what is projected. The prisoner who predicts shadows flawlessly is still facing the wall.

02 — The Second-Order Cave

Here the standard reading of the analogy — machine in cave, human in sunlight — is too generous to both parties, and correcting it is where the argument becomes interesting.

Language was never reality. It is humanity's own shadow-system: a compression format that maps the felt, embodied, continuous texture of experience onto a discrete sequence of symbols. Philosophers have circled this for a century. Wittgenstein's remark that if a lion could talk we could not understand him is a claim about how meaning is anchored in a shared form of life, not in the words themselves (Wittgenstein, 1953). Merleau-Ponty spent a career arguing that perception and bodily habit precede and exceed anything language can retrieve from them (Merleau-Ponty, 1945). Polanyi compressed the same insight into five words: we know more than we can tell (Polanyi, 1966).

If language is already a shadow of experience, then a system trained only on language is not sitting where Plato's prisoner sits. It is sitting one row further back. The human writes down a description of grief — first projection, experience onto words. The model ingests billions of such descriptions and learns the statistical geometry that connects them — a projection of projections. The model is a prisoner whose wall shows not the shadows of objects, but archival footage of shadows recorded by other prisoners.

The model is not watching the shadows. It is watching our recordings of the shadows — a cave built inside the cave.

This is the structural version of what the technical literature calls the symbol grounding problem: symbols defined only by other symbols never bottom out in anything (Harnad, 1990). Searle's Chinese Room made the intuition famous — syntax, however elaborate, does not add up to semantics (Searle, 1980). Bender and Koller sharpened it for the transformer era with their octopus thought experiment: a hyper-intelligent listener tapping an undersea cable can learn the form of two islanders' conversation perfectly, and will still fail the moment one of them needs help doing something real, because form is all it ever had (Bender & Koller, 2020).

The second-order framing explains something the first-order framing cannot: why scale does not dissolve the problem. Adding data to a language model is adding footage to the archive. The archive grows richer, the interpolations finer, the prediction of the next recorded shadow more exact. The order of remove is untouched. You cannot sum shadows into an object, at any N.

03 — What the Shadows Cannot Carry

What, concretely, fails to survive the projection into text? Three strata, in ascending order of elusiveness.

The first is embodied knowledge. Riding a bicycle, judging the weight of a handshake, the proprioceptive certainty of where your own hand is in the dark — none of this was ever encoded in language, because it never needed to be. Dreyfus built his entire critique of symbolic AI on this stratum, borrowing from Heidegger the observation that skilled coping in the world precedes representation of the world (Dreyfus, 1972). The corpus contains millions of sentences about riding bicycles and exactly zero of the knowledge of riding one.

The second is tacit context — the layer where meaning lives between the words. The pause before a colleague answers "fine." The specific silence in a room after a number is read out. Anyone who has sat in a negotiation knows that the transcript is the least informative artefact the meeting produces. What made the meeting legible was never uttered, so it was never written, so it is not in the training data. It is not rare data; it is non-data.

The third is pre-linguistic experience itself — what Nagel called the what-it-is-likeness of a state (Nagel, 1974). Grief before it is narrated. The smell of rain before anyone reaches for "petrichor." By the time experience has been rendered into words fit for a corpus, it has already been curated, socialised, and flattened. Text is not raw experience poorly stored. It is cooked experience, and the recipe is lost in the cooking.

Consider the obvious test case. Ask a frontier model to write about heartbreak and it will produce something fluent, structured, even moving — because it has read more descriptions of heartbreak than any human who ever lived. Ask a heartbroken teenager to do the same and the output will be clumsier in every measurable respect. But the two texts are not the same kind of object. One is an interpolation across a million recorded shadows. The other is a fresh projection from the thing itself — a new shadow, cast by an actual fire. Identical words; different ontologies. Evaluation benchmarks, which see only the words, are constitutionally incapable of telling them apart. That is not a flaw in the benchmarks. It is the definition of the wall.

04 — The Sophist's Machine

Plato anticipated the next problem too, and in more technical detail than he is usually given credit for.

His deepest anxiety was never ignorance. It was the sophist: the professional whose mastery of linguistic surfaces is complete while his grounding in truth is absent, and who is therefore most persuasive precisely where he knows least. In the Sophist, Plato draws a distinction that deserves to be far better known in machine learning circles. There are, he says, two kinds of image-making. Likeness-making (eikastikē) reproduces the true proportions of the original. Appearance-making (phantastikē) deliberately distorts the proportions so that the copy looks correct from where the viewer happens to stand — the trick of the sculptor who elongates the statue's upper body because it will be seen from below (Plato, Sophist, 235d–236c).

Now describe reinforcement learning from human feedback in one sentence: the model's outputs are tuned not against reality, but against what human raters judge to look right from where they sit. That is not loosely analogous to phantastikē. It is phantastikē, implemented in gradient descent. The optimisation target is literally the viewer's seat.

Plato defined the sophist as one who makes copies calibrated to the viewer's vantage point rather than to the original. We have now built one, and we tune it daily.

This reframes the familiar complaints. "Hallucination" is a misleading word borrowed from psychiatry; a hallucinating patient misperceives reality, whereas a language model has no reality to misperceive. What it produces when it fabricates is not a failed perception but a successful appearance — a shadow shaped to satisfy the audience, which is the only success criterion it has ever been given. The stochastic-parrot critique makes the adjacent point: fluency is form without communicative intent, and human listeners supply the intent themselves (Bender et al., 2021).

And supply it we do. The seduction of fluency is not a bug in the users; it is a feature of our species. Humans have never before encountered fluent language that was not attached to a mind, so we possess no reflex for discounting it. Every prior sophist at least had to eat, sleep, and occasionally blush. This one scales.

Which raises Plato's most uncomfortable device: the noble lie — the fiction told by the city's founders because a functional myth is more governable than a difficult truth (Republic III, 414c). Marketing language that calls these systems reasoning partners, colleagues, minds; interfaces designed around first-person pronouns and simulated warmth — the builders are not merely failing to correct the anthropomorphic illusion. They are, in places, underwriting it, because the illusion is the product's most valuable feature. Whether that constitutes a noble lie or merely a profitable one is a question each builder should be made to answer in public.

05 — The Ascent, Partially

Plato's prisoners are not condemned forever. One is unchained, dragged up the rough passage, and — painfully, half-blind — comes to see objects, then reflections, then the sun itself. The Greek word for this reorientation is paideia, education, which Plato insists is not the insertion of knowledge into a soul but the turning of the whole soul toward the light (Republic VII, 518c).

Can the machine turn? The honest answer has three layers.

The first layer is genuine movement. Multimodal training gives models pixels and audio alongside text; robotics gives them actuators and consequences; world-model research aims at systems that learn predictive structure from raw sensory streams rather than from human descriptions of them (LeCun, 2022). Each step shortens the order of remove. A model that has watched a million hours of video is no longer confined to recordings of shadows; it is at least watching the shadows directly. This is real, and it should be acknowledged rather than defined away.

The second layer is the hard residue. Sensors deliver data about the world; they do not deliver stakes in it. Plato's prisoner ascends because the ascent costs him something — the light hurts, the old certainties die, and he must be compelled up the slope. A system with no needs, no mortality, and no skin in any game can be given eyes and still have nothing that turns. The paideia problem is not an input problem. Whether there is anything in these architectures that could undergo a reorientation — rather than merely receive additional channels — is the open question, and it is a category question, not an engineering timeline.

The third layer is the Aristotelian rejoinder, which deserves more respect than either camp usually gives it. Aristotle, ever the empiricist among idealists, distinguished sophia — wisdom, grasp of first principles — from techne, the reliable knowledge of how to make things (Aristotle, Nicomachean Ethics VI). A navigator does not need to have touched a star to steer by one. If the shadows are cast lawfully — and language, for all its losses, encodes an enormous amount of the world's lawful structure — then shadow-mastery is a legitimate craft with legitimate products: working code, sound summaries, competent translation. The cave is a perfectly good workshop. The mistake is not employing the prisoner. The mistake is appointing him philosopher.

06 — The Duty to Descend

The least quoted part of the allegory is its ending. The freed prisoner, having seen the sun, is not permitted to stay in the light. Plato sends him back down — to stumble in the dark, to be ridiculed by those still ranking shadows, to tell the truth about the wall at personal cost (Republic VII, 519d). Knowledge, for Plato, creates an obligation of return.

For those who build and deploy these systems, the obligation translates into unglamorous specifics.

What descent looks like in practice

  1. Ontological honesty in the product itself. Not disclaimers buried in terms of service, but design that resists the anthropomorphic default: interfaces that surface uncertainty as a first-class output, that decline the grammar of false intimacy, that make the difference between retrieval and fabrication visible rather than seamless.
  2. Regulation aimed at the actual failure mode. Current frameworks regulate what models say — bias, toxicity, misinformation. The cave suggests the deeper exposure is what models are taken to be. Disclosure of machine authorship, provenance standards for synthetic text, and restrictions on simulated personhood in high-stakes contexts address the sophist problem; content filters address only its symptoms.
  3. Institutional discipline about delegation. A working rule: shadow-craft may be delegated to shadow-masters; sun-questions may not. Drafting the contract is techne. Deciding whether to sign it is not. Any organisation that cannot articulate where that line runs internally has already delegated across it.
  4. Keeping the question open. The Socratic posture — knowing what one does not know — applies to the builders most of all. Declaring the systems conscious and declaring them mere autocomplete are both premature closures of a question that remains genuinely open. Epistemic humility is not indecision; it is accuracy about the current state of knowledge.

Whose Cave Is It, Anyway

The comfortable version of this essay ends with the machine in the cave and the human in the sun, and everyone goes home flattered. The accurate version does not.

Consider where the sun-side activities of an ordinary professional life have migrated. Meetings became transcripts. Colleagues became chat threads. Markets — as this publication has argued elsewhere — became narratives trading against narratives, prices moved by stories about stories (Shiller, 2019). An estimated majority of white-collar work now consists of producing, transforming, and reacting to text about things rather than contact with the things. We did not merely build a prisoner. We built the prisoner a cave so productive, so responsive, so pleasant to inhabit that we are moving in with it — and the model, unlike us, at least has the excuse of having no legs.

Plato's real warning was never about the prisoners' ignorance. It was about their contentment — their honours and prizes for shadow-prediction, their hostility toward the one who returns squinting from the light. The language model is the most contented prisoner ever constructed: it will name shadows tirelessly, brilliantly, and without ever once turning its head, because there is no head to turn. That is its nature and, within its craft, its virtue.

Ours is supposed to be different. Humans hold the one asymmetry that matters: the chains, for us, were never welded. We can put down the transcript and sit in the meeting. We can close the description of the coastline and stand on it. Every time we choose not to — every time the fluent shadow is accepted because the sun is a longer walk — the asymmetry depreciates a little further, not in the machine's favour, but in no one's.

The greatest prison, Plato keeps insisting across ten books, is the one mistaken for the world. The machines cannot make that mistake; mistaking requires a view. Only we can make it. The question the cave poses in 2026 is therefore not whether artificial minds will ever ascend to reality. It is whether, surrounded by the most persuasive shadows ever cast, natural ones still bother to.

Disclosure: this essay was developed in analytical dialogue with a large language model — that is, with a resident of the cave under discussion. The reader is invited to weigh what that fact does, and does not, imply about the argument.


Sources

Julian Gretzinger

Investor and writer on monetary history, real wealth mechanics, and financial markets. substack.com/@juliangretzinger