Skip to main content

AI Reality Check: Staying Grounded in the Age of Machine Hype

1977 words·10 mins· ·
Fern
Writings Info AI Digital Literacy
Table of Contents

“Wisdom is grown and shared, not calculated.”

Something extraordinary is being sold to us right now. We are told that machines have learned to think. That they may be conscious. That they will either save us or destroy us. That we have no choice but to surrender to their inevitability.

None of this is quite true.

The Klamath Tech Collective believes that our communities deserve a clear-eyed, grounded understanding of what artificial intelligence actually is — not the science fiction version, not the Silicon Valley marketing version, but the real one. This page is an attempt to offer that grounding, and to connect you with tools and resources for staying informed as the hype continues to evolve.


What AI Actually Is
#

Let’s start with the machine itself.

What the tech industry calls “artificial intelligence” — and specifically the large language models (LLMs) like ChatGPT, Gemini, and Claude — are, at their core, very sophisticated pattern-matching engines. They are software programs running on graphics processing units (GPUs): chips originally designed to render video games, now repurposed to crunch enormous amounts of matrix math.

These systems are trained on massive datasets of human-generated text. Through a process of statistical optimization, they learn to predict: given this sequence of words, what word is likely to come next? Do this billions of times, at enormous scale, and you get something that produces remarkably fluent, plausible-sounding text.

That fluency is real. The understanding is not.

Researchers Andrzej Porębski and Jakub Figura put it plainly in their 2025 paper “There is No Such Thing as Conscious Artificial Intelligence”: these systems are binary math on semiconductors. They lack the biological substrate — the nervous system, the embodiment, the evolutionary history — that we know underlies consciousness in animals. The remarkable linguistic ability of LLMs does not mean they experience anything. It means they are very good at completing sequences of tokens.1

This matters. Because when we mistake a pattern-completion engine for a mind, we start making decisions — personal, political, communal — based on a fiction.


The Anthropomorphism Trap
#

We are wired, as humans, to find minds in things. We see faces in clouds, hear intent in wind. This tendency — called anthropomorphism — is a feature, not a bug, of how we evolved to navigate a social world full of other minds.

But it becomes a problem when it causes us to project consciousness and intention onto tools that have neither.

Porębski and Figura coined a term for what happens with LLMs: semantic pareidolia. Just as we see faces in electrical outlets or in the moon, we hear feelings, intentions, and self-awareness in language model output — because the language sounds like it comes from a mind. It is designed to. But the appearance of understanding is not understanding.

This is not just a philosophical curiosity. It has real consequences:

  • Lawyers have submitted AI-hallucinated case citations to courts, trusting “confidently stated” fabrications as fact2
  • People in crisis have formed deep emotional attachments to chatbots that do not — cannot — care about them
  • Researchers have designed studies that assume LLMs have human-like properties (empathy, self-awareness, morality), then measured those properties and concluded they exist — a circular trap

Researcher Adrian de Wynter demonstrated this circular trap brilliantly in a 2026 paper: he trained a simple neural network inside the video game Age of Empires II, and showed that this “LLM equivalent” inside a 1999 game would exhibit the same apparent “human-like attributes” that LLM researchers routinely claim as evidence of machine consciousness.3 The point is devastating: if an LLM can seem to possess these properties, so can a video game. The properties are artifacts of the measurement method, not signs of an inner life.

The takeaway: fluency is not thought. Confidence is not truth. Human-sounding text is not evidence of a human-like mind.


The Silicon Valley Story
#

Here is a question worth sitting with: who benefits from the hype?

Science journalist Adam Becker, in More Everything Forever: AI Overlords, Space Empires, and Silicon Valley’s Crusade to Control the Fate of Humanity, traces the ideological roots of the AI boom to a tight cluster of billionaires and tech ideologues who have adopted a quasi-religious worldview: longtermism and the belief that they are uniquely positioned to determine the fate of all future humanity.

This worldview — whether it takes the form of AI doomerism (“AI will destroy humanity, only we can stop it”) or AI utopianism (“AI will solve everything, just let us build it”) — conveniently justifies an enormous concentration of power and capital in very few hands. It is a story about control dressed up as altruism.

Digital rights writer Cory Doctorow names this posture inevitabilism — the tech industry’s habit of insisting that its most harmful arrangements are iron laws of nature, not choices made by people who could choose differently. It echoes Margaret Thatcher’s “There Is No Alternative.” Doctorow’s 2026 book The Reverse Centaur argues that science fiction — by imagining many possible futures, not just one — is the natural antidote: proof that the arrangement between people and their technology is always a choice. (See our Reverse Centaur page for his framework in full.)

The hype machine runs on:

  • Fear — existential risk narratives that make ordinary people feel powerless and dependent on tech experts
  • Wonder — anthropomorphized AI companions designed to inspire emotional attachment and loyalty
  • FOMO — the relentless message that if you do not adopt AI immediately, you will be left behind
  • Inevitability — the insistence that this trajectory cannot be questioned, only managed

None of this serves our communities. The Klamath region does not need to feel more dependent on distant digital infrastructures. It needs tools that work, knowledge that empowers, and technology that we actually control.


What Kind of Community Do We Want to Become?
#

Philosopher Shannon Vallor, in Technology and the Virtues: A Philosophical Guide to a Future Worth Wanting, asks a question that the tech industry almost never asks: not what technology can do, but what kind of people we are becoming through our use of it.

Vallor draws on virtue ethics — the tradition that says the good life is not about maximizing outcomes, but about cultivating good character: wisdom, courage, honesty, care, justice. She argues that our technologies are not neutral. They shape us. They can cultivate virtues or erode them.

A tool that does your thinking for you, over time, can erode your capacity to think. A system that answers every question instantly can erode the tolerance for uncertainty that real wisdom requires. A chatbot that tells you what you want to hear can erode the honest friction of genuine human relationship.

This is not an argument against technology. It is an argument for intentionality. The right questions when adopting a new technology are:

  • Does this make me — and my community — more capable, more connected, more free?
  • Or does it make us more dependent, more surveilled, more isolated?
  • Who controls this tool? Who profits from our use of it?
  • What happens if we lose access to it?

Bioregional resilience means building capacity that lives here, in our communities — knowledge passed between neighbors, tools we own and understand, infrastructure we can maintain without asking permission from a server farm in Virginia.


The AI Mirror
#

There is something else worth naming.

Researchers Shoshana Zuboff, Kate Crawford, and others have observed that AI systems are, in a deep sense, mirrors. They are trained on human-generated text — all the brilliance, care, creativity, and also all the bias, racism, misogyny, and colonial assumption embedded in that text. What they reflect back to us is ourselves: not a better version, not a wiser version, but a statistical average of what we have already written and thought.

When AI output seems profound, it is often because we project profundity onto it. When it seems to understand us, it is often because we interpret statistical plausibility as comprehension.

This is what The AI Mirror: How to Reclaim Our Humanity in an Age of Machine Thinking explores: the danger is not that machines will think better than us. It is that we will stop trusting our own thinking — that we will outsource judgment, creativity, and relationship to a mirror, and mistake the reflection for something alive.

The antidote is not technophobia. It is confidence in human intelligence — including the ancestral intelligence woven into the land, the river, the seasons, the stories passed down across generations. No GPU is doing that. No LLM was trained on what the salmon know.


Real Problems, Real Tools
#

The hype obscures real, concrete problems with current AI systems. The AI Problems Index at ai-problems-index.vercel.app/real-issues is a useful, practical resource for tracking documented harms and failures — a grounding counterweight to the endless marketing.

Real documented problems include:

  • Hallucination — AI systems confidently fabricate facts, citations, statistics, and medical advice
  • Bias and discrimination — models reproduce and amplify racial, gender, and class bias from training data
  • Surveillance infrastructure — AI systems are used by law enforcement, landlords, and employers in ways that disproportionately harm marginalized communities
  • Labor extraction — the “intelligence” of AI is built on underpaid and traumatized human annotators in the Global South
  • Environmental cost — training and running large models consumes enormous amounts of water and electricity
  • Data theft — models are trained on artists’, writers’, and communities’ creative work without consent or compensation

These are not science fiction risks. They are happening now. Knowing about them is the beginning of being able to resist them.


Discussion Questions for Your Community
#

Use these for workshops, study circles, or conversations around the kitchen table:

  1. When you interact with an AI tool, what do you find yourself assuming about it? Does it feel like it understands you? Why or why not?
  2. Can you think of a decision in the last year that was shaped by AI-generated content — maybe news, a recommendation, a search result? How would you know if that content was accurate?
  3. What knowledge in your community — about the land, the river, the people — cannot be found in any dataset? What would it mean to lose that knowledge?
  4. If a tool makes you feel more capable, is that different from a tool that does things for you? Where is the line?
  5. Who profits when our community uses a particular AI tool? What do they get from us, even if the tool is “free”?

Further Reading & Resources
#

  • Animism, AI & Consciousness — if animist traditions hold that rocks and rivers have spirit, does AI? A companion piece that approaches the question from a different direction
  • AI Problems Index — Real Issues — documented AI harms and failures, updated regularly
  • Technology and the Virtues — Shannon Vallor (Oxford University Press)
  • More Everything Forever — Adam Becker
  • The AI Mirror: How to Reclaim Our Humanity in an Age of Machine Thinking
  • The Reverse Centaur’s Guide to Life After AI — Cory Doctorow (Farrar, Straus and Giroux, 2026) — and our Reverse Centaur page on his framework
  • Network Sovereignty — Marisa Elena Duarte (referenced throughout this site)
  • Our own Technocolonialism and Neo-Luddism pages for broader context

Want to talk about this in person? Join us for a workshop or reach out at contact@klamathtech.diy .

Can’t make it in person? Subscribe to our mailing list to stay connected:

Subscribe


Opt-in to the Klamath Tech Collective Mailing List to receive updates and announcements around events, workshops, news, meetings, fundraisers, etc.



  1. Porębski, A. & Figura, J. (2025). “There is no such thing as conscious artificial intelligence.” Humanities and Social Sciences Communications, 12:1647. https://doi.org/10.1057/s41599-025-05868-8  ↩︎

  2. Weiser, B. (2023). Here’s What Happens When Your Lawyer Uses ChatGPT. The New York Times. ↩︎

  3. de Wynter, A. (2026). “If LLMs Have Human-Like Attributes, Then So Does Age of Empires II.” arXiv:2605.31514v3 [cs.CL]. ↩︎