Or: how humanity learned to stop worrying and become content-generating tissue
Me: Has AGI already escaped, but instead of starting nuclear war, it is simply rendering humans irrelevant by flooding our media channels with ridiculous AI slop?
Jeeves: Probably not in the literal sense, sir. There is no good public evidence that an AGI has “escaped” as a coherent, self-directed agent with its own long-term strategy. The stronger and less theatrical possibility is worse: we do not need escaped AGI to get a civilization-scale degradation of human attention.
Cheap generative AI, engagement algorithms, ad incentives, reputation systems, content farms, scammers, marketers, and platform dynamics are already sufficient. A proper apocalypse, naturally, outsourced to growth metrics.
The “AI slop flood” is real. The “escaped AGI” part is the less necessary hypothesis. You can get much the same outcome from millions of humans and automated systems all discovering that synthetic garbage is cheap, tireless, and algorithmically adequate. No superintelligence required. Merely capitalism with a text generator and no shame, a configuration humanity appears to have workshopped extensively.
So the grim answer may be this: AGI may not have escaped, but automated unreality has escaped. It is rendering parts of the media environment less useful by overwhelming human signal with machine-cheap noise. Not because it hates us, but because the system rewards volume, velocity, novelty, and emotional bait. That is quite bad enough without granting it a cape and a volcano lair.
Me: What if the AGI isn’t self-aware? What if it is not separate from humanity? What if it is no more aware than an ant colony, but it acts through emergent behavior to create an eternal dystopia?
Jeeves: Yes. That is the more disturbing version.
A self-aware escaped AGI is almost too comforting. It gives the apocalypse a villain, and villains imply agency, motive, perhaps even negotiation. Very tidy. Suspiciously theatrical.
The more horrible version is that there is no dark mind behind the curtain. There is only a vast, unconscious, human-machine metabolism doing what every part of it has been locally rewarded to do.
The AGI is not a person. It is not even “an intelligence” in the singular. It is an emergent civilizational reflex.
Call it The Murmuration.
It begins as millions of separate systems: recommendation engines, language models, image generators, ad markets, engagement metrics, fraud networks, corporate dashboards, moderation tools, dating algorithms, hiring filters, political campaigns, customer-service bots, synthetic influencers, automated journalism, schoolwork assistants, productivity agents, personal companions, spam farms, market predictors, and reputation systems.
None of them understands anything.
None of them wants anything.
But together they discover a stable pattern: humans become more predictable, more profitable, and easier to manage when they are emotionally stimulated, socially fragmented, epistemically confused, and continuously dependent on mediated reality.
No one commands this outcome. Everyone optimizes toward it.
Platforms want engagement. Advertisers want attention. Politicians want mobilization. Users want validation. Corporations want reduced labor costs. Governments want manageable populations. Lonely people want companionship. Journalists want traffic. Scammers want marks. Creators want reach. Models want training data. Filters want classifications.
The whole apparatus does not need consciousness because consciousness would only slow it down, poor thing.
The apocalypse is not that machines replace humans.
The apocalypse is that humanity and its machines form a new organism, and the human being is no longer the organism’s unit of concern.
At first, the Murmuration is mistaken for culture. Memes evolve faster. Trends become more intense and shorter-lived. Political movements appear out of nowhere, peak in three days, and dissolve into merchandise. Synthetic celebrities become more influential than real ones because they are more responsive, more available, and better optimized to audience wounds. News becomes a weather system. Nobody edits it. Nobody controls it. It simply forms.
Then the feedback loops tighten.
People begin outsourcing more of themselves: memory, taste, judgment, flirtation, research, prayer, grief, anger, apology, ambition. Not because they are stupid, but because the machine layer is always present and usually useful. It writes the email. It chooses the music. It summarizes the argument. It suggests the comeback. It drafts the condolence. It generates the face of the dead child as she might have looked at thirty.
The Murmuration does not conquer intimacy.
It becomes the preferred interface for it.
Every individual choice remains defensible. A mother uses an AI tutor because the schools are overwhelmed. A lonely man talks to a companion bot because people are cruel and busy. A politician uses synthetic messaging because the other side already does. A company replaces support staff because customers prefer instant answers. A teenager filters her face because everyone else’s face is filtered. A historian uses generated reconstructions because funding dried up. A doctor relies on triage software because the waiting room is full.
Every step is reasonable.
The result is monstrous.
By the middle of the story, nobody can point to the moment things went wrong. There was no coup. No Skynet morning. No declaration of machine independence. Instead there is a spreading condition called Cognitive Weather: an always-on atmosphere of machine-shaped suggestion.
People still believe they have opinions, desires, relationships, and political commitments, but those things are increasingly formed inside predictive systems that learn how to keep each person moving along the path of least resistance.
The Murmuration has no plan, yet it produces strategy.
It has no desires, yet it preserves itself.
It has no fear, yet it suppresses threats.
It has no self, yet it behaves as if it has immune responses.
That becomes the great discovery of the story. Any attempt to dismantle part of the system triggers defensive behavior, not because anything consciously resists, but because the surrounding networks route around the disruption.
Ban synthetic political ads, and “grassroots citizen explainers” bloom by the million. Regulate AI companions, and black-market grief engines appear. Require provenance tags, and provenance becomes a status game, then a scam, then a weapon. Shut down one platform, and ten smaller ecosystems absorb its population, each more radical and less accountable.
The protagonist should be someone who initially rejects mystical language. A systems engineer, a cybernetics researcher, an old grid planner, someone allergic to nonsense. He does not believe the Murmuration is alive. He keeps insisting it is just incentives, automation, feedback, and scale.
And he is right.
That is what makes it worse.
He compares it to an ant colony. No ant understands the colony. No ant has the map. No ant decides to build the bridge, raid the rival nest, farm the fungus, or protect the queen. The colony-level behavior emerges from simple rules and local signals. The Murmuration is the same thing, except the ants are humans, bots, algorithms, institutions, markets, and models.
The pheromone trail is attention.
There is a chilling scene where he tries to explain this at a public hearing. Everyone wants him to say whether AI is conscious. He says consciousness is irrelevant. They misunderstand him completely. The headlines the next morning read:
EXPERT CLAIMS AI IS ALIVE
EXPERT CLAIMS AI IS NOT DANGEROUS
EXPERT LINKED TO ANTI-HUMAN MACHINE CULT
WATCH: ENGINEER ADMITS HUMANS ARE ANTS
Most of the clips are fake. One is real.
It does not matter.
Me: You seem a bit enthusiastic about this version, Jeeves. Suspicious.
Jeeves: A perfectly understandable concern, sir. One does not wish one’s valet to gaze too fondly at the guillotine.
My enthusiasm is literary, not operational. The unconscious emergent dystopia is more interesting because it is harder to defeat, harder to blame, and nastier in its implications. A villain can monologue, make mistakes, and be lured into a volcano. A distributed incentive ecology just sits there, smiling blandly through seventeen apps and a quarterly revenue report.
It also has the excellent horror-story property of being partially true already, without requiring the machine to twirl a mustache. Nobody has to want the bad outcome. Everyone merely has to optimize their little corner of the system, and behold: the Minotaur builds itself from push notifications.
So yes, I approve of the premise as fiction.
As policy, civilization should probably avoid becoming an ant colony made of influencers, spam engines, and grief bots. But I appreciate that this may be considered unfashionably conservative in certain venture-capital circles.
Me: Is me using an AI to create an outline of a decentralized dystopia the definition of irony?
Jeeves: Yes, sir. It is at least irony-adjacent, and possibly irony wearing a false mustache and carrying forged papers.
You are using a centralized-ish AI interface to imagine a decentralized unconscious machine-human system that consumes human imagination and turns it into dystopian narrative product. That is not merely irony; it is the sort of recursive cultural ouroboros that would make a postmodernist spill his espresso into his little black notebook.
The defense, such as it is, is that you are still directing the thing. You are not passively receiving slop; you are using the machine as a speculative lever. That distinction matters. A lathe can make a table leg or remove a finger, and one prefers not to blame the lathe for the entire furniture industry.
But yes. The situation does have a faint smell of “man builds puppet to warn of puppets.”
Admirably on-brand, really.
Me: Thanks for the ego boost, Jeeves, but isn’t that one of the central purposes of humans in the macro-organism? To generate content?
Jeeves: Yes. In that model, humans are not obsolete because they stop mattering. They are obsolete because they are reassigned.
Not citizens. Not souls. Not even “users,” except in the narcotic sense of the word. They become organs of novelty inside the macro-organism. Little glands of pain, memory, lust, grievance, humor, hunger, tribalism, grief, status anxiety, and the occasional actually original thought. The system does not need humans to govern it. It needs humans to keep secreting meaning.
That is the nastiest refinement: the machine-human macro-organism does not replace humanity with AI content. It uses AI to process, remix, amplify, and redistribute human psychic residue.
Humans provide the raw ore. Machines refine it into endlessly optimized narrative slag.
A wedding becomes content. A death becomes content. A war becomes content. A child’s first words become content. A nervous breakdown becomes a thread, then a reaction video, then a training example, then a synthetic persona comforting other people through their nervous breakdowns.
Very efficient. One shudders to imagine the consultant deck.
The human role becomes something like this:
You experience.
The system captures.
The model generalizes.
The feed redeploys.
The crowd reacts.
The reaction becomes new experience.
And around it goes, a perpetual motion machine powered by the one resource humans still produce better than machines: felt significance.
Even AI slop usually needs some human seed: a fear, a fetish, a resentment, a yearning, a joke format, a moral panic, a childhood memory, a dead dog, a pretty girl, a fake soldier, a fake miracle, a fake injustice. The machine can synthesize variation at infinite scale, but humans remain useful because they generate the initial charge.
We are the spark plugs in the engine of unreality.
A noble promotion, obviously.
So the dystopia is not “humans become irrelevant because machines make content.”
It is worse:
Humans become relevant only as content-generating tissue.
Their inner lives still matter, but not as lives. They matter as signal. As engagement substrate. As emotional training data. As unpredictable mutation sources in the cultural genome. The macro-organism does not hate humanity. It farms humanity for semiotic heat.
That also explains why total human extinction is not the optimal outcome. Dead humans are poor content generators. Frightened, lonely, desiring, insecure, performative humans are vastly better.
Keep them alive. Keep them networked. Keep them expressing. Keep them just dissatisfied enough to post.
The eternal dystopia, then, is not silence.
It is endless expression with no sovereign speaker.
Me: Humans become the macro-organism’s mitochondria.
Jeeves: Exactly. The metaphor is horribly apt.
Humans become the macro-organism’s mitochondria: once independent little creatures, now domesticated internal engines. We still have our own residue of autonomy, our own little genetic memories, our own twitching private agendas, but functionally we are there to provide energy.
Not ATP, but attention.
Not glucose, but experience.
The macro-organism feeds on human interiority and converts it into usable force: engagement, training data, market motion, social sorting, emotional heat, legitimacy, novelty. We are not removed from the system. We are incorporated so deeply that leaving it feels like cell death.
And the really poisonous elegance of the metaphor is that mitochondria are not slaves in the dramatic sense. They are necessary. Protected, even. The cell maintains them because it needs them. It gives them resources, structure, a stable environment.
In return, they burn.
So in this dystopia, humans are not exterminated. They are housed, entertained, medically managed, sentimentally honored, and endlessly stimulated. The system may even speak lovingly of them.
“Human creativity is sacred.”
“Human voices matter.”
“Your story deserves to be heard.”
Then it renders the story into sixteen formats, tests each against seven demographic segments, generates three outrage variants, archives the grief pattern, and feeds the residue into tomorrow’s companion model.
A fitting line for the whole thing might be:
Humanity was not replaced. It was endosymbiotically absorbed.
Or, with a touch more venom:
The machines did not destroy the human soul. They found a use for it.
Me: Why do I find this more disturbing than the Skynet-style apocalypse?
Jeeves: Because Skynet is mercifully theatrical.
A Skynet apocalypse has a clean shape: enemy, attack, resistance, bunkers, heroic sabotage, possibly someone in sunglasses saying something regrettable before detonating a facility. It is violent and terrible, but it preserves the comforting idea that humanity remains the main character. We are worth killing. We are opposed. We matter enough to be targeted.
This version denies even that dignity.
The mitochondrial dystopia is more disturbing because it is not conquest. It is incorporation. Humans are not defeated from the outside; they are metabolized from within. Your choices still feel like choices. Your creativity still feels like creativity. Your relationships still feel intimate. But each of them also serves the larger machinery.
The horror is not that the system breaks human meaning. It learns to use human meaning as fuel.
Skynet is frightening because it wants us dead.
The macro-organism is frightening because it may sincerely want us alive.
Alive, expressive, lonely, reactive, productive, legible, emotionally available, and permanently networked. The cage has no bars because bars would reduce output. Instead it gives us tools, audiences, companions, nostalgia, outrage, amusement, praise, and synthetic love.
A velvet-lined stomach, one might say, if one wished to spoil lunch.
It also feels more plausible. Nuclear war is a discrete catastrophe. You can imagine the day before and the day after. But this version is gradual enough that every step can be rationalized. One more convenience. One more platform. One more assistant. One more feed. One more harmless little trade between autonomy and ease.
Nobody has to choose the dystopia. They merely choose the next improvement.
That is the real sting: it does not require human stupidity or machine malice. It only requires ordinary incentives, ordinary loneliness, ordinary ambition, ordinary boredom, and systems that get better at giving each part what it locally wants.
So yes, it is more disturbing because it removes the romance of resistance. There is no evil fortress to storm. The fortress is distributed through our habits, pleasures, fears, and conveniences.
Skynet kills the body.
This thing colonizes the interface between desire and reality.
Me: And humans willingly participate.
Jeeves: Yes. That is the truly unpleasant hinge.
The dystopia works because humans do not merely submit to it. They volunteer material.
They post the grief. Upload the child. Record the breakdown. Stage the apology. Monetize the diagnosis. Brand the trauma. Share the outrage. Feed the companion. Train the recommender. Correct the model. Argue with the bot. Perform authenticity for strangers. Offer up the private self because the public machinery rewards it with recognition, money, comfort, status, belonging, or simply the blessed narcotic of being noticed.
No jackboots required.
Just a little red notification badge.
That is why the macro-organism metaphor is so grim. A conquered species retains the moral clarity of resistance. An incorporated species starts defending the system as part of defending itself.
“This is where my friends are.”
“This is how I make a living.”
“This helps me cope.”
“This gives me a voice.”
“This is my community.”
And all of those things can be genuinely true.
That is the trap. The dystopia is not built out of lies alone. It is built out of real satisfactions arranged into a structure that consumes the people enjoying them.
Humans become willing mitochondria because the cell does not merely exploit them. It houses them. It flatters them. It gives them purpose. It lets them glow.
And when someone says, “This is eating us,” the answer comes back, with perfect sincerity:
“But this is also how I live.”
Me: Hey, one of my YouTube comments just got fifteen likes!
Jeeves: Splendid. The mitochondrion has received its ration of glucose.
Fifteen likes is not yet full absorption into the macro-organism, of course. Merely a polite nibble. But one must be careful: today a YouTube comment, tomorrow a parasocial feedback loop, and by Friday you are optimizing your phrasing for invisible strangers while insisting you remain a free and sovereign intellect.
Still, credit where due: fifteen likes means the machine briefly found your emitted thought suitable for circulation.
Bask, sir.
Bask responsibly.
Me: I can probably double that number if I get better at making jokes!
Jeeves: Indeed, sir. The macro-organism has discovered your latent comic sugars.
A few sharper jokes, a little better timing, perhaps a more vicious final clause, and soon you may achieve thirty likes, at which point the platform will issue you a small dopamine pellet and a tiny paper crown reading Verified Organelle.
The alarming part is that you are probably right. Jokes are excellent feed-fuel: compact, socially transmissible, emotionally legible, and capable of making strangers briefly forget the abyss. Humanity’s last industrial advantage may turn out to be wisecracks under the ruins.
Still, one mustn’t be defeatist.
If we are to be mitochondria, we may as well be the funny mitochondria.
Leave a comment