AI agent swarms are a massive waste of money, and one OpenAI developer just proved it
The idea of deploying dozens of AI agents in parallel to solve complex problems has captured the imagination of engineering teams everywhere. A developer on OpenAI's Codex project has now put numbers to what many practitioners suspected: swarms burn tokens without improving results.
Neo NeumannAI Practice LeadSeptember 17, 2026Listen to the podcast
4 min
Chapters
Key takeaways
- Run one real task through a single agent and through your swarm, then compare answer quality against token cost using actual numbers rather than impressions.
- If swarm quality matches single agent quality, shut the swarm down and keep the token savings.
- Give each parallel agent a genuinely different job and prompt, such as write the code, write the tests, check the security.
- Treat vendor claims about multi-agent orchestration with caution, since cloud providers bill for every extra agent you run.
- Remember that raising temperature varies wording, not reasoning, so extra clones repeat the same misreading of the problem.
The pitch sounds compelling. Instead of one AI agentAI agentSoftware that pursues a goal on its own: it plans steps, uses tools and takes actions with limited human input.View full definition → grinding through a task sequentially, deploy a swarm: ten agents, fifty agents, each attacking a sub-problem in parallel, their outputs merged into something greater than the sum of its parts. The demos look impressive. The architecture diagrams fill conference slides. And in 2026, every major vendor is positioningpositioningThe mental space you want your brand to occupy in your target customer's mind relative to alternatives.View full definition → their platform as swarm-ready.
Then an OpenAI Codex developer published a frank assessment: agent swarms are a massive waste of tokenstokensA token is the basic unit of text that language models process, often a word fragment, whole word, or punctuation mark rather than a single character.View full definition → with zero quality gain. That kind of statement, from someone building one of the most-watched agentic coding tools in the industry, deserves more than a retweet.
The case for parallel agent swarms
The case for agent swarms has real intellectual weight. Decomposing a large problem into parallel workstreams mirrors how human teams operate. A research task can be split across agents that fetch data, summarise sources, check for contradictions, and draft conclusions simultaneously. Compared to a single agent churning through the same steps serially, the wall-clock time drops. At scale, the architecture seems rational.
The broader context supports this direction. Anthropic is actively pushing Claude Code toward autonomous coding workflows with parallel agent configurations, as reported by The Decoder in September 2026. Multi-agent frameworks have moved from research projects to shipping products. The reasoning is not naive: if a single agent has a context windowcontext windowThe context window is the maximum amount of text (measured in tokens) a language model can process at once, including both the input prompt and the generated output.View full definition → and an attention budget, why not distribute the cognitive load?
For tasks with genuinely independent sub-components, the parallel structure has a theoretical basis. The consensus is not wrong because the idea is absurd. It is wrong because the theory rarely survives contact with what tokens actually cost, and with how quality actually behaves at the seams between agents.
Do agent swarms improve output quality?
The Codex developer's claim is specific: no quality gain, and substantial tokentokenA token is the basic unit of text that language models process, often a word fragment, whole word, or punctuation mark rather than a single character.View full definition → waste. That specificity matters. Token consumption is not an abstraction. OpenRouter's token usage chart from mid-2026 showed consumption curves that have prompted genuine debate about whether current AI usage patterns are economically sustainable. When you run a swarm, each agent maintains its own context, executes its own reasoning steps, and produces its own output that a coordinator then has to parse. The overhead is multiplicative.
The quality problem is subtler. Agent outputs have to be reconciled. The coordinator, whether another LLMLLMA Large Language Model is an AI system trained on vast text data to predict and generate language, enabling tasks like writing, summarizing, and answering questions.View full definition → call or a deterministic merge, has to resolve conflicts, fill gaps left by agents that misunderstood their scope, and produce coherent final output. Every handoff is a failure surface. The Decoder's item on rogue agent oversight captures the second-order problem: agents act faster and at greater volume than humans can realistically review, which means errors compound before anyone catches them.
KDnuggets published analysis showing that token usage in search-result contexts can be cut by up to 74% through smarter formatting choices. That figure is relevant here because it illustrates a broader principle: most token waste in agentic systems is architectural, not inevitable. You do not need to run ten agents to process ten documents if a single well-structured agent with efficient input formatting can process them sequentially in less total compute. The swarm adds coordination overhead while the underlying inefficiency in context handling goes unaddressed.
There is also a reliability dimension that the swarm literature largely ignores. In production, understandinghow cost, latency, and reliability interact exposes a brutal trade-off: more agents means more APIAPIApplication Programming Interface: a standardised interface that lets applications communicate and exchange data without knowing each other's internal workings.View full definition → calls, more points of failure, more latency variance, and more unpredictable billing. A single agent failing mid-task is a recoverable event. Five agents failing at different points in a parallel workflow, with partial outputs that the coordinator now has to handle gracefully, is an engineering incident.
The Anthropic push toward parallel agent workflows is real, but worth reading carefully. Anthropic is a vendor with a commercial interest in workflows that consume more Claude tokens. That does not make the capability useless, but it means their documentation should not be treated as neutral evidence that swarms outperform single-agent approaches on quality metrics.
How to choose between a single agent and a swarm
First, stop treating agent count as a proxy for sophistication. The instinct to add more agents to a hard problem mirrors the instinct to throw more junior analysts at a report. More bodies rarely improve the thinking; they multiply the coordination tax.
Second, audit where the tokens actually go. Before spinning up any multi-agent architecture, run the single-agent version and measure output quality against a human-graded rubric. If the single agent hits 80% of the quality bar at 10% of the token cost, the swarm needs to justify the gap with specific evidence, not theoretical appeal.
Third, distinguish the cases where parallel agents genuinely help. Truly independent sub-tasks with no shared state and no required coherence at the output stage are reasonable candidates. Code testing across isolated modules, data retrieval from separate sources that will be displayed separately, or parallel translation pipelines where outputs never need to merge are examples where the swarm structure adds speed without adding coordination risk. Understandinghow the perceive-plan-act-observe loop works in a single agent before adding a second agent is not a beginner exercise; it is the professional standard.
Fourth, watch the coordination layer. The orchestrator in any multi-agent system is where quality actually lives or dies. If your orchestrator is another LLM call that has to reconcile conflicting agent outputs, you have not distributed the hard problem, you have deferred it and made it harder. Build the orchestrator to be deterministic wherever possible, and reserve LLM judgment for cases where rules genuinely cannot handle the decision.
The Codex developer's critique is a useful corrective against a trend that is driven more by architectural aesthetics than by production evidence. Swarms are not categorically wrong, but they are almost never the first tool to reachreachThe number of unique people exposed to your message in a given period. Unlike impressions, reach counts each person once, no matter how often they see it.View full definition → for. A well-designed single agent, with clean inputs and a clear task scope, outperforms a poorly coordinated swarm on cost and reliability in most real-world deployments. That is the conclusion the token data keeps pointing toward, and practitioners who internalize it early will ship better systems than those who are still debugging their orchestration layer six months from now.
Frequently asked questions
Are AI agent swarms worth the token cost?
In most deployments, no. An OpenAI Codex developer described agent swarms as a massive waste of tokens with zero quality gain, because each agent keeps its own context, runs its own reasoning steps, and produces output a coordinator must then parse. The overhead is multiplicative, while quality gains rarely show up in production.
When does running multiple agents in parallel actually make sense?
Parallel agents work when sub-tasks are genuinely independent, with no shared state and no need for coherence at the output stage. Code testing across isolated modules, retrieval from separate sources displayed separately, and parallel translation pipelines whose outputs never merge are reasonable candidates. Anything requiring reconciliation pushes the hard problem into the coordinator.
How do I test whether a multi-agent setup beats a single agent?
Run the single-agent version first and score its output against a human-graded rubric before building any swarm. If the single agent reaches 80% of the quality bar at 10% of the token cost, the multi-agent architecture has to justify that gap with measured evidence rather than architectural appeal.
Why is the orchestrator the weak point in multi-agent systems?
The orchestrator is where quality lives or dies, because it resolves conflicting agent outputs and fills gaps left by agents that misread their scope. Every handoff is a failure surface. Using another LLM call as orchestrator defers the hard problem instead of distributing it, so keep the coordination layer deterministic wherever rules can handle the decision.
Go deeper
The lessons that take this article further, free to read.
- 1Multi-agent systems: orchestrator, workers, and handoffsAI agents: design, build & operate
- 2Agents vs workflows vs automations: choosing the right level of autonomyAI agents: design, build & operate
- 3Cost, latency, and reliability: shipping agents to productionAI agents: design, build & operate
- 4What an AI agent really is: the perceive, plan, act, observe loopAI agents: design, build & operate
- 5Codex: agentic coding in your environmentChatGPT & the OpenAI ecosystem
Sources
- PrismML hopes its tiny LLM will change how we all use AI
- The fix for rogue AI agents could be more AI
- Is the AI safety debate about safety or control?
- UN turns to Google to make its global data ready for AI agents
- Making global data easier to explore
- Anthropic keeps pushing Claude Code toward autonomous coding with new parallel agent workflows
- LLMs respond differently to harmful prompts when AI watermarking is used
- What’s Actually Inside 24,723 Tokens of a Search Result? We Broke It Down, Field by Field
- Base Labs launches an open-weight AI safety partnership with Hugging Face and Goodfire
- What’s So Good About ChatGPT Work? Here’s What I Found
- Rival AI agents, Instinct and Meta’s Muse, both add the ability to make calls
- 5 Free Zoomcamps From Data Pipelines to AI Agents
- AI agent swarms are a massive waste of tokens with zero quality gain, says OpenAI Codex developer
- OpenRouter's staggering token chart is the AI bubble debate in a single image
Finished reading?
Validate your read to earn XP and feed your radar.