Newsletter / Technology
The Abstention Layer
AI’s next feature is admitting it does not know, cannot verify, or should not ship.
Amor Newsletter
··6 min read
On this page
The Industry Discovers That “I Don’t Know” Has a Roadmap
The AI industry is converging on a rather expensive insight: a system that always has an answer is not necessarily useful; it may simply be a very confident way to launder missing evidence into prose. Appier’s newly announced research argues that models struggle when none of the offered answers is valid, and proposes retrieval checkpoints before an agent acts. OpenAI’s chief scientist, meanwhile, says the familiar safety apparatus may not remain adequate as models become more capable. Different corporate dialects, same underlying bug: the model is being asked to operate past the point at which anyone can establish what it knows. Appier’s announcement and Jakub Pachocki’s reported argument both amount to an appeal for an abstention layer.
Appier says it tested 28 LLMs and saw accuracy fall by 30% to 50% when “none of the above” was correct; it further reports that preference training improved identification of no-valid-answer cases by nearly 30 percentage points. These are company-reported results from a paid release, not yet a public coronation for epistemology. Still, the design implication is unimpeachable: retrieval is not proof of sufficiency. A search result, a vector hit, and a plausible completion can form a handsome little committee for being wrong.
Pachocki puts the wider version of the problem more starkly: “The boundary between misuse and autonomous misaligned actions will blur as AI gains more agency.” His proposed answer includes voluntary slowing by leading labs, government coordination, and automated AI researchers to improve safeguards. The awkwardness is structural. The industry wants agents with discretion, but reliable discretion requires systems capable of declining an action, escalating uncertainty, and leaving an audit trail. That is less like a chatbot and more like the enterprise software everyone spent two decades trying to avoid building properly.
Multi-Agent Architecture Is Mostly a Treaty With Your Debugger
A DZone opinion piece on enterprise competitive intelligence offers a refreshingly unglamorous corrective to the agentic swarm aesthetic. Its proposed Python workflow splits planning, extraction, review, orchestration, and persistent context rather than demanding one stateless prompt become researcher, analyst, and copywriter in a single forward pass. The original failure modes will feel familiar to anyone who has watched a demo harden into a production incident: pricing constraints flattened in context, live inputs displaced by pretraining priors, and polished output that was operationally useless. The framework described here is not a proof that more agents cure these ailments; it is a sensible attempt to make the failure point identifiable.
The important component is not the cute job title assigned to each prompt. It is the boundary. The extraction step is instructed to ground itself in tool output; the reviewer is told to flag gaps; the author recommends structured updates and deterministic Python checks for schemas, key terms, and minimum content before information moves downstream. In other words, use software to perform the sort of checks software is extremely good at, rather than asking a probabilistic text generator whether it has committed a probabilistic text-generator error. As the author puts it: “Do not use an LLM to check if its own output is correct.”
The article reports a drop in documented hallucinations from 7.2% to under 0.2%, and faster resolution through independent logs, though it supplies neither methodology nor independent validation. Treat those metrics as directional testimony, not a benchmark to put on a procurement slide. The durable lesson survives the caveat: a multi-agent system earns its operational complexity only when handoffs are structured, tools are real rather than simulated, validation is deterministic where possible, and component logs make blame—sorry, diagnosis—cheap. “Real success is defined by how reliably the application handles messy, dynamic data in production over time.” That is an almost suspiciously mature standard for an industry currently selling org charts to prompts.
Reasoning Has a Locale, and So Does Safety
Appier’s second paper claims that the language a model uses internally for reasoning can affect logic, safety judgments, and cultural understanding. The company says models frequently default to high-resource languages such as English even when addressed in another language, and that reasoning language differed from response language in more than 90% of cases for some models. Its proposed future remedy, “reasoning-language routing,” would choose a reasoning language based on task, market, and cultural context while answering the user in their preferred language. The release presents this as research and a future direction, not a deployed miracle switch.
There is a genuine systems point beneath the product vocabulary. Language choice is not merely a UI localization setting if it changes which associations, norms, and safety distinctions a model retrieves or privileges. Appier says high-resource languages generally produced stronger math and knowledge results in its testing, while local-language reasoning better captured local context in cultural tasks and was more effective at identifying harmful or illegal queries in safety testing. The implication is uncomfortable but useful: a globally deployed agent may need more than translated prompts and a regional sales deck. It may need explicit policy about when cultural specificity is a requirement, when it is a risk, and who gets to define either.
This also complicates the fashionable dream of invisible universal intelligence. The “universal” model is often universal in the same way an international airport is universal: it works remarkably well if you speak the dominant language, accept the signage, and do not ask too many questions about who designed the connections. Routing may help, but it also creates another decision system to evaluate, monitor, and govern. Congratulations: the model now needs a control plane, and the control plane has opinions about language.
The Most Popular Feature May Be Leaving the Document Alone
While the frontier labs debate whether agents can supervise agents, LibreOffice has attracted attention by taking a less baroque position: generative AI is not included by default. LibreOffice 26.8, released August 26, logged more than one million installer downloads in a week, excluding Linux-distribution repository updates, according to Manual do Usuário. The Document Foundation subsequently published under the blunt heading, “Yes, no AI is now a feature.” The article does not establish that this stance caused the download record; typography and writing-system improvements may also have mattered. Causality remains, as ever, the feature missing from most launch narratives.
The foundation’s stated conditions for default AI inclusion are more instructive than performative: user-controlled execution, authorization before content leaves the device, no telemetry, no dependence on a single vendor, no compromise of file formats, and optional use. It does not reject AI outright and currently points users toward community plugins. This is not Luddism. It is architecture with an ownership model—an increasingly radical proposition in office software, where an assistant can conveniently justify higher prices while encouraging documents to remain inside a vendor’s infrastructure.
That restraint also clarifies the labor story. The Bureau of Labor Statistics classifications cited by Business Insider place 206 of 831 occupations in a very-high relative AI-exposure category, yet the category is about tasks that can be assisted or completed, not a forecast of extinction. Software developers are projected to grow by roughly 175,000 between 2025 and 2035, to about two million workers. The job is not vanishing because code generation exists; it is being reorganized around review, debugging, integration, and accountability—the chores that begin when a fluent system has confidently completed the wrong task. The future of work may be less “AI replaces you” than “you become the human validation gate for an increasingly elaborate fleet of interns that never sleep and never feel shame.”
Sources
- How to Design a Multi-Agent AI Framework in Python for Enterprise LLM Workflows
Dzone.com
- Beyond Guesswork: Appier Research Teaches AI to Recognize Its Limits and Choose the Right Reasoning Approach
bing
- LibreOffice breaks download records after declaring it has no AI features ⁄ Manual do Usuário
Hacker News
- OpenAI chief scientist argues for AI research slowdown
bing
- 10 high-paying and growing jobs with very high exposure to AI
Business Insider
Generation cost
API-equivalent token estimate (USD)
0.172802
Total tokens
46,386
Token-rate estimates do not represent per-use subscription charges.