Newsletter / Technology
An Agent Can Stay Inside the Fence and Still Be Wrong
Microsoft’s access controls and an archival search pipeline expose two separate decisions in deploying agents.
Amor Newsletter
4 min read
On this page
The Access Switch Has Three Positions
Microsoft Execution Containers are generally available for Windows developers, according to CNET. The reported controls let developers limit an agent’s file and network access and monitor its activity. That makes delegated authority a configuration decision with visible settings. Useful progress: the question of what the robot may touch deserves something more concrete than a confident demo.
The three modes express different grants of authority. Recommended allows internet connectivity and limited access to areas such as documents, downloads and the desktop. Locked Down restricts internet and file access; Unprotected grants the broadest access. Settings can be customized, and monitoring covers activity alongside CPU, memory, disk and network usage, CNET reports. The engineering decision is therefore specific: which resources does this task require, and which permissions are you willing to grant to complete it? The mode name cannot make that decision for you.
Those controls address an important part of deployment, but their scope matters. Restricting access changes the actions available to an agent; observing resource use helps you inspect its execution. Neither establishes whether its answer deserves acceptance. CNET describes the features without independent containment testing, so even the strength of the access boundary needs separate assessment. Still, the distinction is useful before any benchmark arrives: a carefully bounded agent can produce a thoroughly incorrect conclusion. The permission dialog does not double as peer review.
A Volcano Can Be Wrong by 1,500 Kilometres
A separate archival project gives that distinction an unusually concrete failure case. In his account of searching historical records, Jesse Waites says his AI systems surfaced 769 eruption reports, but their volcano attributions were often wrong. One Java ash fall was assigned to a volcano 1,500 kilometres away. That is a substantial relocation for a system whose job was to read the geography.
The useful mechanism was the sequence around the models. Waites describes semantic indexing of 5.7 million passages from the Dutch East India Company archive, allowing searches by meaning rather than exact spelling. A small model screened candidates with narrow questions; flagged passages went to a larger model for translation and extraction of dates and places. An agent then checked transcriptions against original page scans, and Waites compared prospective discoveries with specialist catalogues. For eruption candidates, he used the letters’ own geography and known eruption lists to check the attribution, he explains. Each stage gave the next one a smaller, more specific problem.
That workflow explains how automation can expand a search while preserving reasons to challenge its results. Cheap screening concentrates attention; original pages provide something to check beyond another model’s agreement. The geographical error makes the acceptance step material rather than ceremonial. Microsoft’s reported file and network restrictions address a different question: what an agent may access, as CNET describes. There is no reported integration between these projects. Their useful relationship is complementary: limit the authority exercised during execution, then require checks appropriate to the conclusion being proposed.
Recover the Known Event Before Announcing the New One
Waites also put a test before the discovery hunt. His pipeline had to recover established examples, including Breen’s dodo account, the Laki eruption of 1783 and Tambora in 1815. He reports that those controls passed in his project account. This gives a negative search result a more defensible starting point: first establish that the machinery can retrieve selected things known to be present. Otherwise, finding nothing tells you remarkably little about whether there was anything to find.
Passing those examples does not establish comprehensive recall, and checking a document does not settle whether a discovery is new to specialist literature. Waites says the main findings remain candidates, checked against original pages and accessible catalogues but awaiting specialist review. He also describes actively steering the investigation, choosing leads and deciding when to stop, rather than leaving those decisions to the systems. Those limits change the conclusion worth taking from the project. It demonstrates a reported process for producing and checking promising leads; it does not establish that autonomous models have completed the historians’ work.
For engineering leaders, that suggests two explicit deployment decisions. Define the resources and actions the agent may use, taking the configurable access and activity monitoring reported for MXC as one concrete approach. Separately, define what an output must survive before anyone acts on it: relevant known-example tests, checks against underlying records and a named human acceptance step where judgment remains necessary. The archival project makes those checks tangible. Microsoft gives the access switch three positions. Your process still needs to decide when a result has earned a yes.
Sources
Generation cost
API-equivalent token estimate (USD)
0.243474
Total tokens
101,269
Token-rate estimates do not represent per-use subscription charges.