Key takeaways

  • OpenAI published the customer report on October 9, 2026. Asana says the caching and retention changes have shipped in StackAI, but the reported 76× and 5× figures come from a development study on one public demo catalog—not measured production fleet savings.
  • The study tested six cache and screenshot-retention policies at 120,000- and 480,000-character history budgets, three times on each of four models: 144 selected runs, plus a separate 12-run no-pruning follow-up.
  • Asana’s best GPT-6.1 Sol condition averaged $0.47 in estimated model cost, about four minutes and 89% cached input. The original Model B baseline was at least $36.21 and about 22.5 minutes; a capped baseline run makes the ratio a lower bound.
  • The mechanism matters more than the headline: caching a growing history did not help when each call edited older screenshots or trimmed text. Larger history plus append-only stretches and batched pruning preserved the reusable prefix.
  • Treat the result as a reproducible hypothesis. Replay representative tasks with current prices and hard step, token and spend caps; compare accepted outcomes, cache writes and reads, infrastructure cost and failure behavior before changing production.
01

The October 9 report covers a shipped optimization, not a new model

OpenAI published Asana’s browser-agent case study on October 9, 2026. The underlying Asana report is dated September 30 and says the caching and retention changes have shipped in StackAI. GPT-6 Astra in Codex helped investigate the code and run the experiments; GPT-6.1 Sol was one of four inference models tested for the browser workflow.

The headline result is specific: the selected optimized workflow on GPT-6.1 Sol averaged $0.47 in estimated model cost and about four minutes, versus at least $36.21 and roughly 22.5 minutes for the original Model B setup. Asana describes that as 76 times cheaper and five times faster. It does not report a new OpenAI model, new Asana product tier, customer price, service level or production-wide savings rate.

02

Editing old history was breaking prefix reuse

The browser agent resent tools, instructions, page text and screenshots on every model call. Its tools and system prompt were cacheable, but the growing browsing history was not. More importantly, the agent removed the previous screenshot and trimmed older text at almost every step. Prefix caching can reuse only the longest unchanged beginning of a request, so those edits invalidated reuse after the changed point.

Asana tested three coupled changes: extend the cache boundary through the newest tool result, raise the text-and-tool history budget from 120,000 to 480,000 characters, and remove screenshots in batches. Under a 20:1 policy, the agent could hold up to 20 screenshots and then cut back to one, leaving about 19 append-only calls between rewrites. Simply adding history caching without stabilizing that history cost more than not caching it on three of four models at the larger budget.

03

The study ran 144 trials on one catalog task

CAT32 asked the agent to browse a public demo bookstore, collect six fields for each of 32 books and return a table plus price totals: 192 reference facts. Each model received six policies at two character budgets with three runs per condition, producing 36 selected runs per model and 144 overall. A later no-pruning follow-up added four runs on each of three models.

The four names were GPT-6.1 Sol and anonymized Models A, B and C from another frontier provider. Model B was the original production choice. Model A and B ran from September 14 to 23; Model C and Sol ran on September 30 under a different protocol. Sol used gpt-6.1-sol through the Responses API, high reasoning effort, a 30-minute cache lifetime and standard pricing. Asana therefore labels cross-model comparisons descriptive rather than controlled head-to-head evidence.

04

The best Sol condition averaged $0.47 with 89% cached input

At the 480,000-character budget with 20:1 screenshot pruning, the three Sol runs cost $0.45, $0.51 and $0.46, or $0.47 on average. They took 25, 35 and 24 calls and 3.7, 4.5 and 3.8 minutes. Cached reads represented 88%, 91% and 88% of input. OpenAI’s published rates for gpt-6.1-sol were $2 per million standard input tokens, $2.50 for cache writes, $0.10 for cache reads and $10 for output; no request crossed the study’s long-context price threshold.

Model B’s original 120,000-character baseline averaged at least $36.21 because one of three runs hit the cap, while its best tested condition averaged $1.24. That separates two effects: workflow changes cut Model B cost at least 29-fold, then the same optimized design on Sol cost another 2.6 times less. The 76× comparison combines an architecture change with a model and provider change; it is not a model-only speed or price ratio.

05

A larger budget reduced repeated work and missing answers

At 120,000 characters, Model C answered none of 18 runs and Sol answered three; most reached the step limit after repeated trimming. At 480,000 characters, all 18 runs for each model delivered an answer, and the final Sol requests retained all 192 facts. Keeping more context increased per-call input but reduced calls and moved most repeated input onto cheaper cache reads.

The larger number is not a universal minimum. No 480,000-character run actually reached the budget, and the biggest request in the follow-up was about 151,000 input tokens. A different site, tool schema, image policy or task length could behave differently. History should grow only within explicit context, step, token, wall-time and dollar ceilings; otherwise append-only design can turn a looping agent into a large uncached bill when one edit breaks the prefix.

06

Answer evidence was narrower than the headline suggests

Asana checked persisted outputs against an independently prepared catalog reference rather than accepting the agent’s success claim. Every best-condition run saw all 192 facts. At the large budget, Sol answered all 18 runs and stated the correct total in all 18. However, Sol returned a short summary rather than the requested full table; final-answer tuning was outside the study’s scope.

The result therefore supports fact collection and one total on CAT32, not general browser-agent accuracy. It does not measure login flows, dynamic pages, adversarial instructions, accessibility trees, captchas, purchases, write actions, recovery from browser failure or correctness across changing customer sites. The public catalog was live, and the paper notes that its independently prepared reference could not guarantee identical pages across every run.

07

Three repetitions cannot rank small differences

The cheapest condition was selected after observing 12 conditions per model, which creates selection bias. Most conditions had only three repetitions, one Model A condition had two analyzed runs, and parallel workflows competed for machines and providers. Baseline caps make some savings ratios lower bounds, while a stopped run may be cheaper only because it failed to finish.

Asana explicitly says the study maps broad patterns rather than distinguishing configurations a few percent apart. The two phases changed effort, tool choice, API adapter and cache lifetime. Estimated model costs use native token counters and dated list prices, but exclude browser sandboxes, application servers, engineering, review and other infrastructure. These are useful disclosures; they also prevent treating $0.47 as an all-in production unit cost.

08

What browser-agent teams should do next

Instrument the actual outbound request, not just application settings. For each call, record uncached input, cache writes, cache reads, output, prefix break reason, retained facts, screenshots, tool calls and elapsed time. Start with an append-only history, then test whether and when pruning becomes necessary. A cache write that is never read is extra cost, and a summary that silently loses task-critical state is not an optimization.

Replay several production-shaped tasks across at least one ordinary, one long and one failure-prone trajectory. Predeclare answer checks and severe-failure gates, randomize or balance run order, increase repetitions where differences are close, and include sandbox and human-review costs. Ship behind a reversible cohort only when accepted-task cost falls without weaker completion, safety or recovery. Preserve hard limits even when the best test never reached them.

09

Copy-ready browser-agent cache experiment record

Complete one record for each task family, model and history policy before changing production traffic.

Entries stay in this browser tab and are not submitted to AccessAllGPT. Blank responses are copied as [Unresolved].

Exact sites and actions, frozen fixtures, required facts and outputs, independent scorer, severe failures and accepted-result rule.

Provider, exact model ID, API, reasoning effort, service tier, region, price snapshot, cache lifetime and fallback.

Tool and instruction prefix, history ordering, cache markers, server state, images, tool results and every field that can invalidate reuse.

Text, tool and screenshot budgets; append-only interval; prune threshold and target; compaction; protected turns and fact-retention checks.

Conditions, repetitions, run order, concurrency, caps, exclusions, missing-run policy, environment versions and immutable code or artifact references.

Uncached input, cache writes, cache reads, output, calls, retries, model dollars, sandbox and server cost, engineering and review cost per accepted result.

Facts seen and retained, final-answer checks, completion, wrong actions, repeated work, p50/p95 runtime, timeouts and recovery.

Step, token, context, screenshot, wall-time and spend limits; domain and action allowlists; credentials; approvals; kill switch and audit trail.

Ship, trial, constrain, wait or reject; approved cohort; rollback; owner; expiry; unresolved evidence and re-evaluation triggers.

Primary sources

  1. Asana cuts model costs 76x in browser tests with GPT-6.1 SolOpenAI · Reviewed: October 9, 2026 publication record; browser-agent problem; role of GPT-6 Astra in Codex; 144-run design summary; tested history budgets and pruning policies; cost, runtime and cache-read results; production-status statement; quotations and caveats · Retrieved · Supports: OpenAI reports that Asana used GPT-6 Astra in Codex to investigate and run a browser-agent experiment, and summarizes Asana’s result: the optimized workflow on GPT-6.1 Sol averaged $0.47 in estimated model cost and about four minutes per run, 76 times cheaper and five times faster than the original Model B setup.
  2. How we cut a browser agent's cost 76x and made it 5x faster by keeping its cache intactAsana · Reviewed: Why Asana investigated; prefix-cache failure mechanism; history caching and batch-pruning changes; GPT-6 Astra and human roles; 144-run design plus follow-up; model anonymization; results; budget effects; answer checks; guardrails; shipped changes and stated takeaways · Retrieved · Supports: Asana describes the cache-prefix failure, its 120,000- and 480,000-character budgets, six policies, three runs per condition across four models, 12-run follow-up, 89% cached-input share for the best Sol condition, and the limits of a small one-task development study.
  3. How Asana used Codex to optimize browser agent costs and runtimeAsana (32-page study by Frank Hidalgo, PhD) · Reviewed: Technical summary; scope and limits; all results and methods; CAT32 task; two-phase protocol; request construction; Responses API adapter; measurement; answer evaluation; threats to validity; reproducibility tables; all 144 run records and 12-run follow-up · Retrieved · Supports: The report provides the underlying run ledger and protocol: one public catalog task, 32 books and 192 facts, 12 conditions per model, three repetitions, native provider usage counters, estimated model cost excluding infrastructure, explicit phase differences, post-run best-condition selection and small-sample limitations. Retrieved PDF SHA-256: 87e993baf4f4ac892846ee65c5276c94ce2282b7ab46b7e826a970748a777d95.
  4. Introducing GPT-6.1 SolOpenAI · Reviewed: Model positioning; prompt-cache price; benchmark claims and qualifications; pricing and availability; API model identifier; ChatGPT and Codex availability; standard input, cached-input and output rates · Retrieved · Supports: OpenAI documents gpt-6.1-sol at $2 per million standard input tokens, $0.10 per million cached input tokens and $10 per million output tokens, and says the model is available through the API, ChatGPT Work and Codex under the stated plan limits.

Limitations

AccessAllGPT conducted a first-party desk review and PDF integrity check only. We did not receive Asana’s code, private model names, source commits, wheels, prompts, request captures, native provider receipts, per-run manifests, Command records, production metrics or invoices; reproduce any of the 144 runs or 12 follow-ups; invoke GPT-6.1 Sol or GPT-6 Astra; verify the public catalog state during the runs; inspect the independent reference construction; validate the model reviewers; or measure quality, cache behavior, latency, infrastructure cost, safety or production savings. Asana selected the lowest-mean condition after the runs, used mostly three repetitions, changed protocol between phases, ran one task and excluded one technical failure from plotted means. Model costs are estimates from token counters and frozen list prices, exclude infrastructure, and some baseline means are lower bounds because runs hit limits. OpenAI’s report is vendor-authored customer evidence, not an independent reproduction.

Disclosures

AccessAllGPT received no Asana, StackAI, OpenAI, Codex or Command account, code, traces, credits, briefing, benchmark data, review, payment or compensation for this article. Asana and OpenAI did not sponsor, review or endorse it. AccessAllGPT did not test or rank the named or anonymized models. AccessAllGPT Research is operated by NeuralArc, is independent, and is not affiliated with Asana, StackAI or OpenAI. Publication-wide relationships are listed on the disclosures page.

Further AccessAllGPT guidance

  1. OpenAI Launches GPT-6.1 Sol
  2. Postman Details How Agent Mode Runs on Amazon Bedrock
  3. OpenAI Details How Ironclad Trained and Evaluated a Computer-Use Agent
  4. Design an Agent Benchmark That Predicts Production
  5. Choose a Model Without Chasing the Leaderboard
  6. AI API Data Retention and Residency
  7. AccessAllGPT Research methodology
  8. Evidence standards
  9. Publication disclosures

Continue the research

Get evidence-led updates for teams making production AI decisions.