Key takeaways
- OpenAI published the Terminal X customer story on October 20, 2026. Terminal X says its GPT-6.1 Sol-based Eval Agent agreed with a senior human reviewer on 88.6% of 500 scored judgments, versus 86.4% for an unnamed next-best model—a 2.2-point difference.
- Terminal X says the same Sol evaluator caught about 25% more recommendations that departed from a fund mandate and ran at about 30% lower cost per query at similar speed. These are company-reported relative results without raw counts or a named baseline.
- The evaluator checks outputs against 54 pass-or-fail criteria covering source selection, numbers, comparables, quotations, narrative coherence, recommendation fit and house views; each failure is paired with a reason and proposed correction.
- The evidence is directly relevant to one customized investment-review workflow, not a general claim that GPT-6.1 Sol has 88.6% financial accuracy or can replace an investment committee. The page does not report confidence intervals, reviewer count, label blinding, class balance or out-of-sample performance.
- Builders should copy the workflow pattern—not the headline percentage: define mandate-specific criteria, preserve source trails, compare named models on frozen cases, inspect disagreements and require humans to own consequential investment decisions.
OpenAI published the Terminal X evaluation on October 20
OpenAI published a customer story on October 20, 2026 describing how Terminal X uses GPT-6.1 Sol and GPT-6 Luna in customized investment agents. The central new result is narrow and concrete: across 500 scored judgments, Terminal X says an Eval Agent using GPT-6.1 Sol agreed with a senior human reviewer 88.6% of the time. The unnamed next-best model reached 86.4%, making the reported difference 2.2 percentage points, or 220 basis points.
This is not a new model launch or an independent benchmark. GPT-6.1 Sol has been available since September under the API identifier gpt-6.1-sol. The October story adds customer-reported production evidence about one evaluation workflow. Terminal X is available through a book-a-demo sales motion and says its customer-specific agents can be deployed on-premise or in a customer cloud; neither reviewed company page publishes a self-serve Terminal X price.
The agent grades outputs against 54 firm-specific criteria
Terminal X describes an orchestrated Eval Agent that reviews every agent answer against 54 pass-or-fail criteria. The checks cover whether figures, comparables, consensus data and quotations came from appropriate sources; whether the narrative is coherent; and whether the recommendation fits the firm’s mandate and house view. A failed check includes a short reason plus a proposed source or corrected text.
The surrounding system is customized rather than generic. Terminal X says its staff reconstruct how a customer’s investment teams screen deals and write memos, encode those processes into agents and sub-agents, and retain analyses, committee decisions, instructions and house views in a versioned “Capital Memory.” That context makes the result more relevant to bespoke investment review and less portable to an off-the-shelf financial chatbot.
The relative gains are promising but underspecified
Terminal X says GPT-6.1 Sol caught about 25% more recommendations that drifted outside a fund’s mandate than the next-best model. It also reports about 30% lower cost per query at similar speed. The story attributes the cost result to Sol’s token efficiency and a deeper review sequence: test the thesis against the mandate, compare it with recent deals, rerun uncertain verdicts and reconcile results.
Those percentages cannot be turned into absolute error or dollar rates from the published material. OpenAI and Terminal X do not identify the comparator, count mandate-drift cases, publish the confusion matrix, disclose how many senior reviewers labeled the cases, state whether labels were blinded, report repeated-run variance or provide token totals. “25% more” could describe different absolute gains depending on prevalence; “30% lower cost” depends on model, prompt, reasoning effort, cache behavior, price band and retry policy.
The 88.6% figure is agreement, not investment accuracy
The measured outcome is agreement with a senior reviewer across scored judgments. It does not establish that 88.6% of investment recommendations were correct, that returns improved, or that the system predicts markets. A reviewer can be internally consistent without being objectively right, and agreement can hide different error costs. Missing a prohibited strategy, approving a fabricated quotation and disagreeing on writing style should not be averaged into one deployment threshold without severity weights.
The article separately reports company-level operating figures: 1,700 firm Memories, more than 1 million custom workflows, an 81% weekly-to-monthly active-user ratio, and $2.4 million in annualized savings for one private-equity customer. These are Terminal X claims carried in an OpenAI customer story. No customer identity, calculation period, counterfactual labor baseline, realized investment outcome or independent audit is provided.
Current API pricing does not prove the reported query cost
OpenAI’s current Standard short-context prices for GPT-6.1 Sol are $2 per million input tokens, $0.10 cached input, $2.50 cache writes and $10 output. The model page documents a 1,050,000-token context window and 128,000 maximum output, while requests above 272,000 input tokens use higher rates for the full request. Batch, Flex, Fast mode and regional processing can also change the bill.
The customer story does not publish prompts, token classes, tool charges, reasoning settings, retries or the comparison model’s rates. Buyers therefore cannot reproduce the 30% figure from list prices. Measure cost per accepted review on the complete workflow, including retrieval, evaluation passes, human corrections and failed runs, rather than comparing only headline token rates.
Use the pattern, then rebuild the evidence on your cases
A useful pilot starts with a frozen set of real, permission-cleared historical cases and a rubric written before model selection. Name every comparator, blind reviewers where practical, preserve source documents and traces, separate factual checks from mandate and style checks, and report counts as well as percentages. Evaluate held-out cases after every change to model, memory, retrieval or instructions so the system is not merely learning the test set.
Trial the pattern for analyst-assistance and quality-control tasks where every claim remains source-linked and a qualified person reviews the output. Constrain authority, data access and retention. Wait if the vendor cannot provide task-level error evidence, reproducible cost logs or deployment controls. Reject autonomous investment authority: the published result supports a bounded evaluator experiment, not delegation of fiduciary judgment.
Copy-ready domain evaluator evidence record
Complete this record before using a model-agreement headline to approve an AI review workflow.
Entries stay in this browser tab and are not submitted to AccessAllGPT. Blank responses are copied as [Unresolved].
Trial, constrain, deploy, wait or reject; exact desk, workflow, output, user, owner, review date and prohibited decisions.
Population, sampling dates, inclusion rules, case and judgment counts, prevalence, train/tune/test separation, held-out set and contamination checks.
Criterion definitions, evidence requirements, pass/fail rules, severity weights, mandate version, adjudication path and rubric freeze date.
Reviewer qualifications and count, independent labels, blinding, disagreement resolution, intra- and inter-rater agreement and conflicts.
Exact model IDs, snapshots, prompts, retrieval corpus, memory state, tools, reasoning effort, context band, cache state and fallback.
Confusion matrix and counts by criterion; agreement, precision, recall and severe-error rate; confidence intervals; repeated-run variance and missing runs.
Input, cache-write, cached-input, output and tool usage; retries, latency, human review, rework and cost per attempted and accepted case.
Source trace, permissions, data boundary, human approval, transaction prohibition, monitoring, kill switch, incident path and rollback.
Triggers for retesting after model, prompt, rubric, corpus, mandate, price or workflow changes; expiry date and accountable approver.
Primary sources
Browse the publication-wide evidence index →
- Terminal X matches senior investor judgment 88.6% with GPT-6.1OpenAI · Reviewed: October 20 publication date; product and deployment description; Capital Memory workflow; 54-criterion Eval Agent; 500-judgment agreement result; mandate-deviation detection; comparative cost and speed; customer savings; usage and adoption figures · Retrieved · Supports: OpenAI published a Terminal X customer story on October 20, 2026. It reports Terminal X-provided results for an investment-workflow Eval Agent using GPT-6.1 Sol, including 88.6% agreement with a senior reviewer across 500 scored judgments, 25% higher mandate-deviation detection and about 30% lower cost per query than an unnamed next-best model.
- Terminal X investment-agent platformTerminal X · Reviewed: Current product positioning; Capital Memory; data, workflow, trace, editing, report, evaluation and delivery stages; on-premise deployment statement; booking-based access; real-time evaluation claims · Retrieved · Supports: Terminal X currently markets an investment-team AI platform that combines firm data, workflows and memory, exposes agent steps and sources, evaluates changes against answer keys from customer work, and is offered through a book-a-demo motion with on-premise deployment.
- GPT-6.1 Sol model referenceOpenAI Developers · Reviewed: Current model identifier and positioning; text and image input; context and output limits; reasoning levels; Responses and Chat Completions support; tools; batch and residency availability; long-context and regional price qualifications · Retrieved · Supports: OpenAI currently documents gpt-6.1-sol as an available API model with a 1,050,000-token context window, 128,000 maximum output, five reasoning-effort levels, Responses API tools, Batch support, and US and EU data-residency options subject to documented constraints.
- OpenAI API pricingOpenAI Developers · Reviewed: Standard GPT-6.1 Sol short- and long-context token tables; cache-write and cached-input rates; Batch, Flex and Fast processing; long-context threshold; regional-processing uplift · Retrieved · Supports: The current Standard short-context table lists GPT-6.1 Sol at $2 input, $0.10 cached input, $2.50 cache writes and $10 output per million tokens. Requests over 272,000 input tokens use higher rates for the full request, and processing modes and regional routing can change the price.
- Introducing GPT-6.1 SolOpenAI · Reviewed: Model positioning; September 2026 launch; vendor capability claims; standard token prices; coding, professional-work and computer-use sections; pricing and availability · Retrieved · Supports: OpenAI introduced GPT-6.1 Sol in September 2026 for coding, computer use and professional work, positioning it between Astra and Luna. The launch article provides vendor-run model results and list-price context, not independent validation of Terminal X performance.
Limitations
This is a first-party customer-story and documentation review, not an independent Terminal X or GPT-6.1 Sol evaluation. AccessAllGPT did not receive the 500 judgments, 54-criterion rubric, source documents, human labels, model outputs, prompts, traces, token logs, invoices, customer contracts or savings calculation; identify the comparator; use Terminal X; call gpt-6.1-sol; test mandate drift; reproduce agreement, cost, speed, savings, workflow, usage or adoption claims; assess investment quality or returns; audit security, privacy, data residency, on-premise deployment or model training; or interview OpenAI, Terminal X, its customers or reviewers. The published sample composition, class balance, absolute error counts, reviewer count, blinding, confidence intervals, run variance and held-out performance are unknown. Product behavior, access, model specifications and prices can change.
Disclosures
AccessAllGPT received no OpenAI or Terminal X account, demo, API credit, customer data, benchmark files, early access, briefing, review, payment or compensation for this article. OpenAI and Terminal X did not sponsor, review or endorse it. AccessAllGPT Research is operated by NeuralArc, is independent, and is not affiliated with OpenAI, Terminal X or any investment firm. Publication-wide relationships are listed on the disclosures page.
Further AccessAllGPT guidance
- OpenAI Launches GPT-6.1 Sol at $2 Input and $10 Output per Million Tokens
- Choose a Model Without Chasing the Leaderboard
- Design an Agent Benchmark That Predicts Production
- AI Agents vs. Workflows
- Set Human Approval Boundaries for AI Agents
- AI API Data Retention and Residency: Set the Procurement Gates
- AccessAllGPT Research methodology
- Evidence standards
- Publication disclosures
Continue the research
Get evidence-led updates for teams making production AI decisions.