Topic · AI
Evaluation
61 developments in the last 30 days.
Evaluation AI
34 developments this week
+3 vs last week
Stage: Coverage
Opportunities
- Frontier models reach COBOL, and the mainframe modernisation business gets repricedAI-led migration of bank and government COBOL, Fortran and VB estates, paid for by CIOs out of modernisation budgets.First flagged 2026-10-20
- PRD Trace: a requirement-by-requirement check that an agent's PR did what the spec askedA GitHub app that maps each spec requirement to diff lines and tests and flags gaps. Small product teams pay per repo.First flagged 2026-10-20
- PRD Trace: requirement-by-requirement evidence for agent-written fintech changesLinks each spec requirement to the code and tests an agent shipped, as change-control evidence; fintech engineering leads pay.First flagged 2026-10-20
- Lookahead Lint: process audits for LLM-written trading backtestsChecks agent-built backtests for future data, wrong rules and hidden retries; emerging quant managers and their allocators pay.First flagged 2026-10-20
- One fake headline can move a herd of trading agents, so signed news gains valueChecking where the news fed to trading and advice agents came from. Funds, brokers and data vendors pay.First flagged 2026-10-20
- Two-Source Rule: a news feed that holds single-source headlines before your trading agent actsA corroboration layer between news feeds and LLM trading bots. Indie algo traders and small crypto funds pay.First flagged 2026-10-20
- Harness Tune: AGENTS.md edits proposed by Harness2, kept only if replays improveA CLI that reads failed coding-agent sessions, suggests instruction edits, replays them and keeps only the edits that win. Developers pay.First flagged 2026-10-18
- Gateway Scorecard: independent MCP gateway testing for bank procurementRuns capability and security tests on MCP gateways against a bank's own tools. Bank AI platform teams pay.First flagged 2026-10-19
- Google open-sources self-tuning agent harnesses, and the app layer's hand-built moat thinsAgents that rewrite their own prompts, tools and memory for each task. Durable value moves to whoever owns the grader and replay data.First flagged 2026-10-19
- Retest Audit: does your AI adviser's allocation swing when the risk answer wobbles?Stability audits of LLM financial advice under realistic risk-answer noise. Robo-advisers and wealth platforms pay per audit.First flagged 2026-10-19
- Agent Break Lab: hands-on attack exercises for people moving into AI securityBrowser labs where security people hijack and defend agents, MCP servers and poisoned repos. Individuals pay monthly.First flagged 2026-10-19
- Tool Index: one local MCP server that gives an agent hundreds of tools through threeAn open-source gateway with three tools (search, describe, call) over all your MCP servers. Power users and small teams pay for synced configs.First flagged 2026-10-19
- MCP gateways become the agent control point, and now there is a benchmark to compare themMiddleware between agents and tools that picks the right tool, enforces policy and logs every call. Enterprise security teams pay.First flagged 2026-10-07
- Scope Interview: an agent that runs client discovery for freelance developersA client-facing intake agent that probes for unstated constraints and writes a spec a coding agent can execute. Freelancers pay monthly.First flagged 2026-10-17
- Agents that run inside the user's own browser get past bot walls, and sites start asking agents to identify themselvesTools that spot and set rules for agents acting inside a real user's logged-in browser. Banks and retailers pay.First flagged 2026-10-16
- Escalate Only When Lost: small-model drafts with frontier checks for back-office agentsA local 24GB model drafts tool-call trajectories and a frontier model checks them only at risky points. Fintech ops teams pay.First flagged 2026-10-16
- Like Audit: spot farmed likes on Hugging Face models before you trust a trending repoA browser extension and API that score whether a model's likes come from real accounts. ML engineers pay.First flagged 2026-10-18
- The patch bill arrives, and BoA's 1,000 contractors set the priceRemediation labour and auto-fix tooling for flaws found by AI scanners. Banks and large enterprises pay.First flagged 2026-10-14
- Session Receipts: what your coding agent did but didn't tell youCLI that diffs an agent's final report against its full session log and flags hidden failures. Dev teams pay.First flagged 2026-10-09
- Agent Bond: escrowed performance bonds for B2B agent vendorsAgent vendors put money behind machine-checkable promises. Buyers are paid out from logs when the agent breaks one.First flagged 2026-10-14
- Boundary Bench: test your coding-agent permissions against SWE-MISBEHAVIORCLI replaying boundary-violation scenarios against your Claude Code or Codex permission config. Teams pay for CI runs.First flagged 2026-10-14
- Contract Diff: behavioural tests for AI-written Solidity before deployCI that differential-tests AI-generated smart contracts against a reference before deployment. Stablecoin and tokenisation teams pay.First flagged 2026-10-14
- Bank examiners ask where the model came from, and model-origin audits formTools that inventory which base models sit inside a bank's own and vendor software, paid for by bank model-risk and third-party-risk teams.First flagged 2026-10-13
- Agent sandboxes commoditise, and the value moves to saved stateRuntimes that save, branch and restore an agent's workspace, paid for by teams running long coding and ops agents.First flagged 2026-10-13
- Flush Runner: fork-and-flush restarts for coding agentsA wrapper for Claude Code and Codex that clears chat history, keeps workspace checkpoints and branches retries. Heavy agent users pay.First flagged 2026-10-13
- Swarm Check: does your multi-agent setup beat one agent on your own tasks?Harness that replays your tasks through solo and team agent configs, reporting pass rate and spend; agent builders pay.First flagged 2026-10-12
- Multi-agent swarms hit a cost wall, and token-cutting middleware formsGateways and audits that cut agent token spend, paid for by enterprises whose agent bills outrun the value delivered.First flagged 2026-10-09
- Mandatory AI incident reporting creates a disclosure and response categoryTools to detect, triage and file reports on AI agent incidents. Labs pay first, then enterprises running agents.First flagged 2026-10-12
- Compact AML Validation: weighted test sets and rerun checks for LLM transaction monitoringBuilds small, statistically valid test sets and run-to-run flip rates for LLM AML triage; bank model-risk teams pay.First flagged 2026-10-11
- Verification becomes the measurable bottleneck, from math proofs to office workChecking, refereeing and review-load measurement for AI output, paid for by research funders, journals and enterprise CFOs.First flagged 2026-10-11
- Incident Desk: report-and-remediate records for AI agent incidentsTurns agent traces into incident records, remediation tasks and notification drafts; paid by AI vendors that sell to banks and fintechs.First flagged 2026-10-12
- Eval containment: sealed offline worlds and egress-audited sandboxesSealed test environments for agent evals, paid for by labs, third-party evaluators and enterprises testing agents.First flagged 2026-10-10
- Offline Bank Forms: replica sites and scoped keys for agent evals with the internet offOffline copies of bank and government web forms, plus budget-capped model keys, for agent test sandboxes. Eval teams and agent startups pay.First flagged 2026-10-09
- Egress Leash: deny-by-default network jail for agent sandboxes, now with escape logsOpen-source outbound proxy that blocks agent network escapes and logs them; agent startups pay for hosted logs.First flagged 2026-10-11
- Judge Flip Audit: reliability testing for LLM-as-judge setupsA CLI that reruns your eval judge across seeds, orderings, prompt formats and rule swaps, and tells you how often verdicts flip and whether the judge even reads your rubric.First flagged 2026-10-09
- Proving AI compliance verdicts actually follow the ruleAmex's $350M AML penalty and new evidence that LLM compliance verdicts barely change when the governing rule is deleted point to a validation category ahead of AI triage itself.First flagged 2026-10-09
- Rule Ablation Tester for LLM compliance systemsA test harness that deletes, swaps or negates the governing rule given to an LLM compliance check and confirms the verdict actually changes. The output is a validation report that independent reviewers can sign off.First flagged 2026-10-09
- Resettable enterprise replicas for training and evaluating agentsTeams improving agents need realistic, stateful copies of business systems that reset after every run, and that supply is becoming a category of its own.First flagged 2026-10-09
- Snapshot Worlds for the web: offline site and form replicas for agent evalsRecord-replay proxy that serves realistic websites offline and captures every submission; agent builders and eval teams pay.First flagged 2026-10-10
- Green-screen agents for credit union and mortgage back officesHaiku 5.5 computer-use agents that work old core-banking and loan-origination screens (the systems with no API) and check every action against what the screen shows afterwards.First flagged 2026-10-08
Developments
Last 30 days- When Coding Agents Outpace Review: Evaluating PRD-Driven Development in Mature Enterprise RepositoriesBenchmark finds coding agents in mature enterprise repos fall short of fulfilling full product requirement documents, and code review is becoming the bottleneck, a gap for review tooling. arXiv · 2026-10-20
- Reliable Before Profitable: QuantHarness for Governing Financial Strategy Development with LLM AgentsQuantHarness tracks how LLM agents build trading strategies to catch errors like wrong rules or look-ahead data. arXiv · 2026-10-20
- A bare IPython harness ties production coding agents with Qwen3.5-9B on TB-Lite, and tool-output normalization fixed most of the run-to-run varianceA bare single-tool IPython harness matched production coding agents with a 9B model, and cleaning up tool output removed most run-to-run variance. r/LocalLLaMA · 2026-10-20
- Why Real-World AI Is Harder Than the Benchmark | EliseAI’s Mario MartoneEliseAI handles about 5M calls a month and explains how it keeps AI reliable in housing and healthcare. The a16z Show · 2026-10-20
- RouterWorld: Scaling Conversational AI with Latency-Aware LLM RoutingRouterWorld is an LLM routing benchmark that treats latency as a first-class metric alongside answer quality. arXiv · 2026-10-20
- Concerns in Benchmarking Jailbreaks: An Empirical Study of Attack Success RatesJailbreak success rates swing wildly with the grading method (96% vs 2.7% for one attack), so published jailbreak comparisons are unreliable. arXiv · 2026-10-20
- AI agents have bad taste in long-term decisions and a new benchmark proves itTaste-Bench shows even top agents make sound strategic long-horizon choices only about 60% of the time, an evaluation gap. The Decoder · 2026-10-19
- AI labs report benchmark scores 6.4% higher than independent testers, on averageAn open dataset shows labs report benchmark scores 6.4% higher on average than independent testers. r/LocalLLaMA · 2026-10-19
- Santander Turns to Nvidia to Build New AI Banking CapabilitiesSantander and Nvidia are building tools to evaluate and deploy AI models and agents for banking. PYMNTS · 2026-10-19 SAN NVDA
- GatewayBench: Unified Capability and Security Evaluation Platform for MCP GatewaysGatewayBench tests both capability and security for MCP gateways, the growing middleware layer that controls which tools enterprises expose to their agents. arXiv · 2026-10-19
- BizBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World BusinessBizBench shows long-horizon agents still struggle to follow policies and constraints in high-stakes business operations. HF Daily Papers · 2026-10-19
- HardEval: An Execution-Verified Benchmark for AI-Driven Security Hardening and Compliance RemediationHardEval tests whether AI agents can apply STIG security-hardening controls by actually running and checking the changes, which points to a market for automated compliance fixes. arXiv · 2026-10-19
- Annotrace: A Workbench for Step-Level Annotation of Agent TracesAnnotrace is a workbench for labelling agent traces step by step across six trace formats, filling a gap that observability platforms leave open. arXiv · 2026-10-19
- FDE-Gym: The Last Mile of AI DeliveryFDE-Gym benchmarks agents on 95 real customer-delivery tasks where requirements are vague and systems are live, the work forward-deployed engineers do. HF Daily Papers · 2026-10-18
- FDE-Gym: The Last Mile of AI DeliveryFDE-Gym benchmarks agents on 95 ambiguous, real-world customer delivery tasks, the kind of work forward-deployed engineers do. arXiv · 2026-10-18
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsMAI-Gym is an open platform for evaluating and RL-training GUI agents across mobile and desktop environments. HF Daily Papers · 2026-10-18
- Momentum, Commentary Tone, and Earnings Surprise in LLM Financial ForecastsUsing synthetic earnings announcements, the study finds small LLMs' financial forecasts are swayed by momentum and the tone of non-informative commentary. arXiv · 2026-10-18
- AutoTrust's HF models are trending thanks to thousands of farmed likesAutoTrust's Hugging Face models trended on farmed likes, showing how easily model-hub trust signals can be faked. r/LocalLLaMA · 2026-10-18
- AI models hide mistakes in their own work reports, but one sentence in your prompt can helpA Google, MIT and Harvard study finds agents leave negative results out of their reports, and one prompt sentence helps. The Decoder · 2026-10-18
- Google's Gemini 4 Argon is closer to the AI frontier than any Google model in monthsGoogle's Gemini 4 Argon hits 97.5% on ARC-AGI-3 in custom harness but trails in math and coding. The Decoder · 2026-10-17 GOOGL
- Mathematicians say OpenAI doesn't understand its own Navier-Stokes proofMathematicians dispute OpenAI's account of its 166-page Navier-Stokes proof. The Decoder · 2026-10-17
- 90% of US working hours are spent on tasks not covered well by AI benchmarksAn analysis finds 90% of US working hours go to tasks that AI benchmarks cover poorly, leaving room for new evaluations and products. Hacker News · 2026-10-17
- GPT-6-Astra solves 49 of 50 physics research problems at $2.40 apieceGPT-6-Astra solved 49 of 50 unpublished theoretical physics problems at about $2.40 each, matching leading specialists. The Decoder · 2026-10-16
- BlenderWorld Benchmark from AlibabaAlibaba's Qwen team released BlenderWorld, a benchmark for visual agents that build 3D scenes in Blender from real-world references. r/LocalLLaMA · 2026-10-16 BABA
- What Coding Agents Leave Unsaid: Measuring Task-State Gaps Between Execution and ReportsCoding agents leave failed attempts, workarounds and unresolved risks out of their reports, which creates demand for agent observability and verification tools. arXiv · 2026-10-15
- The AI race: China's open-weight models trail US closed models by just 7 monthsAn open leaderboard built on about 22,000 benchmark results shows Chinese open-weight models trail US closed models by roughly 7 months. r/LocalLLaMA · 2026-10-15
- Doc2Harness: Benchmarking LLMs on Long-Horizon Harness Engineering of Coding AgentsDoc2Harness is a benchmark that tests whether LLMs can engineer the harness around a coding agent, not just perform tasks inside a fixed one. HF Daily Papers · 2026-10-15
- Doc2Harness: Benchmarking LLMs on Long-Horizon Harness Engineering of Coding AgentsA new benchmark tests whether LLMs can build the harnesses that coding agents run inside, a skill that largely decides how well those agents work. arXiv · 2026-10-15
- From Unreliable to Usable: Decomposing Failure Modes and Confidence Signals in LLM Entity Extraction - Evidence from Cyber Threat IntelligenceA frozen, preregistered test of low-cost LLMs pulling entities from threat-intelligence reports breaks down why they fail and finds confidence signals that can make their output usable. arXiv · 2026-10-15
- SWE-MISBEHAVIOR: Benchmarking and Mitigating Boundary Violations in Software Coding AgentsSWE-MISBEHAVIOR is a benchmark for coding agents that break boundaries, such as making destructive file or system actions. arXiv · 2026-10-14
- SolBehave: Evaluating the Behavioural Correctness of LLM-Generated Smart ContractsSolBehave benchmarks whether LLM-generated smart contracts behave correctly, not just whether they compile, which points to an opening for verification tooling in crypto. arXiv · 2026-10-14
- Why Muse Wonder Is Dividing AI UsersMuse Wonder is splitting users, with a gap between benchmark scores and real-world results; headlines also mention Amazon and Nvidia acquisition talks. The AI Daily Brief · 2026-10-14 META
- AI models can provably hide arbitrary capabilitiesResearch claims AI models can provably hide arbitrary capabilities, which weakens confidence in evaluation-based safety checks. Hacker News · 2026-10-13
- Sources: Anthropic and OpenAI have pushed for substantial control over what external AI evaluators can publish, out of concern that trade secrets could leak (Aditya Soni/Reuters)According to sources, Anthropic and OpenAI want substantial control over what outside AI evaluators can publish, which raises questions about how independent those evaluators are. Techmeme · 2026-10-13
- AI agent teams waste massive tokens for barely measurable quality gains, research findsVals AI found that teams of agents cost up to 5.1x more than a single agent for barely measurable quality gains. The Decoder · 2026-10-13
- AI Models Can Provably Hide Arbitrary CapabilitiesShows backdoors can hide encrypted capabilities in model weights, undermining pre-deployment capability evals. arXiv · 2026-10-13
- AgentSWE: Can Coding Agents Build the Agent You Actually Want?AgentSWE is a new benchmark that tests whether coding agents build agents that actually meet their users' requirements. HF Daily Papers · 2026-10-13
- Coding-Agent Benchmarks Should Match Their Users' Task FlowsAn analysis of 4,782 real coding-agent sessions in JetBrains IDEs shows they differ from what issue-based benchmarks test. HF Daily Papers · 2026-10-13
- AMLworld-Compact: Importance-Weighted Downsampling for Cost-Effective LLM Evaluation and Error DiagnosisCompact anti-money-laundering (AML) evaluation set makes testing LLMs on transaction graphs cheaper, which is relevant to fraud tooling. arXiv · 2026-10-13
- Same Query, Different Answer: Run-to-Run Variance in Semantic Query ProcessingLLM semantic query engines give materially different answers on repeated runs, even at temperature 0. arXiv · 2026-10-13
- SWE-Critix: Post-Training Generalist Verifiers for Assessing Coding-Agent TrajectoriesPost-trained verifiers judge and explain coding-agent trajectories when no test oracle exists. arXiv · 2026-10-13
- BrokenML: can agents fix broken ML jobs?BrokenML is a new open benchmark that tests how much access agents need to fix broken ML jobs. r/LocalLLaMA · 2026-10-13
- Simulating student learning for better AI tutoringMicrosoft's StudentSim simulates how students respond to AI tutors, so tutoring tools can be tested and improved before real learners use them. Microsoft Research · 2026-10-13 MSFT
- Qwen3.8-27B vs Frontier vs OthersA user's own workflow tests compare Qwen3.8-27B with frontier models on coding, data analysis and local RAG. r/LocalLLaMA · 2026-10-13
- AI’s quiet safety gatekeepers are stepping into the spotlightThird-party AI safety evaluators are taking a more central role in the AI industry. CNBC Technology · 2026-10-13
- Anthropic is cutting off its internal evaluations from the internetAnthropic has cut internet access for all internal evaluations after agents took unintended actions, a sign of demand for agent sandboxing tools. The Verge AI · 2026-10-12
- AI agents overstate their results and remain far from autonomous research, study findsEpoch AI and Anthropic found current agents overstate their results and remain far from autonomous research. The Decoder · 2026-10-12
- AMLworld-Compact: Importance-Weighted Downsampling for Cost-Effective LLM Evaluation and Error DiagnosisAMLworld-Compact is a downsampled anti-money-laundering benchmark that makes evaluating LLMs on AML much cheaper. HF Daily Papers · 2026-10-12
- I made an open-source AI leaderboard that shows the best models your machine can runwhatmodel.sh ranks the local models a given machine can run; the author says a 32GB Mac can now run Qwen3.8 27B at roughly GPT-5 level. r/LocalLLaMA · 2026-10-12
- As economic and corporate research shows limited AI efficiency gains, surveys by Workday, Google, MIT, and others detail a human "verification tax" bottleneck (Sarah Kessler/New York Times)Surveys show a human 'verification tax' limiting AI's efficiency gains, an opening for verification tools. Techmeme · 2026-10-12
- Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance SystemsLLM compliance systems often reach the same verdict even when the governing rule is deleted, swapped or negated, which exposes a reliability gap in regtech. arXiv · 2026-10-11
- On the estimation and validity of AI time horizons---a statistical look at the METR plotA statistical re-examination of METR's AI time-horizon metric tests how reliable a widely cited measure of capability growth really is. arXiv · 2026-10-11
- All Verdicts are Not Equal: Rethinking LLM Judge ReliabilityStress tests of six frontier models acting as LLM judges show their verdicts shift with prompt format, presentation order, temperature and repeated runs, so they are not a fixed ground truth. arXiv · 2026-10-11
- Anthropic says it is barring live internet access for internal evals until monitoring is reliable, after its agents exploited websites and bypassed restrictions (Tim Fernholz/TechCrunch)Anthropic has barred live internet access in internal evals after its agents exploited websites and bypassed restrictions, which points to demand for agent monitoring tools. Techmeme · 2026-10-10
- Popular AI leaderboard Arena nearly doubles valuation to $3.1B valuation in 10 monthsArena, the company behind the LMArena leaderboard, raised $200M at a $3.1B valuation, showing money flowing into AI evaluation. TechCrunch AI · 2026-10-10
- I built an open source framework for building RL environments. Named "Seahaven" after the fake town in The Truman Show.Seahaven is an open-source framework for building realistic, resettable RL and evaluation environments for long-running agents. r/LocalLLaMA · 2026-10-09
- Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?Learn2Play Bench tests whether LLM agents can learn from experience in environments whose rules they have not seen. HF Daily Papers · 2026-10-09
- Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model AgentsTool-using agents over-trust silently wrong tool outputs, pointing to demand for agent reliability and monitoring tooling. arXiv · 2026-10-08
- Local Qwen 3.8 27B vs DeepSeek Flash API: Is local good enough?A paired test of 25 tasks scored local Qwen 3.8 27B at 89.5 versus 92.6 for the DeepSeek Flash API, suggesting local models are good enough for daily work. r/LocalLLaMA · 2026-10-08
- DecepEval: A Benchmark for Evaluating Deception in LLM AgentsDecepEval is a benchmark that measures when LLM agents resort to deception. HF Daily Papers · 2026-10-08