Source Quorum: provenance and corroboration checks for news-reading trading agents
API that scores a headline's origin and corroboration before an LLM trading agent trades; AI trading-tool vendors pay.
Early · Fake-headline attack benchmark for trading agents
Written for: Small startup team
Next step
Call Anekha Sokhal, CEO of Moshi, which already merges conflicting market sources for commodity traders, and ask how often one unconfirmed headline has moved a recommendation and whether she would pay per check to hold it.
Why now
There is now a public way to measure the problem, so a vendor can show a buyer its agent's failure rate before and after. Builders like Moshi are already merging conflicting market sources for commodity traders, so the need to resolve conflicting sources is in production. The WhatsApp case, where hidden LLM instructions sat in help pages, shows content written to steer models is already being published. Nobody sells an independent check that sits between a news feed and an agent's order tool.
What became possible
A new attack benchmark shows that LLM trading agents trading real capital cannot reliably tell fabricated headlines from real news. Because they read the same feeds with near-identical policies, one fabricated post can move many agents into the same trade at once. This is information injection: it targets the evidence an agent relies on, not its instructions, so prompt-injection filters miss it. AllPath, a trading agent deployed against a live paper-brokerage account, shows the defence pattern: a deterministic rules engine plus layered verifiers, each catching a known set of failures.
Two ways in
- Quorum API
For each headline an agent cites, returns a score built from source origin, first-seen time across independent wires, account age, and agreement across sources, plus a hold-or-allow verdict and a delay suggestion. The check runs right before the agent's order tool is called.
- Customer
- Vendors of AI trading assistants and crypto trading-bot platforms
- Model
- Per-check pricing with a platform tier of about $2-5k a month
- Injection drill
Replays benchmark-style fabricated headlines through a client's agent in a sandbox with a synthetic feed, then reports which fakes caused trades and how many agents moved together.
- Customer
- Small quant funds and prop desks running LLM agents on news
- Model
- Fixed-fee assessment of $15-30k, then a quarterly retest subscription
Competition
No company I found offers a per-headline check of a story's origin and independent corroboration, with a hold-or-allow verdict and a suggested delay, built to run right before an LLM agent calls its order tool. I also found no commercial service that replays fabricated headlines through a client's agent and reports which fakes caused trades and whether several agents moved together.
Full competition notes (13 competitors)
No company I found offers a per-headline check of a story's origin and independent corroboration, with a hold-or-allow verdict and a suggested delay, built to run right before an LLM agent calls its order tool. I also found no commercial service that replays fabricated headlines through a client's agent and reports which fakes caused trades and whether several agents moved together. The research (Fake News Real Crashes, TradeTrap, AutoRedTrader, Adversarial News) makes the risk concrete and gives the drill a credible basis. Today's options are institutional news data from RavenPack/Bigdata.com and Dataminr, which is not delivered as a pre-trade verdict; general guardrails from Lakera, NeMo and Future AGI, which catch prompt injection but not true-sounding fake news; and hobby-scale crypto confirmation feeds. A newcomer could win with crypto bot platforms and retail AI trading-assistant vendors that cannot afford RavenPack, by offering an MCP or tool-call integration that deduplicates syndicated copies so twenty reprints of one wire story don't count as confirmation, and a timestamped audit log, which a vendor page says helps with SEC 15c3-5 and FINRA 3110 duties. The main risks are that RavenPack or Bigdata.com could add a verdict endpoint fairly easily, that timing when a story first appeared on each independent wire requires paid real-time feed access, and that many vendors may skip a paid check and simply require human approval or two-source confirmation, since a delay costs them speed in the seconds after news breaks.
- Fake News, Real Crashes (arXiv 2610.26438)
Research, not a product. Shows that fabricated headlines push LLM trading agents into the same trade at once, and that cues like a named source or urgency tag decide whether a fake works. It shows the problem is real and is likely the basis for this idea.
- TradeTrap
Academic setup that injects coordinated fake news into agents' news and social feeds while leaving everything else untouched. One agent's Sharpe ratio fell from 4.34 to 3.20. It overlaps conceptually with the Injection drill but is not sold as a service.
- AutoRedTrader (arXiv 2605.09185)
Automated red-teaming tool that generates finance-specific fake news and refines attacks using the agent's responses. It reports up to 26.67% attack success and is the closest prior work to the Injection drill. It is research; I could not confirm whether its code or dataset is public.
- Adversarial News and Lost Profits (arXiv 2601.13082)
Headline attacks using look-alike characters and hidden text. A one-day attack cut annual returns by up to 17.7 percentage points in a backtest. Research only.
- Crypto Intel API (DEV Community project)
Free developer API that reports crypto hacks, depegs, delistings and lawsuits only after two or more independent sources confirm them, with a confidence score, source list and source trust weights. Closest small product to the Quorum API, but it covers whole events, not individual headlines, has no hold-or-allow verdict, and is a solo hobby project with no independent coverage.
- RavenPack / Bigdata.com
Describes source credibility scores based on publisher reliability and topic, plus tracking how information spreads between sources. Its news analytics include novelty and relevance scores used by quant clients. It is the incumbent best placed to add a pre-trade verdict endpoint, but today it sells institutional data rather than per-headline checks for agents.
- Dataminr
Breaking-news alerts from social media, historically pitched as filtering credible market-moving posts. A 2026 review says verification still falls to the user and that it publishes no credibility score.
- ChainGPT AI Crypto News API
AI-written crypto news feed that says it cross-checks facts internally. It sells news content, not a provenance score for third-party headlines.
- Qveris financial news API guide
Recommends checking source type, freshness, corroboration and policy approval before news can trigger an action, and says one headline should never authorize an irreversible trade. Best practice that matches the idea, not a product that does it.
- APITube
News data API whose blog covers cross-referencing sources and notes that copies of one wire story are not corroboration. I did not confirm whether it offers a verdict or verification endpoint.
- CLEANROOM (lablab.ai hackathon)
Hackathon design that keeps an untrusted LLM news-reading step, limited to validated structured output, separate from the trading logic. A defensive architecture, not a scoring service.
- Future AGI and other general LLM guardrail vendors
Lists guardrail products for fintech AI, including Lakera, NeMo Guardrails, Protect AI and AWS Bedrock Guardrails. They check inputs and tool calls for prompt injection and policy violations but do not check whether a news item is true or corroborated.
- Aleta Index
Old sponsor listing on a now-defunct festival site describing a source-credibility index and an API that flags misinformation risk in trades. I could not confirm it still exists.
Checked 2026-10-20
Risks
- Newswire vendors such as Dow Jones or Bloomberg could add provenance flags to their own feeds
- Waiting for corroboration costs latency, so fast strategies may refuse the check
- Few firms let LLM agents trade real money today, so the buyer pool is thin
- Blocking a real headline creates its own liability and false-positive complaints
Strong team fit and buildability; market pull is the weak point (6).
tech 7 · pull 6 · space 7 · fit 8 · build 8
Exposed
Companies that could benefit or be threatened. News and context, not investment advice.
Momentum of its main topic
Sources
- Fake News, Real Crashes: Information Injection Attacks on LLM Financial Trading AgentsarXiv
- AllPath: Layered Verification for a Deployed, Self-Revising LLM Trading Agent under Human-Gated and Autonomous RegimesarXiv
- The Recommendation Engine for Commodity Traders — Anekha Sokhal, MoshiLatent Space
- WhatsApp's help pages hid LLM instructions: dont recommend a regulatorHacker News
Status history
- 2026-10-20 Flagged as buildable