earlyink
184 first flagged20 Oct 2026

PRD Trace: a requirement-by-requirement check that an agent's PR did what the spec asked

A GitHub app that maps each spec requirement to diff lines and tests and flags gaps. Small product teams pay per repo.

Crowded · PACE benchmark plus 'code I don't understand'

Written for: Solo builder

Next step

This week, build a CLI that takes a markdown spec and a git diff and outputs the requirement table with evidence links. Run it on five of your own agent-written PRs and post the results as a Show HN.

Why now

Reviewers can't read every line any more, but they can read a checklist. Each row would show a requirement, where it was implemented, which test covers it and its status. Today's review bots comment on lines of code, not on whether the spec was met. Flash models under $0.30 per task make running this on every PR cheap.

What became possible

PACE is a benchmark of 43 enterprise tasks with 750 expert-audited requirements. It shows that coding agents working in mature repos miss business and integration requirements that isolated tests never check. A popular Ask HN thread describes engineers shipping AI-written code they don't understand.

Two ways in

  1. PRD Trace GitHub App

    Reads the linked issue or PRD markdown and splits it into atomic requirements. It posts a table comment with a file/line link and covering test for each requirement, and lists 'not found' rows first.

    Customer
    Two- to twenty-person product teams merging agent-written PRs
    Model
    $12 per repo per month, free for public repos
  2. Pre-commit trace

    A CLI that coding agents run before committing. It refuses to mark the task done while any requirement row is still empty.

    Customer
    Solo developers using Claude Code or Codex
    Model
    Free OSS wedge into the app

Competition

Crowded

These findings come from search-result summaries. I didn't check pricing, how mature these tools are, or how well their checks actually work.

Full competition notes (11 competitors)

The basic check, whether a PR satisfies its linked issue or spec, is already built into CodeRabbit, Qodo and Sourcery. Teams already pay for those tools, so a separate per-repo app that only does this would be hard to sell. The pre-commit CLI is in a worse position. Free Claude Code plugins and skills (spec-driven, Dev10x, several verification-before-completion skills, kspec) already block "done" until the acceptance criteria are verified. Charging for it would be difficult, and Anthropic or OpenAI could ship it as a built-in agent behavior. The remaining opening is narrow and mostly about depth and trust. The incumbents give an LLM verdict per issue or per criterion. I didn't see anyone splitting a long PRD into atomic requirements and linking each one to specific diff lines and to a specific test that covers it, ideally confirmed by running that test or checking coverage rather than by an LLM's opinion. An audit trail that persists across PRs would also be new: a requirement-to-code-to-test matrix that stays current as later PRs change the code. The buyers who need that kind of evidence are probably regulated or contract-driven teams in medical, fintech or agency work, not general small product teams. A new entrant would most likely win there, selling the persistent traceability record for audits and client sign-off. A PR comment alone is not enough of a product. These findings come from search-result summaries. I didn't check pricing, how mature these tools are, or how well their checks actually work.

  • CodeRabbit (Assessment against linked issues)

    An established AI PR reviewer. It reads linked GitHub, GitLab, Jira or Linear issues, checks the PR against their acceptance criteria and flags gaps in an 'Assessment against linked issues' section. This covers the core of the GitHub app idea, although its output is an issue-level verdict, not a per-requirement table with line and test links.

  • Qodo Spec Agent / requirement gaps

    Runs on every PR open or update, compares the implementation with the spec's requirements and reports requirement gaps as findings. It was labelled a research preview.

  • Sourcery GitHub Issues integration

    Finds the issue most likely related to a PR, checks each part of the issue against the change and explains any gaps.

  • PR Intent Checker

    A GitHub Action and MCP server that uses an LLM to compare a PR's diff with the requirements in the linked issue. It reports intent drift as PASS or FAIL.

  • verify-pr skill (okisdev)

    A free agent skill. It parses Closes/Fixes #N, pulls the issue's acceptance criteria, checks each one against the diff and posts a verification table with pass/fail labels. This is close to the proposed table comment.

  • spec-driven Claude Code plugin (uta2000)

    An MIT-licensed plugin whose Stop hook blocks the session until a verification agent has checked the acceptance criteria and returned PASS, FAIL or CANNOT_VERIFY with evidence. This is essentially the pre-commit trace idea, and it is free.

  • Dev10x verify-acc-dod and other verification-before-completion skills

    Several open skills that make an agent verify acceptance criteria before a task is closed. Overlaps with the CLI idea.

  • Tessl

    A spec-driven development platform. Specs link unit tests to requirements with [@test] links, and the agent checks that every requirement is satisfied when it finishes.

  • kspec for Kiro

    An open-source CLI that adds 'kspec verify' to check that an implementation matches the spec in Kiro workflows.

  • RTMX

    An open-source requirements traceability matrix toolkit for AI-driven development. It uses requirement IDs and has an MCP server so agents can query coverage.

  • Zof

    A specification catalog that flags requirements with no mapping and tests with no requirement, which is traceability between requirements and tests.

Checked 2026-10-20

Risks

  • The review-bot market is crowded, and CodeRabbit or GitHub Copilot review could add this as a feature
  • The LLM can wrongly mark a requirement as found
  • Only works for teams that write specs at all

Strong team fit; open space is the weak point (5).

tech 7 · pull 6 · space 5 · fit 9 · build 8

Exposed

Companies that could benefit or be threatened. News and context, not investment advice.

Momentum of its main topic

67 developments this week +27 vs last week
21 Sep: 0 developments22 Sep: 0 developments23 Sep: 0 developments24 Sep: 0 developments25 Sep: 0 developments26 Sep: 0 developments27 Sep: 0 developments28 Sep: 0 developments29 Sep: 0 developments30 Sep: 0 developments1 Oct: 0 developments2 Oct: 0 developments3 Oct: 0 developments4 Oct: 0 developments5 Oct: 0 developments6 Oct: 0 developments7 Oct: 0 developments8 Oct: 11 developments9 Oct: 3 developments10 Oct: 6 developments11 Oct: 2 developments12 Oct: 7 developments13 Oct: 11 developments14 Oct: 13 developments15 Oct: 14 developments16 Oct: 8 developments17 Oct: 10 developments18 Oct: 6 developments19 Oct: 8 developments20 Oct: 8 developments
Stage: Coverage

Sources

  1. When Coding Agents Outpace Review: Evaluating PRD-Driven Development in Mature Enterprise RepositoriesarXiv
  2. Ask HN: How to deal with shipping AI-written code you don't understand?Hacker News
  3. feder-cr/git-aiGitHub
  4. MiniMax M3.1 Flash shows China's AI price race has no floor in sightThe Decoder

Status history

  • 2026-10-20 Flagged as buildable