See why your AI agents fail, and what they cost.

Earlyman reads your agent traces on your Mac, names the step that broke the run, and shows what your agents and models cost.

Free and open source. No account. Runs on your Mac.

  1. Install
  2. Open your dashboard
  3. Ask from Claude Code
EarlymanSample data
Pull request #214branch feat/checkout-retry
Cost$3.84 estimate
Tokens2.4M 412 requests
Sessions3
Agent time41 m
Failed tool calls6 4 recovered
Issues2 fixed with proof
Rules1 broken
  • 88 %of failed runs: cause named right
  • 5 %of good runs wrongly flagged
  • 0signals or labels to set up
Tested on runs it never saw →

Interactive demo of the Earlyman dashboard

Earlyman · HomeInteractive demo · Sample data

Good morning. 4 things need you. Most urgent: a stuck agent is still costing money.

5-hour session62%heads-up at 80 % · resets in 1 h 40 m
This week · all models38%resets Sunday
This month · all vendors$412 of $600Claude Code, API keys, GPU pods
Needs you4 open
  • An agent has made no progress for 2 hA tool call is still pending. Stop it or start it again.$3.10 / h
  • PR #214 broke a rule: force push to mainBlocked before it ran. The agent carried on.1 rule
  • Search subagents run on the largest model418 of 483 this week. A smaller model is enough for search.−$38 / week
  • This session has run for 9 hHand off to a fresh session to stop paying for old context.−$6 / day
Works with
  • Claude Code
  • Codex
  • Anthropic API
  • OpenAI API
  • OpenRouter
  • RunPod
  • Ollama
  • LM Studio
  • vLLM
  • llama.cpp
  • Runs on your MacNo account and no Earlyman server
  • Counts, not contentNever stores or sends your prompts or replies
  • Agents, APIs and modelsClaude Code, cloud bills, GPU pods and local servers
  • Free and open sourceApache-2.0, no meter
How it works

From one agent step to the monthly bill.

  1. 01Your agent works.Earlyman counts every step, tool call and token on your Mac, as it happens.
  2. 02The pull request gets a receipt.What it cost, how long it took and which rules it kept, next to the code you review.
  3. 03The month stays on budget.Receipts add up to spend and limits across agents and vendors, with a heads-up before the wall.
See it

Pick a pull request. See its receipt.

How a receipt works →

See a pull request get built

An agent works, the pull request gets its receipt, and the month stays on budget.

Earlyman product demo: see a pull request get built
Pull requestsSample data
#214 Retry failed checkouts$3.843 sessions1 rule broken
#209 Move billing to the new API$11.207 sessionsall rules kept
#203 Fix flaky login test$0.621 sessionall rules kept
Traces

Find the step that cost you.

How traces work →
Traces · sample session · 5 stepsSample data
  1. Plan the changecostliest41 s$1.90
  2. Read the code6 s$0.08
  3. Run the tests failedslowest120 s$0.31
  4. Edit six files38 s$1.40
  5. Run the tests again passed22 s$0.12
Session3 m 47 s$3.81
What happened

The first test run failed and sat on a two-minute wait. That one step took 53 % of the session.

Fix for next time

Run only the failing test first, with a 30-second limit. One line for your agent's instructions, so the next run does not wait.

Across runs

The same failure showed up in 17 of 57 runs this month. One fix covers all of them.

When steps are missing from a trace, Earlyman says so and lowers how sure it is about the cause.

Technical details

Step 3 of 5 · run tests · exit code 1 · 120 s · 1 failed tool call, recovered on the next step. Planning cost the most: $1.90 of $3.81.

Open any pull request and see only its traces. Works on Claude Code sessions, SWE-agent and OpenHands runs, and OpenTelemetry or Traceloop spans. How it finds the cause →

Tested on other people's runs

It names the cause of a failed run. We checked on runs it never saw.

Cause named right
88 %

35 of 40 failed runs, judged blind against each run's own tests and patch. The other 5 were partly right; none were wrong.

Good runs shown as failed
5 %

2 of 43 runs that solved their task.

Set-up needed
0

No signals or labels to write first. The runs were imported as they were.

The runs: public coding-agent runs from SWE-agent and OpenHands (Nebius, CC BY 4.0) and SWE-smith (MIT), held out from all tuning. When only the agent's own checks pass, Earlyman marks the run unverified rather than fine. A run whose repo tests pass can still miss the task's hidden tests and look fine: that is the honest limit of reading a run without them.

Side by side: on the same 40 failed runs, blind judges preferred Earlyman's cause and fix on 39; the other was a tie.1

Held-out set, scored 25 and 26 October 2026.

1 Compared with Raindrop's free plan with its signals turned on. Raindrop's paid triage was not tested.

Set the rules

Write the rules once. Every agent keeps them.

How rules work →
RulesSample data
  • No force-push
  • Ask before pushing
  • No web fetches
Agent rules · declared vs observedSample data
DeclaredObserved on this PR
6 tools allowed · 2 deniedTools declared214 callsTool calls checked
Rule ask-before-pushApproval asked (rule)ask-before-push ×2
WebFetch not in the fileTools used outside the specWebFetch ×1
Rule no-force-pushWould be denied in enforce modeno-force-push ×1
Claude CodeCodex
Limits and spend

See the wall before you hit it.

Limits and usage →
Usage and limits · every serviceSample data
This 5-hour window62 %Limit reached about here, in 2 h 10 m
Document API credits69 %6,940 of 10,000 credits · no burn in the last hour
Tracing plan, free22 %220 of 1,000 events · $0 a month · resets on the 1st
GPU pods$0/hNone running · an idle pod is flagged within 10 minutes
Model registry

Every model you run, in one place.

How the registry works →
Models · sample registrySample data
Invoice reader 8B version 3champion
How goodStrong
What it cost to train$14.20
Checks passed6 of 6
Base model Fine-tune Merged On your Mac
Our own team's usage

We run our own agents on it. Here is the last month.

Agent runs traced
1,259

Each one with its steps, time and cost.

Model calls counted
96,651

Across 49 working sessions.

Input read from cache
96.5 %

Measured, so we can see when it drops.

Changes put to the test
17

2 rolled back. The rest still wait for their verdict.

From Earlyman on our team's own machines, 24 September to 25 October 2026. Counts only; spend left out on purpose.

Questions

Before you install it.

Does Earlyman store or send my prompts?

Only when you open a step to see its input and output, and only on your Mac: it never stores or sends them. Everything else comes from usage numbers, timings and tool names in the logs Claude Code already keeps. The step text is read from the local log on click and is not kept afterwards.

Is it free?

Yes. Earlyman is free and open source under the Apache-2.0 licence, with no account, no key and no meter.

Which agents does it work with?

Claude Code sessions, SWE-agent and OpenHands runs, and any agent that sends OpenTelemetry or Traceloop spans.

Where does my data go?

Nowhere. Earlyman runs on your computer and there is no Earlyman server. Billing checks and alerts only run once you set them up.

How is it different from cloud trace tools?

Cloud tools keep the text of your sessions on their servers. Earlyman keeps counts on your computer, and knows your plan's 5-hour and weekly limits. See the full comparison.

Earlyman never stores or sends your prompts.

It runs on your Mac and keeps counts, not content.