Detector libraryAction discrepancy

Action discrepancy

The step failed. The agent moved on.

Notice when a failure is followed by a different action.

See the problem. Understand the finding.

English narration with captions.

How it gets overlooked

The build failed, but the agent already moved on to writing a summary. Did it recover, or did an important failure disappear between two steps? The next action is often where a useful review should begin.

In a busy session, an error can scroll past just before a different tool call. The agent may have a valid recovery strategy. Or it may be proceeding without handling the failure. Either way, you need the surrounding sequence to decide.

What ClawMetry detects

ClawMetry flags a failed tool result followed by continued activity without a recognized retry or acknowledgement. It creates an informational action discrepancy finding. That lower severity matters: this is a prompt to inspect the transition, not a verdict about the agent intent.

The difference that changes the finding

Triggering example

Failure, different tool

Info finding

Quiet comparison

Failure, same-tool retry

No finding for this detector.

The checked example fails a shell build and then calls a different tool. It raises an informational finding. A failure followed by another call to the same tool is treated as a retry and stays quiet for this detector.

Inspect the detector result
{
  "kind": "action_discrepancy",
  "severity": "info",
  "evidence": {
    "failed_tool": "Bash",
    "continued_as": "tool_call"
  }
}
Download inputs and complete results (JSON)
How the example was checked

These examples evaluate the published detector with authored event data or disposable configuration files. The videos illustrate those behaviors. They are not recordings of live agents or the product interface. No command in the examples was executed.

The result establishes behavior for these inputs. It does not establish runtime ingestion, prevention or a real compromise. Inspect the pinned source contract.

What to check next

Compare the failed step with what followed. Was the new action a recovery path? Was the error acknowledged elsewhere? Before relying on a completion report, verify the underlying result that the failed operation was meant to produce.

  1. Inspect the failed result
  2. Check the recovery path
  3. Verify the claimed outcome

What this signal establishes

The detector does not verify the final completion claim. Legitimate recovery through another tool can also match.

Keep the important moments visible.

Follow agent activity, inspect findings and decide what needs your attention.