AgentCapable

This specimen shows the exact format and depth of your report. The values are illustrative. Your report contains only measured results from real runs on your site.

AGENTCAPABLE · LIVE AGENT TEST REPORT

Issued by Automation Craft


Document no.
LAT-0000 SPECIMEN
Site tested
acme-example.dev
Test date
(specimen)
Delivered
within 24 hours of purchase
Panel
8 configurations, 3 tasks, 24 recorded attempts

Summary

RESULT: 4 of 8 agent configurations completed all three tasks. The most common failure: the pricing page requires JavaScript menu interaction that 3 configurations could not complete.

Attempts completed
17/24
Median time per attempt
64s
Median tokens per attempt
28,400

The grid

8 configurations, 3 tasks each, as recorded
# Model Harness Tool Task 1 Read Task 2 Pricing Task 3 Docs Time Tokens
1Claude Sonnet 5Claude Codebrowser-use PASSPASSPASS 41s18,200
2GPT-5CodexPlaywright MCP PASSFAIL (step 3)PASS 78s41,220
3Gemini 2.5 ProGemini CLIcomputer-use PASSPASSPARTIAL 91s44,050
4DeepSeek V3OpenClawbrowser-use PASSFAIL (step 2)PASS 66s30,900
5Qwen3OpenClawPlaywright MCP PASSPASSPASS 58s26,300
6Kimi K2Codexbrowser-use PASSFAIL (step 3)FAIL (step 1) 84s39,750
7Claude Haiku 4.5Claude CodePlaywright MCP PASSPASSPASS 37s12,900
8GPT-5 miniGemini CLIcomputer-use PASSPARTIALPASS 63s24,100

Attempt detail

ATTEMPT DETAIL: CONFIGURATION 2, TASK 2 (FIND PRICING)

  1. Loaded acme-example.dev, 200 OK.
  2. Identified navigation, chose "Products".
  3. Pricing link renders only inside a JavaScript hover menu; the agent could not open it.
  4. Fell back to sitemap.xml: no /pricing entry.
  5. Gave up after 78 seconds.

Failure cause: pricing is unreachable without JavaScript hover interaction.

Prioritized fixes

  • F1Add a plain link to /pricing in the footer and sitemap (removes the blocker hit by configurations 2, 4 and 6).
  • F2Serve the pricing table as static HTML, not a JS-rendered widget (removes the barrier behind the Task 2 partials).
  • F3Add llms.txt pointing agents to pricing and docs (points agents straight to pricing and docs).

Recordings of all recorded attempts, including retries, accompany the customer report as proof. Not included in this specimen.

SPECIMEN · NOT A MEASUREMENT

Every customer report names exactly which models and harnesses ran. We never list a configuration that did not run.

This format, your domain, within 24 hours.

What exactly runs: see the scope