Aiming
Straighten and crop a seaside banner
Fail
40m 5s$5.0224,021,779 tokensInstructions not followed. Looped without progress
Task IDaiming/banner_crop
Overall rating
66
#24 of 29 runs
Per-task results
88 tasks across 8 types, every one recorded. Pick one to watch exactly what the model did.
By task type
Aiming
Instructions not followed. Looped without progress
Task IDaiming/banner_crop
Cost is the model / provider cost. Every task counts toward the pass rate, including any whose gold answer is not yet verified (flagged "Gold unverified"). Each trace was reviewed against its task's rules: a pass that broke one is disqualified and counts as a fail.