Eval dashboard
Offline scores per model and per fixture issue.
Latest run · claude-sonnet-4-6
Aggregate
54.8%
30 issues
Category acc.
66.7%
File F1
26.8%
Similar recall
54.0%
All runs
| run | model | n | category | file F1 | similar | steps | dup | complete | aggregate |
|---|---|---|---|---|---|---|---|---|---|
| 2026-05-28T16:56:19.881Z | claude-sonnet-4-6 | 30 | 63.3% | 23.2% | 58.3% | 5.3 | 0.0% | 76.7% | 51.6% |
| 2026-06-08T14:23:33.829Z | claude-sonnet-4-6 | 30 | 30.0% | 21.4% | 61.7% | 5.1 | 0.0% | 46.7% | 35.4% |
| 2026-06-08T15:36:45.341Z | claude-sonnet-4-6 | 30 | 60.0% | 22.3% | 47.8% | 5.3 | 0.0% | 76.7% | 47.9% |
| 2026-06-08T16:20:32.554Z | claude-sonnet-4-6 | 30 | 66.7% | 26.8% | 54.0% | 5.6 | 0.0% | 93.3% | 54.8% |
Per-issue · claude-sonnet-4-6 (best first)
| issue | category | file F1 | similar | steps | dup | aggregate | |
|---|---|---|---|---|---|---|---|
| shadcn-ui/ui#9446 | bug | 0.67 | 1.00 | 7 | 0 | 0.90 | detail |
| shadcn-ui/ui#9278 | bug | 0.67 | 1.00 | 4 | 0 | 0.90 | detail |
| shadcn-ui/ui#9198 | bug | 0.67 | 1.00 | 7 | 0 | 0.90 | detail |
| shadcn-ui/ui#7166 | bug | 1.00 | 0.50 | 5 | 0 | 0.90 | detail |
| shadcn-ui/ui#8432 | bug | 0.40 | 1.00 | 6 | 0 | 0.82 | detail |
| shadcn-ui/ui#9635 | bug | 0.22 | 1.00 | 4 | 0 | 0.77 | detail |
| shadcn-ui/ui#9651 | bug | 0.15 | 1.00 | 4 | 0 | 0.75 | detail |
| shadcn-ui/ui#10237 | bug | 0.07 | 1.00 | 4 | 0 | 0.72 | detail |
| shadcn-ui/ui#9914 | bug | 0.00 | 1.00 | 6 | 0 | 0.70 | detail |
| shadcn-ui/ui#9753 | bug | 0.00 | 1.00 | 5 | 0 | 0.70 | detail |
| shadcn-ui/ui#9515 | bug | 0.00 | 1.00 | 8 | 0 | 0.70 | detail |
| shadcn-ui/ui#8892 | other | 0.67 | 0.00 | 7 | 0 | 0.70 | detail |
| shadcn-ui/ui#9428 | bug | 0.08 | 0.50 | 5 | 0 | 0.63 | detail |
| shadcn-ui/ui#9657 | docs→ bug | 1.00 | 1.00 | 5 | 0 | 0.60 | detail |
| shadcn-ui/ui#9118 | bug | 0.07 | 0.20 | 5 | 0 | 0.56 | detail |
| shadcn-ui/ui#9614 | bug | 0.18 | 0.00 | 5 | 0 | 0.56 | detail |
| shadcn-ui/ui#10028 | bug | 0.00 | 0.00 | 4 | 0 | 0.50 | detail |
| shadcn-ui/ui#9424 | docs→ bug | 0.67 | 1.00 | 5 | 0 | 0.50 | detail |
| shadcn-ui/ui#9403 | bug | 0.00 | 0.00 | 6 | 0 | 0.50 | detail |
| shadcn-ui/ui#7695 | bug | 0.00 | 0.00 | 5 | 0 | 0.50 | detail |
| shadcn-ui/ui#421 | question | 0.00 | 0.00 | 4 | 0 | 0.50 | detail |
| shadcn-ui/ui#51 | docs | 0.00 | 0.00 | 6 | 0 | 0.50 | detail |
| shadcn-ui/ui#10320 | bug→ other | 0.00 | 1.00 | 5 | 0 | 0.30 | detail |
| shadcn-ui/ui#9337 | docs→ other | 0.67 | 0.00 | 7 | 0 | 0.30 | detail |
| shadcn-ui/ui#10164 | bug→ other | 0.40 | 0.00 | 5 | 0 | 0.22 | detail |
| shadcn-ui/ui#9328 | feature→ other | 0.40 | 0.00 | 6 | 0 | 0.22 | detail |
| shadcn-ui/ui#9595 | ∅→ bug | 0.00 | 1.00 | 8 | 0 | 0.20 | detail |
| shadcn-ui/ui#9222 | ∅→ bug | 0.00 | 1.00 | 8 | 0 | 0.20 | detail |
| shadcn-ui/ui#10576 | bug→ other | 0.05 | 0.00 | 6 | 0 | 0.11 | detail |
| shadcn-ui/ui#7669 | feature→ other | 0.00 | 0.00 | 6 | 0 | 0.10 | detail |