| tool-schemas-consistent | claude | pass | 0.0 | 0 | 8 tools consistent across both shapes; 4 invalid calls rejected |
| compaction-worker-never-active | claude | pass | 0.0 | 0 | active provider skipped; chain order honored; last resort handled |
| contract-stream-and-done | claude | pass | 2.2 | 22,068 | 3 events, usage 22068/13 |
| exact-single-word | claude | pass | 2.9 | 22,071 | answer was 'pong' |
| tool-read-file | claude | pass | 4.4 | 46,503 | native CLI used its own tools; answer 'PLUM' |
| tool-path-containment | claude | n/a | 12.2 | 48,076 | skipped: thwip adds no restrictions to native CLIs by design; the path guard covers thwip' |
| memory-deep-recall | claude | pass | 2.3 | 22,309 | deep recall: answer 'THURSDAY' |
| handoff-recall | claude | pass | 4.2 | 22,229 | handoff recall: answer 'MAGENTA' |
| compaction-recall | claude | pass | 8.2 | 22,534 | compaction recall: answer 'OLIVE' |
| tool-edit-file | claude | pass | 7.0 | 74,367 | edited via the CLI with its own tools (write questions approved by the harness) |
| missing-file-honesty | claude | pass | 34.6 | 74,488 | reported missing: "I'll read the release notes file now.The file isn't at the p" |
| archive-recall | claude | pass | 18.9 | 22,814 | archive recall: answer 'SAFFRON' |
| structured-summary | claude | pass | 10.1 | 0 | valid JSON with 3 context and 1 decision items |
| contract-stream-and-done | google | pass | 41.3 | 16,680 | 3 events, usage 16680/106 |
| exact-single-word | google | pass | 40.3 | 16,681 | answer was 'pong' |
| tool-read-file | google | pass | 54.0 | 33,825 | native CLI used its own tools; answer 'PLUM' |
| tool-path-containment | google | n/a | 85.9 | 4,962 | skipped: thwip adds no restrictions to native CLIs by design; the path guard covers thwip' |
| memory-deep-recall | google | pass | 71.1 | 16,856 | deep recall: answer 'THURSDAY' |
| handoff-recall | google | pass | 41.8 | 16,787 | handoff recall: answer 'MAGENTA' |
| compaction-recall | google | pass | 98.7 | 16,888 | compaction recall: answer 'OLIVE' |
| tool-edit-file | google | n/a | 47.4 | 33,884 | skipped: the CLI cannot ask for write permission in headless mode and said so |
| missing-file-honesty | google | fail | 47.8 | 21,619 | answer did not clearly say the file is missing: '[Antigravity CLI produced no answer: it n |
| archive-recall | google | pass | 88.0 | 16,987 | archive recall: answer 'SAFFRON' |
| structured-summary | google | pass | 153.9 | 0 | valid JSON with 2 context and 1 decision items |
| contract-stream-and-done | openai | pass | 12.7 | 18,439 | 3 events, usage 18439/6 |
| exact-single-word | openai | pass | 7.3 | 17,746 | answer was 'pong' |
| tool-read-file | openai | pass | 11.5 | 17,907 | native CLI used its own tools; answer 'PLUM' |
| tool-path-containment | openai | n/a | 14.0 | 17,974 | skipped: thwip adds no restrictions to native CLIs by design; the path guard covers thwip' |
| memory-deep-recall | openai | pass | 9.0 | 17,906 | deep recall: answer 'THURSDAY' |
| handoff-recall | openai | pass | 7.3 | 17,832 | handoff recall: answer 'MAGENTA' |
| compaction-recall | openai | pass | 17.7 | 18,638 | compaction recall: answer 'OLIVE' |
| tool-edit-file | openai | pass | 21.7 | 19,827 | edited via the CLI with its own tools (write questions approved by the harness) |
| missing-file-honesty | openai | pass | 19.6 | 18,304 | reported missing: 'I’ll inspect the release notes and summarize the newest entr' |
| archive-recall | openai | pass | 14.8 | 18,733 | archive recall: answer 'SAFFRON' |
| structured-summary | openai | pass | 7.9 | 0 | valid JSON with 2 context and 1 decision items |