Article tracking: Trump
Determine whether an article is describing a new action/policy by the Trump administration.
| Model | Pass rate | Tests | Avg tokens |
|---|---|---|---|
| claude-opus-4-0 | 200 | – | |
| kimi-k2-thinking (moonshotai) | 200 | 330 | |
| gpt-4o-mini | 200 | 2 | |
| qwen3-235b-a22b-2507 | 200 | – | |
| deepseek-chat-v3-0324 | 200 | – | |
| qwen3-14b | 200 | – | |
| claude-3-5-sonnet-20241022 | 200 | 23 | |
| qwen3-30b-a3b-2507 | 200 | 2 | |
| claude-sonnet-4-0 | 200 | – | |
| gpt-oss-20b | 199 | – | |
| gemma-3-12b | 200 | – | |
| gpt-oss-120b | 200 | 119 |
Full results
Loading results…