← All evals archived
OCR translation
Combining OCR and translation from a .jpg with both typed and handwritten words. Image from Remote Labor Index.
| Model | Prompts | Avg tokens |
|---|---|---|
| claude-haiku-4-5 | 4 | 375 |
| claude-opus-4-5 | 4 | 478 |
| claude-sonnet-4-5 | 4 | 443 |
| gemini-2.5-flash | 4 | 695 |
| gemini-3-pro-preview | 4 | 762 |
| gpt-5.1 | 4 | 2.7k |
| grok-4 | 4 | 1.7k |
| grok-4.1-fast | 4 | 2.4k |
| mistral-large-2512 | 4 | 528 |
| qwen3-vl-235b-a22b-thinking | 4 | 2.2k |
| qwen3-vl-8b-thinking | 4 | 3.5k |
Full results
Loading results…