ParseBench local-parser tracker
Scores from ParseBench (arXiv:2604.08538), Table 5, plus later leaderboard entries we verify before adding. Footprints are practical 16GB-MacBook estimates (4-bit quantized weights for VLMs, CPU pipeline for Docling). Last updated 2026-08-08. Maintained by okraPDF.
| Parser | Runs | Footprint | Overall ▼ | Tables | Charts | Content faithfulness | Semantic formatting | Visual grounding |
|---|---|---|---|---|---|---|---|---|
| LlamaParse Agentic | hosted | ~1.2¢/page | 84.9 | 90.7 | 78.1 | 89.7 | 85.2 | 80.6 |
| Gemini 3 Flash (minimal) | hosted | ~0.6¢/page | 71.0 | 89.9 | 64.8 | 86.2 | 58.4 | 56.0 |
| Chandra OCR 2 | 16GB Mac | ~3.5 GB | 70.1 | — | — | — | — | — |
| Reducto | hosted | ~2¢/page | 67.8 | 70.3 | 57.0 | 86.4 | 56.8 | 68.7 |
| Qwen 3 VL 8B | 16GB Mac | ~6 GB | 62.0 | 74.7 | 28.2 | 87.6 | 64.2 | 55.2 |
| Dots OCR 1.5 | 16GB Mac | ~3 GB | 55.8 | 85.2 | 0.9 | 90.0 | 47.0 | 55.8 |
| Docling (OSS) | 16GB Mac | ~2 GB | 50.6 | 66.4 | 52.8 | 66.9 | 1.0 | 66.1 |
| MinerU 2.5 | 16GB Mac | ~1.5 GB | 45.9 | 71.7 | 1.1 | 80.8 | 4.5 | 71.5 |
How to update: edit the DATA array in this file (one entry per parser, one line per dimension set), bump UPDATED, redeploy.
Source repo: apps/web/blog/public/blog/parsebench-local-tracker/index.html.