ANLI
ReportedNatural language inference (does one sentence follow from another) with examples collected to fool earlier models.
- Kind
- Published by a third party's leaderboard, collected by Epoch AI. The leaderboard is named and linked.
- Link
- http://arxiv.org/abs/2404.14219
- Score shown
- Epoch's column "Score", as a percentage, higher is better; random guessing scores about 33.3%. The source gives no error bars.
- Results
- 15 in all: 8 for open-weight models, 7 for closed ones. 7 linked to a model page here.
Best open-weight result: microsoft/Phi-3-small-8k-instruct, 58.1%, number 2 of 15 results.
Open-weight rows are shaded. Dates are when the result was run or evaluated, where the data says. Data from Epoch AI (CC-BY 4.0), fetched 19 Nov 2026: Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from ‘https://epoch.ai/benchmarks’ [online resource]. Epoch AI. Method