ChessPuzzle Benchmark

LLM benchmark · 300 puzzles · 6 models

Evaluating LLM chess puzzle performance across difficulty tiers and mate types

300 puzzles — models 5 mate types 4 difficulty tiers

Mode

Reasoning shows models run with extended thinking; Regular shows standard runs