43% of Atlas Score
The repository provides a 500-problem dataset for evaluating large language models' calculation abilities, including synthetic arithmetic, algebra, and real-world problems, plus competition problems translated via Gemini API. It also includes an evaluation notebook that runs any LLM (via LangChain) on the dataset and reports accuracy by category and difficulty.