Skip to content

AI Developer Tool · TypeScript

evals-action

GitHub Action for Copilot Evals: lint evaluation definitions, preview execution plans, and run Vally suites in CI with clear results and regression reporting.

An organisation's project: the project boards rank individual builders, so it is shown here without a rank. Among builders' projects it would sit 67th in NLP & LLMs.

What it is

The evals-action is a GitHub Action that integrates the Vally CLI to validate, lint, run AI model evaluations, and update pull request comments with results. It automates the evaluation workflow for AI models, particularly for Copilot skills, within GitHub Actions.

  • ai
  • ci
  • evals
  • github-actions
  • github-copilot
Scored at3971be015 Nov 2026Changes since

Merit describes the code at this commit. Later pushes count once the owner rescans. How merit is scored

Distribution based on AI work

1 / 2
NLP & LLMs: 70.0%Computer Vision: 10.0%Data Science: 10.0%AI Agents: 10.0%
  • NLP & LLMs70%
  • Computer Vision10%
  • Data Science10%
  • AI Agents10%

Each field's share of the project's AI work, as scoring counts it. It ranks in the field it is most about.

What the judge found

Read from the project's code at its scored commit.

Strengths3

  • Well-documented with clear usage instructions and examples.
  • Modular and maintainable TypeScript codebase.
  • Solves a specific integration problem effectively (Vally with GitHub Actions).

Limitations

The owner keeps this project's limitations private.

Where it would sit on the NLP & LLMs board

Whole board
  1. 65Open-SnowflakeCoreEducational Implementation · Python57.9/100ImplementationFlameF0X
  2. 66ctirAI Developer Tool · TypeScript57.8/100ImplementationFulvio
  3. 67, shared rankcdeEducational Implementation · Python57.4/100ImplementationJarad Peckenpaugh
  4. 67, shared rankdocenticAgent System · JavaScript57.4/100ImplementationYahya Efe Kuruçay
  5. 67, shared rankevals-actionAI Developer Tool · TypeScript57.4/100ImplementationGitHub

More from GitHub