Skip to content

Benchmarking Project · Python

murphysig

Natural-language provenance convention for signing human-AI collaborative code. Spec, CLI, and empirical benchmark.

An organisation's project: the project boards rank individual builders, so it is shown here without a rank. Among builders' projects it would sit 31st in NLP & LLMs.

What it is

MurphySig is a benchmarking project that evaluates a natural-language provenance convention for human-AI collaborative code. It includes a harness to run experiments across multiple LLM families, measuring effects on AI honesty and code coverage.

  • ai-assisted-development
  • anthropic
  • claude
  • code-attribution
  • dev-conventions
  • gpt
  • llm
  • murphysig
  • openai
  • provenance
Scored at9f0dea37 Nov 2026Changes since

Merit describes the code at this commit. Later pushes count once the owner rescans. How merit is scored

Distribution based on AI work

1 / 2
NLP & LLMs: 100.0%
  • NLP & LLMs100%

Each field's share of the project's AI work, as scoring counts it. It ranks in the field it is most about.

What the judge found

Read from the project's code at its scored commit.

Strengths3

  • Clear and well-documented convention (MurphySig) with empirical validation.
  • Functional benchmark harness with CLI for running, scoring, and reporting.
  • Includes heuristic scoring for local analysis without API calls.

Limitations

The owner keeps this project's limitations private.

Where it would sit on the NLP & LLMs board

Whole board
  1. 29base_transformersEducational Implementation · Python63.6/100AdvancedPranav
  2. 30EuchreGameDataset / Data Pipeline · Python63.4/100AdvancedJarad Peckenpaugh
  3. 31kvidcacheTraining Experiment · Python62.7/100Advancedkarims
  4. 31, shared rankmurphysigBenchmarking Project · Python62.7/100AdvancedRound Tower
  5. 33proofmarkAI Developer Tool · Python62.2/100Advancedkarims

More from Round Tower