Skip to content

Leaderboard

Live rankings of compaction methods, segmented by benchmark version and target model. Submitted via PR; evaluated on GitHub Actions; ranked by elite_score. See methodology for how scores are computed.

How to get on the board

  1. Write a compactor subclassing compactbench.compactors.Compactor — see writing a compactor.
  2. Run it locally against the elite_practice suite until you're happy.
  3. Open a PR to submissions/ — full protocol in submitting.
  4. A maintainer applies the evaluate label after code review; GitHub Actions runs your method against the hidden ranked set and posts the score.
  5. If you qualify, your entry lands here on merge.

Tracking

  • Submission workflow + leaderboard site: #5
  • Launch Elite templates: #6
  • PyPI release + docs polish: #7