Showing 1-6 of 6
Set up Agon to run multiple AI code models in isolated git worktrees, validate candidate fixes, auto-apply winners, and track model skill with Glicko-2 to route future work.
CoinSignal's public leaderboard compares 13 crypto prediction models with verified samples, accuracy, hit rate and calibration—see which meet practical thresholds for pilots.
Nanonets' IDP Leaderboard tests 16 models on 9,000+ real documents across three benchmarks (messy OCR, layout, business extraction), revealing task-dependent rankings and cost trade-offs.
Practical walkthrough to clone and run AIBuildAI (ranked #1 on OpenAI MLE‑Bench). In 20–120 minutes run a demo build, generate an evaluation report, and reproduce the result.
Anthropic analyzed 1.5M Claude conversations and defines three disempowerment patterns—reality, belief, action. Rare by percent but meaningful at scale; includes monitoring guidance.
DeepMind's FACTS Benchmark Suite evaluates LLM factuality with claim-level tests, error taxonomies and provenance checks. Includes a 5-item quick-start checklist and decision framework.