forked from mlfoundations/evalchemy
-
Notifications
You must be signed in to change notification settings - Fork 3
Pull requests: marin-community/evalchemy
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[evals] Add a self-contained HumanEval grader matching lm-eval-harness
#65
opened Aug 5, 2026 by
ayush1298
Loading…
Load full text-only OlympiadBench dataset
agent-generated
Automated failure tracking
#60
opened Aug 5, 2026 by
Helw150
Member
Loading…
fix: rewrite MRCR to use real openai/mrcr dataset
agent-generated
Automated failure tracking
#22
opened Jul 17, 2026 by
penfever
Collaborator
Loading…
[PROPOSAL] harbor-style retry + error classification for the API-eval path
#19
opened Jul 17, 2026 by
penfever
Collaborator
Loading…
Add deterministic RIMO-N, OlymMATH, and AMO-Bench parser evaluations
#12
opened Jul 11, 2026 by
taivu1998
Loading…
Add MathArena HMMT benchmark variants with shared adapter
#7
opened Jul 6, 2026 by
taivu1998
Loading…
[OlympiadBench] Add separate official English text-only task
#2
opened Jul 6, 2026 by
taivu1998
Loading…
ProTip!
no:milestone will show everything without a milestone.