Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Fix max_tokens sent as a list by the litellm judge backend .github/workflows/pr_style_bot.yaml #281: Issue comment #1297 (comment) by AbhilakshSinghReen
Failure
Failure
Fix balanced few-shot sampling: falsy label truncation and global RNG use Build PR Documentation #2058: Pull request #1310 opened by ErenAta16
Action required ErenAta16:fix/balanced-fewshot-falsy-label
ErenAta16:fix/balanced-fewshot-falsy-label
Action required
Fix balanced few-shot sampling: falsy label truncation and global RNG use Tests #3955: Pull request #1310 opened by ErenAta16
Action required ErenAta16:fix/balanced-fewshot-falsy-label
ErenAta16:fix/balanced-fewshot-falsy-label
Action required
Fix balanced few-shot sampling: falsy label truncation and global RNG use Slow end to end tests #1555: Pull request #1310 opened by ErenAta16
Action required ErenAta16:fix/balanced-fewshot-falsy-label
ErenAta16:fix/balanced-fewshot-falsy-label
Action required
Fix balanced few-shot sampling: falsy label truncation and global RNG use Quality #3956: Pull request #1310 opened by ErenAta16
Action required ErenAta16:fix/balanced-fewshot-falsy-label
ErenAta16:fix/balanced-fewshot-falsy-label
Action required
Fix sequential few-shot sampling mutating the shared few-shot pool Tests #3954: Pull request #1308 opened by ErenAta16
Action required ErenAta16:fix/sequential-fewshot-shared-pool-mutation
ErenAta16:fix/sequential-fewshot-shared-pool-mutation
Action required
Fix sequential few-shot sampling mutating the shared few-shot pool Build PR Documentation #2057: Pull request #1308 opened by ErenAta16
Action required ErenAta16:fix/sequential-fewshot-shared-pool-mutation
ErenAta16:fix/sequential-fewshot-shared-pool-mutation
Action required
Fix sequential few-shot sampling mutating the shared few-shot pool Quality #3955: Pull request #1308 opened by ErenAta16
Action required ErenAta16:fix/sequential-fewshot-shared-pool-mutation
ErenAta16:fix/sequential-fewshot-shared-pool-mutation
Action required
Fix sequential few-shot sampling mutating the shared few-shot pool Slow end to end tests #1554: Pull request #1308 opened by ErenAta16
Action required ErenAta16:fix/sequential-fewshot-shared-pool-mutation
ErenAta16:fix/sequential-fewshot-shared-pool-mutation
Action required
vLLM Main Branch Tests vLLM Main Branch Tests #21: Scheduled
30s main
main
30s
fix metric_class names in avg_at_n / avg_at_n_math / maj_at_n test cases Build PR Documentation #2056: Pull request #1305 opened by jayzuccarelli
Action required jayzuccarelli:fix-avg-maj-at-n-test-case-names
jayzuccarelli:fix-avg-maj-at-n-test-case-names
Action required
fix metric_class names in avg_at_n / avg_at_n_math / maj_at_n test cases Tests #3953: Pull request #1305 opened by jayzuccarelli
Action required jayzuccarelli:fix-avg-maj-at-n-test-case-names
jayzuccarelli:fix-avg-maj-at-n-test-case-names
Action required
fix metric_class names in avg_at_n / avg_at_n_math / maj_at_n test cases Quality #3954: Pull request #1305 opened by jayzuccarelli
Action required jayzuccarelli:fix-avg-maj-at-n-test-case-names
jayzuccarelli:fix-avg-maj-at-n-test-case-names
Action required
fix metric_class names in avg_at_n / avg_at_n_math / maj_at_n test cases Slow end to end tests #1553: Pull request #1305 opened by jayzuccarelli
Action required jayzuccarelli:fix-avg-maj-at-n-test-case-names
jayzuccarelli:fix-avg-maj-at-n-test-case-names
Action required
Fix max_tokens sent as a list by the litellm judge backend Build PR Documentation #2055: Pull request #1297 synchronize by AbhilakshSinghReen
Action required AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
Action required
Fix max_tokens sent as a list by the litellm judge backend Quality #3953: Pull request #1297 synchronize by AbhilakshSinghReen
Action required AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
Action required
Fix max_tokens sent as a list by the litellm judge backend Slow end to end tests #1552: Pull request #1297 synchronize by AbhilakshSinghReen
Action required AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
Action required
Fix max_tokens sent as a list by the litellm judge backend Tests #3952: Pull request #1297 synchronize by AbhilakshSinghReen
Action required AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
AbhilakshSinghReen:fix/litellm-judge-max-tokens-tuple
Action required
Fix litellm judge backend: send max_tokens as an int, not a 1-tuple .github/workflows/pr_style_bot.yaml #280: Issue comment #1302 (comment) by AbhilakshSinghReen
Failure
Failure
[BUG] Task : wikitext:103:document_level does not work .github/workflows/pr_style_bot.yaml #279: Issue comment #1299 (comment) by hogeheer499-commits
Failure
Failure
Use ast.literal_eval instead of eval in hellaswag_arabic_pfn .github/workflows/pr_style_bot.yaml #278: Issue comment #1294 (comment) by jayzuccarelli
Failure
Failure
Fix unreachable response_format default in JudgeLM Build PR Documentation #2054: Pull request #1303 opened by oraziooztas
Action required oraziooztas:fix/judge-response-format-default
oraziooztas:fix/judge-response-format-default
Action required
Fix unreachable response_format default in JudgeLM Quality #3952: Pull request #1303 opened by oraziooztas
-1s oraziooztas:fix/judge-response-format-default
oraziooztas:fix/judge-response-format-default
-1s
Fix unreachable response_format default in JudgeLM Slow end to end tests #1551: Pull request #1303 opened by oraziooztas
-1s oraziooztas:fix/judge-response-format-default
oraziooztas:fix/judge-response-format-default
-1s
Fix unreachable response_format default in JudgeLM Tests #3951: Pull request #1303 opened by oraziooztas
Action required oraziooztas:fix/judge-response-format-default
oraziooztas:fix/judge-response-format-default
Action required