Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
1,865 workflow runs
1,865 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

refactor: adding api_key param to litellm (#1114) Quality #3710: Commit 36b3e6c pushed by NathanHB
2m 59s main
main
2m 59s
refactor: adding api_key param to litellm Quality #3709: Pull request #1114 opened by pjavanrood
2m 38s pjavanrood:pjavan-litellm-apikey-fix
pjavanrood:pjavan-litellm-apikey-fix
2m 38s
[EVAL] SciCode Quality #3708: Pull request #1086 synchronize by akshathmangudi
2m 49s akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
2m 49s
feat: add MathVista benchmark Quality #3707: Pull request #1081 synchronize by NathanHB
Action required omkar-334:vista
omkar-334:vista
Action required
Wrap vllm inputs to compatible with VLLM>=0.10.2 Quality #3706: Pull request #1003 synchronize by NathanHB
Action required JIElite:upgrade-vllm-to-0.10.2
JIElite:upgrade-vllm-to-0.10.2
Action required
Enable loading data sets from files for custom tasks (#1083) Quality #3705: Commit 03d8c4e pushed by NathanHB
6m 15s main
main
6m 15s
Fix typo in few_shots_select option error message ("fbalanced" → "balanced") Quality #3704: Pull request #1111 opened by jayminban
2m 55s jayminban:fix-fbalanced-typo
jayminban:fix-fbalanced-typo
2m 55s
fix(tasks): print also tasks not prefixed by the suite name Quality #3703: Pull request #1087 synchronize by NathanHB
2m 58s bram-pramono:main
bram-pramono:main
2m 58s
Add support to vllm==0.11.0 Quality #3702: Pull request #1027 synchronize by anmarques
2m 43s neuralmagic:vllm0.11
neuralmagic:vllm0.11
2m 43s
Enable loading data sets from files for custom tasks Quality #3701: Pull request #1083 synchronize by davebiagioni
2m 43s davebiagioni:enable-data-files
davebiagioni:enable-data-files
2m 43s
fix(tasks): print also tasks not prefixed by the suite name Quality #3699: Pull request #1087 synchronize by bram-pramono
2m 40s bram-pramono:main
bram-pramono:main
2m 40s
Refactor PR Style Bot workflow with new inputs (#1105) Quality #3698: Commit 6496d62 pushed by NathanHB
3m 27s main
main
3m 27s
Update comment bot secrets in workflow (#1107) Quality #3697: Commit 7fba130 pushed by paulinebm
2m 43s main
main
2m 43s
Update comment bot secrets in workflow Quality #3696: Pull request #1107 opened by paulinebm
2m 43s paulinebm-patch-2
paulinebm-patch-2
2m 43s
[EVAL] SciCode Quality #3695: Pull request #1086 synchronize by akshathmangudi
Action required akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
Action required
[EVAL] SciCode Quality #3694: Pull request #1086 synchronize by akshathmangudi
Action required akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
Action required
[EVAL] SciCode Quality #3693: Pull request #1086 synchronize by akshathmangudi
Action required akshathmangudi:akshath/issue-740
akshathmangudi:akshath/issue-740
Action required
[EVAL] MultiChallenge Quality #3692: Pull request #1075 synchronize by akshathmangudi
Action required akshathmangudi:akshath/issue-1019-v2
akshathmangudi:akshath/issue-1019-v2
Action required
[EVAL] Long Horizon Execution Quality #3691: Pull request #1074 synchronize by akshathmangudi
Action required akshathmangudi:akshath/issue-1056-v2
akshathmangudi:akshath/issue-1056-v2
Action required
[EVAL] Long Horizon Execution Quality #3690: Pull request #1074 synchronize by akshathmangudi
Action required akshathmangudi:akshath/issue-1056-v2
akshathmangudi:akshath/issue-1056-v2
Action required
Refactor PR Style Bot workflow with new inputs Quality #3688: Pull request #1105 synchronize by NathanHB
2m 53s NathanHB-patch-5
NathanHB-patch-5
2m 53s
Refactor PR Style Bot workflow with new inputs Quality #3687: Pull request #1105 synchronize by NathanHB
2m 37s NathanHB-patch-5
NathanHB-patch-5
2m 37s
Refactor PR Style Bot workflow with new inputs Quality #3686: Pull request #1105 opened by NathanHB
3m 16s NathanHB-patch-5
NathanHB-patch-5
3m 16s
Comment out PR Style Bot workflow configuration Quality #3685: Commit f48af0b pushed by paulinebm
3m 4s main
main
3m 4s
test Quality #3684: Pull request #1104 synchronize by paulinebm
16s paulinebm:main
paulinebm:main
16s