Commits

Commits on May 3, 2024

remove context length parameter doc string
djstrong
committedMay 3, 2024
remove echo parameter in OpenAI completions API
djstrong
committedMay 3, 2024
eval tracker args fix (EleutherAI#1777 )
KonradSzafer
committedMay 3, 2024
evaluation tracker implementation (EleutherAI#1766 )
KonradSzafer
committedMay 3, 2024

Commits on May 2, 2024

Add option to set OpenVINO config (EleutherAI#1730 )
helena-intel
committedMay 2, 2024
vllm lora support (EleutherAI#1756 )
bcicc
committedMay 2, 2024

Commits on May 1, 2024

upload new tasks (EleutherAI#1728 )

simran-arora
and
haileyschoelkopf
committedMay 1, 2024
Fix m_arc choices (EleutherAI#1760 )

jordane95
and
haileyschoelkopf
committedMay 1, 2024
Pile 10k new task (EleutherAI#1758 )
mukobi
committedMay 1, 2024
remove duplicated num_fewshot: 0 (EleutherAI#1769 )
chujiezheng
committedMay 1, 2024

Commits on Apr 26, 2024

Add filter registry decorator (EleutherAI#1750 )
lozhn
committedApr 26, 2024
Support individual scrolls datasets (EleutherAI#1740 )
giorgossideris
committedApr 26, 2024

Commits on Apr 25, 2024

Fix Parameter Propagation for Tasks that have include (EleutherAI#1749 )
lintangsutawika
committedApr 25, 2024
Add XNLIeu: a dataset for cross-lingual NLI in Basque (EleutherAI#1694 )
juletx
committedApr 25, 2024
reference --tasks list in README (EleutherAI#1726 )
nairbv
committedApr 25, 2024

Commits on Apr 18, 2024

Adding retries and rate limit to toxicity tasks (EleutherAI#1620 )
sator-labs
committedApr 18, 2024
fix error when appending eot_token_id for generate_until tasks (EleutherAI#1699 )
sergiopperez
committedApr 18, 2024

Commits on Apr 16, 2024

Add neuralmagic models for sparseml and deepsparse (EleutherAI#1674 )

mgoin
and
haileyschoelkopf
committedApr 16, 2024
Add delta weights model loading (EleutherAI#1712 )
KonradSzafer
committedApr 16, 2024

Commits on Apr 8, 2024

Update README.md (EleutherAI#1680 )
haileyschoelkopf
committedApr 8, 2024

Commits on Apr 7, 2024

correction bug EleutherAI#1664 (EleutherAI#1670 )

nicho2
and
haileyschoelkopf
committedApr 7, 2024

Commits on Apr 5, 2024

Anthropic Chat API (EleutherAI#1594 )

tryumanshow
and
haileyschoelkopf
committedApr 5, 2024
TMMLU+ implementation (EleutherAI#1394 )

committedApr 5, 2024

Commits on Apr 4, 2024

Patch QQP prompt (EleutherAI#1661 )
haileyschoelkopf
committedApr 4, 2024

Commits on Apr 1, 2024

Fix CLI --batch_size arg for openai-completions/local-completions (EleutherAI#1656 )
mgoin
committedApr 1, 2024
Add Latxa paper evaluation tasks for Basque (EleutherAI#1654 )
juletx
committedApr 1, 2024

Commits on Mar 28, 2024

Fix SuperGlue's ReCoRD task following regression in v0.4 refactoring (EleutherAI#1647 )
orsharir
committedMar 28, 2024

Commits on Mar 27, 2024

Fix conditional import for Nemo LM class (EleutherAI#1641 )
haileyschoelkopf
committedMar 27, 2024

Commits on Mar 26, 2024

Integration of NeMo models into LM Evaluation Harness library (EleutherAI#1598 )
sergiopperez
committedMar 26, 2024

Commits on Mar 25, 2024

Seq2seq fix (EleutherAI#1604 )

lintangsutawika
and
artemorloff
committedMar 25, 2024
peft Version Assertion (EleutherAI#1635 )
LameloBally
committedMar 25, 2024
Add vLLM FAQs to README (EleutherAI#1625 ) (EleutherAI#1633 )
haileyschoelkopf
committedMar 25, 2024

Commits on Mar 22, 2024

add logging of model args (EleutherAI#1619 )
baberabb
committedMar 22, 2024

Commits on Mar 21, 2024

OpenAI Completions -- fix passing of unexpected 'until' arg (EleutherAI#1612 )
haileyschoelkopf
committedMar 21, 2024
Add ACLUE task (EleutherAI#1614 )
haonan-li
committedMar 21, 2024