build commit_id=b281b09, I cannot find lm-eval command.

[jieheroli]

according to the open llm leaderboard's ABOUT tag。
now the data in the board come from llm-evaluation-harness commit_id=b281b09。
but when i download the project, execute the command: “pip istall -e .”
i cannot find lm-eval command.but when i build the master branch, everything is ok.
why?

[LSinev]

b281b09 is rather old branch (seems like 0.3.0 with some patches), check documentation of that state to find out the ways to run it.
This is an example from that branch and commit, no lm-eval available (many new api and models are not available too)

python main.py \
    --model hf-causal \
    --model_args pretrained=EleutherAI/pythia-160m,revision=step100000,dtype="float" \
    --tasks lambada_openai,hellaswag \
    --device cuda:0