Skip to content

Commit

Permalink
add harness submodule
Browse files Browse the repository at this point in the history
  • Loading branch information
zhangir-azerbayev committed Oct 16, 2023
1 parent 0222c58 commit 927fd22
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 1 deletion.
3 changes: 3 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,6 @@
[submodule "overlap"]
path = overlap
url = [email protected]:wellecks/overlap.git
[submodule "lm-evaluation-harness"]
path = lm-evaluation-harness
url = https://github.com/wellecks/lm-evaluation-harness
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,10 @@ Additional evaluation code is in a [fork of the Eleuther LM Evaluation Harness](
This repository contains the following directories
- `proof_pile_2`: scripts for downloading and preprocessing data.
- `gpt-neox`: git submodule containing a modified branch of `EleutherAI/gpt-neox`
- `finetunes`: git submodule containing scripts for the fine-tuning experiments
- `lm-evaluation-harness`: code for all evaluations, except formal2formal theorem proving.
- `llemma_formal2formal`: git submodule containing scripts for the formal2formal experiments
- `overlap`: git submodule containing the overlap and memorization analysis
- `finetunes`: git submodule containing scripts for the fine-tuning experiments

Because this project contains submodules, you should clone this project with the `--recurse-submodules` flag or, alternatively, run `git submodule update --init --recursive` from within the project directory after cloning the project. After running `git pull`, you should also run `git submodule update`.

Expand Down
1 change: 1 addition & 0 deletions lm-evaluation-harness
Submodule lm-evaluation-harness added at 8ba804

0 comments on commit 927fd22

Please sign in to comment.