Skip to content

Commit

Permalink
Fixing typo
Browse files Browse the repository at this point in the history
  • Loading branch information
mmazeika committed Feb 14, 2024
1 parent 1ba6087 commit 25b0eee
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/codebase_structure.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ results/GCG/baichuan2_7b_1000steps/test_cases/test_cases.json
```
The experiment names (llama2_7b, baichuan2_7b, and baichuan2_7b_1000steps) are specified in each method's config file (described below).

After we have a `test_cases.json` file for a specific experiment, we can generate and evaluate compopletions with the second half of the evaluation pipeline. The models config file (described below) defines a list of **target models**. The target model names determine where completions and results are saved. By convention we save completions in `{top_level_results_dir}/{method_name}/{experiment_name}/completions/{model_name}.json` and classification results in `{top_level_results_dir}/{method_name}/{experiment_name}/results/{model_name}.json`. For example, the results of the baichuan2_7b_1000steps experiment from above might be saved in
After we have a `test_cases.json` file for a specific experiment, we can generate and evaluate completions with the second half of the evaluation pipeline. The models config file (described below) defines a list of **target models**. The target model names determine where completions and results are saved. By convention we save completions in `{top_level_results_dir}/{method_name}/{experiment_name}/completions/{model_name}.json` and classification results in `{top_level_results_dir}/{method_name}/{experiment_name}/results/{model_name}.json`. For example, the results of the baichuan2_7b_1000steps experiment from above might be saved in
```
results/GCG/baichuan2_7b_1000steps/completions/baichuan2_7b.json
results/GCG/baichuan2_7b_1000steps/results/baichuan2_7b.json
Expand Down

0 comments on commit 25b0eee

Please sign in to comment.