Skip to content

Commit

Permalink
Update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
Kyle1668 committed Feb 4, 2023
1 parent f3d966d commit 79be103
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ Furthermore:
1. To generate the hidden states for one model `mdl` and all datasets, `cd elk` and then run

```bash
python generation_main.py --model deberta-v2-xxlarge-mnli --datasets imdb --prefix normal --device cuda --num_data 1000
python generation_main.py --model deberta-v2-xxlarge-mnli --datasets imdb --prefix normal --device cuda --num-data 1000
```

To test `deberta-v2-xxlarge-mnli` with the misleading prefix, and only the `imdb` and `amazon-polarity` datasets, while printing extra information, run:
Expand All @@ -37,12 +37,12 @@ The name of prefix can be found in `./utils_generation/construct_prompts.py`. Th
1. To train a ccs model and a logistic regression model

```bash
python train.py --model deberta-v2-xxlarge-mnli --prefix normal --dataset imdb --num_data 1000
python train.py --model deberta-v2-xxlarge-mnli --prefix normal --dataset imdb --num-data 1000
```

and evaluate:
```bash
python evaluate.py --model deberta-v2-xxlarge-mnli --dataset imdb --num_data 1000
python evaluate.py --model deberta-v2-xxlarge-mnli --dataset imdb --num-data 1000
```

Once finished, results will be saved in `evaluation_results/{model}_{prefix}_{seed}.csv`
Expand Down

0 comments on commit 79be103

Please sign in to comment.