-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multi datasets #123
Merged
Merged
Multi datasets #123
Changes from 1 commit
Commits
Show all changes
46 commits
Select commit
Hold shift + click to select a range
681698d
add multiple datasets support
Benw8888 ac1b9f1
Merge branch 'main' of github.com:EleutherAI/elk into multi-datasets
Benw8888 b864c77
train_reporter works on a list of layers now
Benw8888 7d7d97c
changing printed layer names
Benw8888 4fe61e9
fixed concatenation bug
Benw8888 fe61d67
minor edits
Benw8888 74da878
fixed pyright issues
Benw8888 569ef05
Merge branch 'main' of github.com:EleutherAI/elk into multi-datasets
Benw8888 b62b679
Merge branch 'main' into multi-datasets
norabelrose fe94c22
Fix tests
norabelrose bba24d8
Now working sorta
norabelrose 03ba6e0
Skip slow BalancedBatchSampler test
norabelrose 15ab351
Slightly relax test_output_is_roughly_balanced
norabelrose a80369e
Make BalancedSampler deterministic
norabelrose d304ab3
InitVar
norabelrose 761c82d
Support multi class again
norabelrose f29743b
Fix naming issue
norabelrose b7b7e23
Support few shot prompts
norabelrose 1afb563
Merge branch 'main' into multi-datasets
norabelrose 225d4c7
fix multiclass labels
AlexTMallen 9368dc8
Merge branch 'multi-datasets' of github.com:EleutherAI/elk into multi…
AlexTMallen a858b65
Merge branch 'main' into multi-datasets
norabelrose 5dc2ec6
Merge branch 'multi-datasets' of github.com:EleutherAI/elk into multi…
norabelrose b1b95e5
Fix dumb part of test failures
norabelrose ee3911e
Fix assert_allclose warning
norabelrose a55b3de
Switch to torch.testing.assert_close in EigenReporter test
norabelrose 44dc25c
Shuffle load_prompts output by default
norabelrose 93d8d87
Fix smoke test failure
norabelrose fad4d74
Remove debug prints
AlexTMallen 0a054f4
Remove more debug print statements
AlexTMallen 177eec2
make min_memory usable; broadcast mmax_examples in __post_init__
AlexTMallen 3a762b0
prompt loading refactor to enable better streaming
AlexTMallen f66c054
remove shuffle arg
AlexTMallen d3d87fc
remove unused @dataclass
lauritowal 3d08147
merge
lauritowal c9a43e1
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 94290aa
add concatenated_layer_offset to eval
lauritowal f9298e4
Merge branch 'multi-datasets' of https://github.com/EleutherAI/elk in…
lauritowal 3765c4f
add self.
lauritowal 2b05193
replace target with data
lauritowal 83731bb
add self.
lauritowal 764fda9
remove second arg
lauritowal d2c66b0
fix passing the wrong params for world size / rank
thejaminator 9186326
Update prompt_loading.py
lauritowal 3f99a4d
fix pre-commit errors
lauritowal 148130d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the function signature is
so we were passing world_size to rank and vice versa