Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Python 3.11 to CI tests #91

Merged
merged 18 commits into from
Feb 19, 2023
Merged

Add Python 3.11 to CI tests #91

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
608bbc7
load dset
AlexWan0 Feb 16, 2023
0464c22
use Datasets.from_generator for multiprocessing
AlexWan0 Feb 18, 2023
f66ef4c
revert some debugging stuff
AlexWan0 Feb 18, 2023
f2b7abf
remove accidentally included files
AlexWan0 Feb 18, 2023
5717d19
switch to correct multiprocessing lib + switch to spawn
AlexWan0 Feb 18, 2023
189bb30
split dataset before multiprocessing
AlexWan0 Feb 18, 2023
5af52d7
nicer prints
AlexWan0 Feb 18, 2023
3862e92
Replace custom method with np.array_split
norabelrose Feb 18, 2023
03b782d
Merge branch 'main' into multiprocessing
norabelrose Feb 19, 2023
9b3bbe3
Move multiprocessing inside generator
norabelrose Feb 19, 2023
f5b8a4a
change yield to put
AlexWan0 Feb 19, 2023
54f7f9a
change to use model_str
AlexWan0 Feb 19, 2023
bfb7955
fix connectionreseterror
AlexWan0 Feb 19, 2023
c6e6dd1
switch extract to return dataset instead of saving to disk
AlexWan0 Feb 19, 2023
5e9662e
Switch to torch.multiprocessing.spawn
norabelrose Feb 19, 2023
a0a7c81
Merge branch 'main' into multiprocessing
norabelrose Feb 19, 2023
5a950a1
Merge remote-tracking branch 'origin/main' into multiprocessing
norabelrose Feb 19, 2023
27e3759
Start testing on Python 3.11
norabelrose Feb 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove accidentally included files
  • Loading branch information
@AlexWan0
AlexWan0 committed Feb 18, 2023
commit f2b7abfe09eaba6d3fcfb17822e715a82bde5f24
Loading