Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minor changes #1125

Merged
merged 12 commits into from
Feb 23, 2024
Merged

Minor changes #1125

merged 12 commits into from
Feb 23, 2024

Conversation

segyges
Copy link
Contributor

@segyges segyges commented Jan 19, 2024

  • Changes default output for docker container
  • Renames docker pythia config to indicate it is docker pythia config
  • Fix unit test for evaluate function

tests/README.md Outdated

# run tests in tests/model, output coverage report of megatron module as html
pytest --forked --cov-report html --cov=megatron tests/model
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why the removal of --forked? These should be necessary for distributed pytests.

Copy link
Contributor Author

@segyges segyges Jan 19, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

--forked is causing this error, a lot:

RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

Removing it resolves most of those; it's possible it would be better to figure out why the runner fails in this way presently, though.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Quentin-Anthony I pulled the bit about --forked out, resolving whatever is going on with tests can be pushed to a different issue/PR.

@Quentin-Anthony Quentin-Anthony added the merge-queue This PR is next on the queue to merge label Feb 23, 2024
Copy link
Member

@Quentin-Anthony Quentin-Anthony left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for these!

@Quentin-Anthony Quentin-Anthony merged commit 72d1803 into EleutherAI:main Feb 23, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
merge-queue This PR is next on the queue to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants