Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scalable Qa aggregation #268

Merged
merged 6 commits into from
Feb 28, 2020
Merged

Scalable Qa aggregation #268

merged 6 commits into from
Feb 28, 2020

Conversation

Timoeller
Copy link
Contributor

  • greatly reduces GPU memory consumption during QA Inference
  • utilizes more GPU computations during training + inference
  • manually tested inference, pytests pass, tested on subset of squad dataset for training and eval, tested for BERT and RoBERTa

@Timoeller Timoeller self-assigned this Feb 28, 2020
@Timoeller Timoeller merged commit 15bde11 into master Feb 28, 2020
@Timoeller Timoeller deleted the qa_aggregation_scalable branch February 28, 2020 16:27
@Timoeller Timoeller mentioned this pull request Feb 28, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tholor tholor tholor approved these changes

Assignees

@Timoeller Timoeller

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@Timoeller @tholor