Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update doc and adapt to latest lm-evalution-harness for JA tasks #6

Merged
merged 6 commits into from
May 22, 2023

Conversation

leemengtw
Copy link
Collaborator

@leemengtw leemengtw commented May 20, 2023

As title, this PR include some small changes to allow us to specify

  • num few shots
  • prompt version

For each Japanese specific evaluation task in GPT-NeoX using the jp-stable branch of Stability-AI/lm-evaluation-harness.

@leemengtw leemengtw self-assigned this May 20, 2023
@leemengtw
Copy link
Collaborator Author

These changes are simple so I'll just go ahead to merge it.

@leemengtw leemengtw merged commit 3064ca1 into jp-stable May 22, 2023
leemengtw pushed a commit that referenced this pull request Jun 7, 2023
Adding launch_command, working_dir and config_path to wandb
leemengtw added a commit that referenced this pull request Jun 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant