Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarify GPT-4 model #4

Closed
rodion-m opened this issue Jun 13, 2024 · 1 comment
Closed

Clarify GPT-4 model #4

rodion-m opened this issue Jun 13, 2024 · 1 comment

Comments

@rodion-m
Copy link

Please clarify what GPT-4 models us used in the benchmark (4o or Turbo) and also, please add them both into the benchmark.

@booydar
Copy link
Owner

booydar commented Jun 15, 2024

Thanks for pointing out this lack of clarity, I'll update the readme and paper text. For main experiments we used the gpt-4-0125-preview, and for retrieval-augmented generation we employed the GPT-4-turbo version. Evaluation results for each model can be found in the predictions_06_2024 branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants