Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for or examples of Evals with image prompts? #50

Closed
kfarr opened this issue Mar 14, 2023 · 2 comments
Closed

Support for or examples of Evals with image prompts? #50

kfarr opened this issue Mar 14, 2023 · 2 comments

Comments

@kfarr
Copy link

kfarr commented Mar 14, 2023

Perhaps dumb question, feel free to close, but watching the GPT-4 livestream it seems that there is the ability to take an image prompt and do processing thereof which is our desired use case. Is there an analogous mechanism to create eval data sources with an image instead of text input?
@kfarr kfarr changed the title Eval with image prompts? Support for or examples of Evals with image prompts? Mar 14, 2023
@logankilpatrick
Copy link
Contributor

The current model available via our API and ChatGPT does not support image inputs. We will be adding that but there's no way to do evals for it right now.

@kfarr
Copy link
Author

kfarr commented Mar 14, 2023

@logankilpatrick ok cool thanks for the info

@kfarr kfarr closed this as completed Mar 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kfarr @logankilpatrick