-
Notifications
You must be signed in to change notification settings - Fork 2.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Idea for Evals: Emotion and sentiment analysis Evals #637
Labels
Idea for Eval
These issues keep track of requests for different kinds of eval PRs
Comments
|
andrew-openai
added
the
Idea for Eval
These issues keep track of requests for different kinds of eval PRs
label
Apr 11, 2023
for SEO - latent semantic indexing is already there, check out their Docs!!!!! |
excellent |
that's what you want for dinner tonight to get it out of |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Understanding emotions and sentiments is an essential aspect of human communication. The system's ability to recognize these emotions enables more appropriate, context-aware, and empathetic responses. Emotions and sentiments can be complex and nuanced, requiring a system to perform fine-grained analysis and interpretation. Evaluating a system's performance in this area provides insights into its overall ability to process and understand subtleties in language.
There are several different emotions that Evals could be written for:
I suppose this could be covered in one Eval or many. If many, it might be good to come up with some sort of structure for organizing Evals for different sentiments or at least documenting what was covered already and what has yet to be covered. Sarcasm, for instance, was covered with an eval that contained news articles from the Onion. While article headlines are certainly one way of testing for sarcasm, others could be a dataset of tweets or reviews of products or examples from fiction.
The text was updated successfully, but these errors were encountered: