-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Homogenize Generator meta output #7687
Labels
Contributions wanted!
Looking for external contributions
Comments
Taking into account tendency for other LLM providers/libraries to converge on OpenAI API - let's got with OpenAI naming scheme. |
Alright, I'll go for OpenAI's convention :) |
Been having a look at all generators and all the keywords seem to keep the OpenAI standard. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is your feature request related to a problem? Please describe.
The dictionaries returned by generators have matching keys to an extent, but some are using different notations for the same concept, mainly within the metadata / usage keys. For example:
Describe the solution you'd like
I would like generators to output the same scheme and keys to the extent that it is possible, i.e. for matching concepts. In particular, I would prefer to use input_tokens/output_tokens and stop_reason.
Describe alternatives you've considered
So far, in apps where we swap generators depending on the use case, the alternative is:
The text was updated successfully, but these errors were encountered: