Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to store row-level metadata #448

Merged

Conversation

domenicomanna
Copy link
Contributor

This metadata field allows non API parameters to be stored which could be useful for when the results need to be associated with an external source. For example, if the user has several rows of text data within a database, and they want to calculate embeddings for each row, they can now use the metadata field to save the row id so that when they parse the results back, they know which embedding corresponds to which database row.

This metadata field allows non API parameters to be stored which could
be useful for when the results need to be associated with an external
source. For example, if the user has several rows of text data within a
database, and they want to calculate embeddings for each row, they can
now use the metadata field to save the row id so that when they parse
the results back, they know which embedding corresponds to which
database row.
@ted-at-openai
Copy link
Collaborator

Good idea, thanks for the contribution. I considered something like this before, but omitted it since the input field itself is going to be the most reliable key. Still, I could see metadata helping if the metadata is more hashable or if there are duplicate inputs that you want to more easily match up.

@ted-at-openai ted-at-openai merged commit 806a01c into openai:main May 23, 2023
@domenicomanna domenicomanna deleted the parallel-processor-add-metadata branch May 24, 2023 17:07
katia-openai pushed a commit that referenced this pull request Feb 29, 2024
…adata

Add ability to store row-level metadata
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants