-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Input parameter meta
in FileTypeRouter
#6392
Labels
2.x
Related to Haystack v2.0
P2
Medium priority, add to the next sprint if no P1 available
type:feature
New feature or request
Comments
After a sync with @silvanocerza and @TuanaCelik we agreed to update the converters to accept a single metadata dictionary. In this way, users can use a Multiplexer to provide this dictionary directly to all converters, covering this usecase. I will also make an example script to explain the solution. TODO:
|
This was referenced Dec 20, 2023
This was referenced Jan 8, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
2.x
Related to Haystack v2.0
P2
Medium priority, add to the next sprint if no P1 available
type:feature
New feature or request
Is your feature request related to a problem? Please describe.
When a preprocessing pipeline starts with
FileTypeRouter
, which is usually the case when we use multiple converters, it's not possible to provide meta information for filesDescribe the solution you'd like
Extra
meta
input parameter that accepts dictionary to add this info to files.Probably FileTypeRouter will pass this info directly to converters as they route the files
Describe alternatives you've considered
Additional context
Something to think about: Why is the name of the input parameter is "sources" when the component name is FileTypeRouter? Does it make sense to change it to "files"?
The text was updated successfully, but these errors were encountered: