-
Notifications
You must be signed in to change notification settings - Fork 24.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Synthetic source should load fields sequentially #94003
Comments
Pinging @elastic/es-analytics-geo (Team:Analytics) |
1 similar comment
Pinging @elastic/es-analytics-geo (Team:Analytics) |
Pinging @elastic/es-storage-engine (Team:StorageEngine) |
Synthetic source has some ability to do that. The interface is:
Some of the doc values implementations read the values out of doc values into an array up front and then replay them when they are building doc values. IIRC single valued numbers work that way but multivalued ones don't. |
Synthetic source generally reads the values of a document from doc values. It does synthesise documents one by one by reading one doc value for each field at a time.
On the other hand doc values are optimised to read values sequentially so the access pattern of synthetic source is problematic as it will pollute the local cache and it can cause slow reads.
We should investigate the possibility of reading synthetic source fields sequentially to avoid cache issues.
The text was updated successfully, but these errors were encountered: