You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
If we call run_batchOpenSearchDocumentStore makes use of msearch if it is a sparse query. That is, it executes the searches in parallel. For dense searches this is not the case, all searches are executed in sequence.
Describe the solution you'd like OpenSearch's msearch supports dense searches as well, so let's:
create a batch pendant of query_by_embedding like query_batch for DocumentStores
default impl would be to delegate to query_by_embedding
for OpenSearchDocumentStore and ElasticsearchDocumentStore implement it to use msearch
Describe alternatives you've considered
Additional context
Parallel searches using msearch substantially speed up batch queries: I measured ~50% latency drop.
The text was updated successfully, but these errors were encountered:
tstadel
changed the title
Execute dense searches in parallel in OpenSearchDocumentStore in batch mode
Execute dense searches in parallel in OpenSearchDocumentStore when in batch mode
Nov 30, 2022
Is your feature request related to a problem? Please describe.
If we call
run_batch
OpenSearchDocumentStore
makes use ofmsearch
if it is a sparse query. That is, it executes the searches in parallel. For dense searches this is not the case, all searches are executed in sequence.Describe the solution you'd like
OpenSearch
'smsearch
supports dense searches as well, so let's:query_by_embedding
likequery_batch
for DocumentStoresquery_by_embedding
OpenSearchDocumentStore
andElasticsearchDocumentStore
implement it to usemsearch
Describe alternatives you've considered
Additional context
Parallel searches using
msearch
substantially speed up batch queries: I measured ~50% latency drop.The text was updated successfully, but these errors were encountered: