Support vector ANN search benchmarking #3094
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
|
Test resultsExample for a local run with
|
HugoWenTD
force-pushed
the
bb-11.4-vec-ann-benchmark
branch
2 times, most recently
from
ac8d6d9
to
7a3507a
Compare
HugoWenTD
force-pushed
the
bb-11.4-vec-ann-benchmark
branch
2 times, most recently
from
38fba8a
to
663c971
Compare
HugoWenTD
force-pushed
the
bb-11.4-vec-ann-benchmark
branch
from
663c971
to
ae69733
Compare
cvicentiu
force-pushed
the
bb-11.4-vec-vicentiu
branch
from
2f6b2b3
to
3d0e4ea
Compare
HugoWenTD
force-pushed
the
bb-11.4-vec-ann-benchmark
branch
2 times, most recently
from
746db91
to
205a394
Compare
Introduce scripts and Dockerfile for executing the `ann-benchmarks` tool, aimed at vector search performance testing. Support running the ANN benchmarking both in GitLab CI and manually. Developer Interface: Both of the scripts provide flexibility for altering default behavior via environment variables. Refer to the detailed description in the scripts' documentation section. - `run-local.sh`: This script facilitates the execution of the ANN (Approximate Nearest Neighbors) benchmarking test either against local builds or a specified folder where the MariaDB server is installed. - `run-docker.sh`: This script automates the execution of the ANN benchmarking test within a Docker container. It builds the required Docker image if it doesn't exist or if forced, then build the source code and runs the benchmark in the specified workspace. GitLab CI Build: - A new job `ann-benchmark` is included in the test stage. This job runs ann-benchmark against the MariaDB server built in Ubuntu 22.04. Initially, we are using the `random-xs-20-euclidean` dataset with 20 dimensions and 10000 records.
HugoWenTD
force-pushed
the
bb-11.4-vec-ann-benchmark
branch
from
205a394
to
500403f
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Introduce scripts and Docker file for running the
ann-benchmarkstool, dedicated to vector search performance testing.Offer developers support to run the benchmark in their development environment via existing MariaDB builds or by deploying the source code and executing the benchmark within Docker.
Also, integrate these builds into GitLab CI for Ubuntu 22.04 and include ANN benchmarking tests.
For detailed usage instructions, refer to the commit message and script help command.
How can this PR be tested?
Manual test was done for the scripts. The script is also integrated in Git-Lab CI pipeline.
Basing the PR against the correct MariaDB version
Backward compatibility
The changes fully backward compatible.
Copyright
All new code of the whole pull request, including one or several files that are either new files or modified ones, are contributed under the BSD-new license. I am contributing on behalf of my employer Amazon Web Services, Inc.