Enterprise SDK for Nexa AI's model serving on edge devices.
We have released pre-built wheels for various Python versions, platforms, and backends for convenient installation on our index page.
pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/cpu --extra-index-url https://pypi.org/simple --no-cache-dirTo install with Vulkan support, make sure you have Vulkan SDK 1.3.261.1 or later installed.
For Windows PowerShell:
$env:CMAKE_ARGS="-DGGML_VULKAN=on"; pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/vulkan --extra-index-url https://pypi.org/simple --no-cache-dirFor Windows Command Prompt:
set CMAKE_ARGS="-DGGML_VULKAN=on" & pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/vulkan --extra-index-url https://pypi.org/simple --no-cache-dirFor Windows Git Bash:
CMAKE_ARGS="-DGGML_VULKAN=on" pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/vulkan --extra-index-url https://pypi.org/simple --no-cache-dirHow to clone this repo:
git clone --recursive https://github.com/NexaAI/nexa-sdk-enterpriseIf you forget to use --recursive, you can use below command to add submodule:
git submodule update --init --recursiveThen you can build and install the package:
pip install -e .python -m tests.test_text_generation
python -m tests.test_disk_kv_cache