2 Releases published by 1 person

• v0.4.18 0.4.18

  published Jun 28, 2024

• v0.4.19 0.4.19

  published Jul 1, 2024

24 Pull requests merged by 6 people

• Remove the brew installer

  #817 merged Jul 3, 2024

• chore: error output logs for cortex run

  #818 merged Jul 3, 2024

• feat: cpuinfo as node module - new build scripts

  #813 merged Jul 3, 2024

• fix: model id parsing breaks model pull

  #816 merged Jul 3, 2024

• feat: support cortex engines init command

  #815 merged Jul 2, 2024

• fix: revert wrong change, change telemetry server url

  #812 merged Jul 2, 2024

• feat: add analytic metric, send benchmark to server

  #784 merged Jul 2, 2024

• chore: quick update model repo to cortexso

  #810 merged Jul 1, 2024

• fix: model not found

  #808 merged Jul 1, 2024

• fix: download success event

  #807 merged Jul 1, 2024

• Create LICENSE

  #806 merged Jul 1, 2024

• refactor: model pull api and post processing

  #794 merged Jul 1, 2024

• fix: return immediately when invoke download model api

  #804 merged Jul 1, 2024

• chore: cortex.llamacpp to nightly version 0.1.20-30.06.24

  #802 merged Jul 1, 2024

• chore: correct engine reload on config save

  #797 merged Jun 28, 2024

• fix: reload engine configurations on configs update

  #796 merged Jun 28, 2024

• fix: api path - add v1 component

  #795 merged Jun 28, 2024

• chore: error handling for chat/completions endpoint

  #793 merged Jun 28, 2024

• fix: correct cortexso-node dependency installation

  #792 merged Jun 28, 2024

• chore: cortex.llamacpp to v0.1.20

  #791 merged Jun 28, 2024

• Update the URL and API desc

  #785 merged Jun 28, 2024

• chore: error handling

  #788 merged Jun 27, 2024

• chore: update benchmark using cortex client (cortex-node)

  #787 merged Jun 27, 2024

• feat: cortex supports remote engines

  #786 merged Jun 27, 2024

2 Pull requests opened by 2 people

• chore: remove cortex.llamacpp out of cortex-cpp release

  #790 opened Jun 28, 2024

• Fix error bin file macos

  #819 opened Jul 3, 2024

26 Issues closed by 5 people

• feat: Better stdout when pulling models

  #776 closed Jul 3, 2024

• feat: stdout "loading model..." during `run` and `start`

  #801 closed Jul 3, 2024

• bug: CPU Info not found

  #814 closed Jul 3, 2024

• feat: cortex should support `engines init` to reinit engines manually

  #809 closed Jul 2, 2024

• epic: RAG?

  #680 closed Jul 1, 2024

• epic: Cortex supports File Search via RAG

  #738 closed Jul 1, 2024

• feat: Cortex has nightly builds?

  #646 closed Jul 1, 2024

• feat: cortex supports onnx engine

  #623 closed Jul 1, 2024

• Quickstart setup step 4 (not working)

  #595 closed Jul 1, 2024

• feat: `cortex config`

  #674 closed Jul 1, 2024

• bug: 400ms+ lag for cortex CLI response

  #675 closed Jul 1, 2024

• feat: Add Intel integrated GPU and discrete GPU support

  #470 closed Jul 1, 2024

• bug: weird responses from nitro when cache enabled

  #526 closed Jul 1, 2024

• feat: add e2e testing for embedding endpoint

  #501 closed Jul 1, 2024

• feat: Support for Nitro with llama.cpp vulkan backend on Mac

  #476 closed Jul 1, 2024

• bug: nitro attempts to load nonexistent "ggml-model-f16.gguf" model

  #472 closed Jul 1, 2024

• Error Handling and Error Messages

  #517 closed Jul 1, 2024

• epic: Queue

  #523 closed Jul 1, 2024

• bug: Windows Firewall asks to connect to Nitro.exe

  #627 closed Jul 1, 2024

• I still got 'Illegal instruction' bug under cuda with ubuntu 22.04.

  #317 closed Jul 1, 2024

• feat: Asia model hub mirror

  #679 closed Jul 1, 2024

• Discussion: cortex benchmark cli

  #610 closed Jul 1, 2024

• bug: nitro cuda windows low performance on machine has multiple GPUs - tested using Jan App

  #269 closed Jul 1, 2024

• feat: Cortex CLI

  #548 closed Jul 1, 2024

• epic: Smart model routing / loading

  #204 closed Jul 1, 2024

• Cortex should be able to start llama3 after confirming it was downloaded correctly

  #696 closed Jun 27, 2024

7 Issues opened by 4 people

• Cortex Website: Some small nits

  #820 opened Jul 3, 2024

• feat: Cortex supports Vulkan - ROCm?

  #811 opened Jul 2, 2024

• epic: router between on-device vs cloud models

  #803 opened Jul 1, 2024

• question: why `cortex ps` slow on windows

  #800 opened Jul 1, 2024

• bug: Resolve "Windows Firewall has blocked cortex.cpp"

  #799 opened Jul 1, 2024

• Cortex Benchmark

  #798 opened Jun 29, 2024

• epic: remove cortex.llamacpp out of cortex-cpp release

  #789 opened Jun 28, 2024

21 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• feat: Cortex multiple engines onboarding

  #704 commented on Jul 3, 2024 • 1 new comment

• feat: better `cortex serve` CLI experience

  #755 commented on Jul 3, 2024 • 1 new comment

• bug: Check for install requirements before downloading models

  #778 commented on Jun 28, 2024 • 1 new comment

• feat: New cortex github banner image

  #766 commented on Jul 2, 2024 • 0 new comments

• feat: Automatic fallback to CPU in case of GPU loading failure

  #805 commented on Jul 1, 2024 • 0 new comments

• Cortex Website

  #737 commented on Jul 1, 2024 • 0 new comments

• feat: npm/brew uninstall should remove ~/cortex

  #775 commented on Jul 1, 2024 • 0 new comments

• bug: `cortex models` should == `cortex models -h`

  #754 commented on Jul 1, 2024 • 0 new comments

• bug: I'm trying to get JAN on avx with ERROR AVX2.

  #552 commented on Jul 1, 2024 • 0 new comments

• feat: Migration from coupled server to engine - trt-llm

  #536 commented on Jul 1, 2024 • 0 new comments

• epic: Better Cortex Error Handling and Hardware Compatibility Checks

  #369 commented on Jul 1, 2024 • 0 new comments

• feat: Support MacOS with AVX on Intel processor

  #500 commented on Jul 1, 2024 • 0 new comments

• feat: ARM support on Linux

  #527 commented on Jul 1, 2024 • 0 new comments

• feat: Migration from coupled server to engine - Python Sub System

  #534 commented on Jul 1, 2024 • 0 new comments

• feat: Cortex has structured logging

  #378 commented on Jul 1, 2024 • 0 new comments

• chore: refactor and remove redundant manual build flags and move into main nitro CMakeLists

  #482 commented on Jul 1, 2024 • 0 new comments

• epic: support ROCm

  #323 commented on Jul 1, 2024 • 0 new comments

• feat: support alpine image

  #365 commented on Jul 1, 2024 • 0 new comments

• feat: [Add Response Code to Nitro REST API for Localization Support]

  #130 commented on Jul 1, 2024 • 0 new comments

• feat: Model download caches would be nice (onnx/trt downloads are slow and often fail)

  #777 commented on Jun 28, 2024 • 0 new comments

• feat: SHA/SIG files to validate the integrity of downloaded models

  #783 commented on Jun 27, 2024 • 0 new comments