-
Notifications
You must be signed in to change notification settings - Fork 129
Insights: predibase/lorax
Overview
-
- 5 Merged pull requests
- 2 Open pull requests
- 0 Closed issues
- 3 New issues
Loading
Could not load contribution data
Please try again later
Loading
5 Pull requests merged by 3 people
-
Tokenize inputs in router
#548 merged
Jul 19, 2024 -
Fix : compile bug causing models to error with 'lora' key not found
#547 merged
Jul 19, 2024 -
Move kv cache allocation to router to ensure correct block allocation
#545 merged
Jul 19, 2024 -
Preload adapters during init
#543 merged
Jul 17, 2024 -
no warm up
#540 merged
Jul 15, 2024
2 Pull requests opened by 2 people
-
LORAX_USE_GLOBAL_HF_TOKEN to be applied correctly even though request doesn't have api_token
#542 opened
Jul 16, 2024 -
Doc updates for Medusa training
#544 opened
Jul 17, 2024
3 Issues opened by 2 people
-
if LoRAX is based on punica kernels will it be able to support LoRA Adapters for Mistral NeMO 12B?
#549 opened
Jul 20, 2024 -
Support Lora Adapter generated from mistral-finetune
#546 opened
Jul 19, 2024
3 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Improve OpenAI API compatibility
#216 commented on
Jul 19, 2024 • 0 new comments -
feat: Function calling with output schema enforcement
#536 commented on
Jul 17, 2024 • 0 new comments -
Apply chat template in router to properly validate input length
#538 commented on
Jul 15, 2024 • 0 new comments