SF9040 / mlx-ui Public

forked from da-z/mlx-ui

Notifications You must be signed in to change notification settings
Fork 0
Star 0

A hackish frontend for mlx-lm using streamlit. The default model is the excellent mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit but supports other ChatML models as well

0 stars 31 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
.gitignore		.gitignore
README.md		README.md
app.py		app.py
install.sh		install.sh
requirements.txt		requirements.txt

Repository files navigation

MLX Chat

A hackish frontend for mlx-lm. Uses the mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit model.

Install

$ ./install.sh

Run

$ . ./venv/bin/activate
$ streamlit run app.py

TODO

Add "continue" function

About

A hackish frontend for mlx-lm using streamlit. The default model is the excellent mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit but supports other ChatML models as well

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 86.5%
Shell 13.5%