- Easy to run on
Local
orKaggle
(new) - Using any model from
Huggingface
andOllama
- Process multiple PDF inputs.
- Chat with multiples languages (Coming soon).
- Simple UI with
Gradio
.
- Import
notebooks/kaggle.ipynb
to Kaggle - Replace
<YOUR_NGROK_TOKEN>
with your tokens.
git clone https://github.com/datvodinh/rag-chatbot.git
cd rag-chatbot
docker compose up --build
source ./scripts/install_extra.sh
-
MacOS, Window: Download
-
Linux
curl -fsSL https://ollama.com/install.sh | sh
- Macos
brew install ngrok/ngrok/ngrok
- Linux
curl -s https://ngrok-agent.s3.amazonaws.com/ngrok.asc \
| sudo tee /etc/apt/trusted.gpg.d/ngrok.asc >/dev/null \
&& echo "deb https://ngrok-agent.s3.amazonaws.com buster main" \
| sudo tee /etc/apt/sources.list.d/ngrok.list \
&& sudo apt update \
&& sudo apt install ngrok
source ./scripts/install.sh
source ./scripts/run.sh
or
python -m rag_chatbot --host localhost
- Using Ngrok
source ./scripts/run.sh --ngrok
- Add evaluation.
- Better Document Processing.
- Support better Embedding Model for Vietnamese and other languages.
- ReAct Agent.
- Document mangement (Qrdant, MongoDB,...)