Skip to content

RAG with LM studio, local LLMs, Scientific PDF text extraction,

License

Notifications You must be signed in to change notification settings

tomMEM/RAG_with_LM-studio

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

RAG_with_LM Studio

RAG with LM Studio, local LLMs

Loop_PDFs_text_LM.ipynb

  • Reads all PDFs in a given folder
  • Extracts text using GROBID
  • Stores text elements in SQLite3 database
  • Recursive chunks
  • Embedding
  • Vectorization
  • Retrieval: 1. standard, 2. LangChain: MultiQueryRetriever
  • OpenAI-based chat using LM studio
  • Display Query, Prompt Info, Answer: dashboard Browser TAB
  • Retrieval and QA chain -based chat using LM studio
  • Display in new Browser TAB