Back to search
This project has implemented the RAG function on Jetson and supports TXT and PDF document formats. It uses MLC for 4-bit quantization of the Llama2-7b model, utilizes ChromaDB as the vector database, and connects these features with Llama_Index. I hope you like this project.
Stars
12
Forks
1
Watchers
12
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
23
commits