by hieunq95 · Agent Tool · ★ 20
🚀 Tiny LLM Chat Agent A FastAPI + Streamlit based Retrieval-Augmented Generation (RAG) chatbot, designed to chat with users using local large language models (LLMs) while allowing PDF uploads for context-aware conversations. The system leverages the Qwen-2.5:0.5B-Instruct model, a lightweight LLM optimized for efficient on-device processing. This minimum setup ensures fast response times while enabling customized knowledge retrieval from uploaded documents, making it ideal for research, study, and technical applications. Disclaimer: The is provided for the demonstration purpose.
| Stars | 20 |
| Forks | 3 |
| Language | Python |
| Category | Agent Tool |
| Quality Score | 60.5790738036841/100 |
| Open Issues | 1 |
| Last Updated | 2025-04-01 |
| Created | 2025-03-14 |
| Platforms | python |
| Est. Tokens | ~1068k |
Explore other popular agent tool tools:
tiny-llm-agent is Tiny LLM chatbot powered by Qwen2.5:0.5B-Instruct. It can run locally on a laptop. Depoloyment on Google Cloud is also supported.. It is categorized as a Agent Tool with 20 GitHub stars.
tiny-llm-agent is primarily written in Python.
You can find installation instructions and usage details in the tiny-llm-agent GitHub repository at github.com/hieunq95/tiny-llm-agent. The project has 20 stars and 3 forks, indicating an active community.