Do you Know! Llama ?
Baivab Sarkar
Posted on April 11, 2024
Llama2 CSV ChatBot
It's a conversational tool powered by a fine-tuned large language model (LLM) known as Llama-2 7B. This chatbot utilizes CSV retrieval capabilities, enabling users to engage in multi-turn interactions based on uploaded CSV data.
Suuuuuuu Want to try: 👇👇👇
huggingface.co/Llama-2-GGML-CSV-Chatbot
📖 ChatBot Conversession
⚡Streamlit ver. on #v2.0.2.dev20240102
Development Specs
- Utilizes Llama-2 7B and Sentence Transformers for robust functionality.
- Developed using Langchain and Streamlit technologies for enhanced performance.
- Cross-platform compatibility with Linux, macOS, or Windows OS.
🛠️ Try it on your 💻
- Clone the Repository:
git clone https://github.com/ThisIs-Developer/Llama-2-GGML-CSV-Chatbot.git
- Install Dependencies:
pip install -r requirements.txt
Download the Llama 2 Model:
Download the Llama 2 model file named
llama-2-7b-chat.ggmlv3.q4_0.bin
from the following link:
🔗Download Llama 2 Model
Llama 2 Model Information
Name Quant method Bits Size Max RAM required llama-2-7b-chat.ggmlv3.q4_0.bin q4_0 4 3.79 GB 6.29 GB Note: After downloading the model, add the model file to the
models
directory. The file should be located atmodels\llama-2-7b-chat.ggmlv3.q4_0.bin
, in order to run the code.
📝 Usage
- Run the Application:
streamlit run app.py
- Access the Application:
- Once the application is running, access it through the provided URL.
System Requirements
- CPU: Intel® Core™ i5 or equivalent.
- RAM: 8 GB.
- Disk Space: 7 GB.
- Hardware: Operates on CPU; no GPU required.
📌 Important Notes
- While robust, this chatbot is not a substitute for professional advice.
- Ensure the CSV file adheres to the expected format for optimal performance.
💖 💪 🙅 🚩
Baivab Sarkar
Posted on April 11, 2024
Join Our Newsletter. No Spam, Only the good stuff.
Sign up to receive the latest update from our blog.