Do you Know! Llama ?

thisisdeveloper

Baivab Sarkar

Posted on April 11, 2024

Do you Know! Llama ?

Llama2 CSV ChatBot

It's a conversational tool powered by a fine-tuned large language model (LLM) known as Llama-2 7B. This chatbot utilizes CSV retrieval capabilities, enabling users to engage in multi-turn interactions based on uploaded CSV data.

Image description

Suuuuuuu Want to try: 👇👇👇

huggingface.co/Llama-2-GGML-CSV-Chatbot

📖 ChatBot Conversession

Image description

⚡Streamlit ver. on #v2.0.2.dev20240102

ChatBot Conversession img-1 png

Development Specs

🛠️ Try it on your 💻

  1. Clone the Repository:
git clone https://github.com/ThisIs-Developer/Llama-2-GGML-CSV-Chatbot.git
Enter fullscreen mode Exit fullscreen mode
  1. Install Dependencies:
pip install -r requirements.txt
Enter fullscreen mode Exit fullscreen mode

Download the Llama 2 Model:

Download the Llama 2 model file named llama-2-7b-chat.ggmlv3.q4_0.bin from the following link:
🔗Download Llama 2 Model

Image description

Llama 2 Model Information

Name Quant method Bits Size Max RAM required
llama-2-7b-chat.ggmlv3.q4_0.bin q4_0 4 3.79 GB 6.29 GB

Note: After downloading the model, add the model file to the models directory. The file should be located at models\llama-2-7b-chat.ggmlv3.q4_0.bin, in order to run the code.

📝 Usage

  1. Run the Application:
streamlit run app.py
Enter fullscreen mode Exit fullscreen mode
  1. Access the Application:
    • Once the application is running, access it through the provided URL.

Image description

System Requirements

  • CPU: Intel® Core™ i5 or equivalent.
  • RAM: 8 GB.
  • Disk Space: 7 GB.
  • Hardware: Operates on CPU; no GPU required.

Image description

📌 Important Notes

  • While robust, this chatbot is not a substitute for professional advice.
  • Ensure the CSV file adheres to the expected format for optimal performance.
💖 💪 🙅 🚩
thisisdeveloper
Baivab Sarkar

Posted on April 11, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related

Do you Know! Llama ?
ai Do you Know! Llama ?

April 11, 2024