Haystack AI to Create RAG Pipeline

jhparmar

parmarjatin4911@gmail.com

Posted on January 28, 2024

Haystack AI to Create RAG Pipeline

Liquid syntax error: Variable '{{

Haystack AI to Create RAG Pipeline

pip install haystack-ai datasets ollama-haystack gradio

ollama run mistral

Importing required libraries

from datasets import load_dataset
from haystack import Document
from haystack.document_stores import InMemoryDocumentStore
from haystack.components.retrievers import InMemoryBM25Retriever
from haystack.components.builders import PromptBuilder
from ollama_haystack import OllamaGenerator
from haystack.pipeline import Pipeline

Load dataset and create documents

dataset = load_dataset("bilgeyucel/seven-wonders", split="train")
docs = [Document(content=doc["content"], meta=doc["meta"]) for doc in dataset]

Initialize document store and write documents

document_store = InMemoryDocumentStore()
document_store.write_documents(docs)

Initialize retriever

retriever = InMemoryBM25Retriever(document_store)

Define prompt template

template = """
Given the following information, answer the question.

Context:
{% for document in documents %}' was not properly terminated with regexp: /\}\}/

💖 💪 🙅 🚩
jhparmar
parmarjatin4911@gmail.com

Posted on January 28, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related