AI Bot: Intelligent Financial Query Assistant Powered by PostgreSQL and Ollama

ngtduc693

Duc Nguyen Thanh

Posted on November 9, 2024

AI Bot: Intelligent Financial Query Assistant Powered by PostgreSQL and Ollama

This is a submission for the Open Source AI Challenge with pgai and Ollama

What I Built

Presenting An AI bot is a clever assistant designed to comprehend and react to actual questions about banking, insurance, and credit cards. By matching the semantics of user inquiries with the most appropriate answers, the AI Bot provides contextually relevant answers. It is designed to not only recognize but also fully understand the user's query purpose. The AI Bot provides a smooth and easy-to-use user experience by accurately interpreting and responding to user inquiries about specific policies, financial advice, or credit details.


Demo

https://www.youtube.com/watch?v=MTUj1jAPEdk&feature=youtu.be


Tools Used

To accomplish its responsive, high-performance AI capabilities, this project makes use of a number of potent tools and technologies:

- Database: PostgreSQL server, provided by Timescale, serves as the foundational database for vector storage and querying.
- Programming Language: Built using .NET 8 for seamless and robust server-side execution.
- Model: Utilized Ollama’s nomic-embed-text model to generate precise embeddings and support AI Bot’s semantic understanding.
- Embedding API: Ollama’s embedding API enabled enhanced text matching and contextual understanding.
- Algorithm: Cosine Similarity was implemented to measure and match query relevance.
- Cache: Optimized with Memory Cache for faster responses and reduced computation time.
- AI Extension: pgvector was instrumental in managing and querying vector data.


Final Thoughts

The process of creating AI Bot was fascinating and demonstrated how open-source, AI-powered tools can be used to create practical applications. This project exemplifies how PostgreSQL and Ollama's open-source models may be used to create solutions that are intelligent, responsive, and easily accessible.


Prize Categories:

  • Open-source Models from Ollama: AI Bot leverages Ollama’s open-source models for embedding and understanding text-based queries.
  • Embeeding API: Ollama’s embedding API enabled enhanced text matching and contextual understanding
  • Vectorizer Vibe: With pgvector, we harnessed vector embeddings to achieve high-accuracy query matching
  • PR: ngtduc693
💖 💪 🙅 🚩
ngtduc693
Duc Nguyen Thanh

Posted on November 9, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related

Customer Support RAG Assistant
devchallenge Customer Support RAG Assistant

November 11, 2024

Sound Scape
devchallenge Sound Scape

November 11, 2024

open-contribution
devchallenge open-contribution

November 11, 2024