Semantic Router - Steer LLMs

hansalshah

Hansal Shah

Posted on July 10, 2024

Semantic Router - Steer LLMs

I wanted to share a project I've been working on called SemRoute, and I would love to get your feedback. SemRoute is a semantic router that uses vector embeddings to route queries based on their semantic meaning. It's designed to be flexible and easy to use, without the need for training classifiers or using large language models.

Here's a brief overview:

  • Supports multiple embedding models (OpenAI, MistralAI)
  • Support custom embedding models
  • Offers dynamic and static thresholding
  • Allows different scoring methods (individual averaging, centroid)

You can check it out on GitHub: https://github.com/HansalShah007/semroute. I'd really appreciate any feedback or suggestions from this community on how to improve it or use cases you think it might be suited for.
Thanks!

💖 💪 🙅 🚩
hansalshah
Hansal Shah

Posted on July 10, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related