DEV Community

Hansal Shah
Hansal Shah

Posted on

Semantic Router - Steer LLMs

I wanted to share a project I've been working on called SemRoute, and I would love to get your feedback. SemRoute is a semantic router that uses vector embeddings to route queries based on their semantic meaning. It's designed to be flexible and easy to use, without the need for training classifiers or using large language models.

Here's a brief overview:

  • Supports multiple embedding models (OpenAI, MistralAI)
  • Support custom embedding models
  • Offers dynamic and static thresholding
  • Allows different scoring methods (individual averaging, centroid)

You can check it out on GitHub: https://github.com/HansalShah007/semroute. I'd really appreciate any feedback or suggestions from this community on how to improve it or use cases you think it might be suited for.
Thanks!

Top comments (0)

Image of Docusign

🛠️ Bring your solution into Docusign. Reach over 1.6M customers.

Docusign is now extensible. Overcome challenges with disconnected products and inaccessible data by bringing your solutions into Docusign and publishing to 1.6M customers in the App Center.

Learn more