Discussion and suggestion on an idea

🚀 Exploring an idea — would love to hear your thoughts!
I’ve been thinking about building a platform that can help businesses provide AI-powered customer support using their own business data, documents, policies, product information, and more.
But one question I’m currently exploring is not the AI model itself — it’s the architecture and delivery.
For a platform that may serve multiple businesses:
🔹 Should we maintain completely separate vector databases for each business?
🔹 Or would a shared, multi-tenant vector architecture with proper metadata isolation be more efficient and scalable?
🔹 How should the knowledge be organized when a business has products, policies, FAQs, documents, and constantly changing information?
🔹 More importantly, how should the final product actually be delivered to the client?
Should it be:
→ A simple website-embeddable chatbot
→ An SDK/component they can integrate into their existing application
→ An API-first platform
→ Or a combination of these approaches?
I’m currently exploring the best balance between scalability, data isolation, infrastructure cost, ease of integration, and the actual value delivered to businesses.
I’d genuinely appreciate perspectives from developers, architects, SaaS builders, and anyone who has worked with RAG, vector databases, multi-tenant systems, or AI-powered customer support platforms.
I’m still shaping the architecture, so I’d love to learn from different approaches and experiences. 🙌
If you have any ideas, suggestions, or architectural approaches, please feel free to comment or DM me. I’d be really excited to discuss and learn from you! 🚀