Internal AI platform: document search and LLM exposed through an API
Professional engagementGo2cam International · 2022 – 2025
- Context
- Teams were losing time searching dense technical documentation spread across several internal sources. The goal was context-aware, verifiable answers without leaving the business tools people already used, then making that capability available company-wide, not to a single application.
- Architecture
- Document ingestion and normalisation pipeline, chunking and embedding, storage in a vector database (Qdrant, ChromaDB, then PostgreSQL with pgvector). Semantic search is exposed through a REST API alongside the in-house LLM itself: a single entry point consumed by several business applications, rather than an integration reimplemented by every team. A support chatbot was built on top of it to absorb first-line technical questions.
- Technical choices
- One access layer for AI across the company: applications consume a stable API contract and stay unaware of the model behind it, so the model can be replaced without touching any client. Answers are always tied back to their source, so they remain verifiable.
- Results
- Internal research time cut by roughly 50%, with context-aware, auditable answers. The chatbot absorbs recurring support requests.
- Python
- Qdrant
- Django
- RAG
- pgvector
- REST API
