retrieval

An LLM Gateway for RAG: Embeddings and Chat, One Key

RAG apps call two model types — embeddings and chat — often from different providers. Here is how a single gateway unifies both behind one key, with shared cost tracking, budgets, and fallback.