A Project-shaped setup ...

RAG for Local LLM, chat with PDF/doc/txt files, ChatPDF. 纯原生实现RAG功能，基于本地LLM、embedding模型、reranker模型实现，支持GraphRAG，无须安装任何第三方agent库。 Local-first RAG server for developers. Semantic + keyword ...

Let's walkthrough replacing an existing OpenAI client to route queries between LLMs instead of using only a single model. First, let's replace our OpenAI client by initializing the RouteLLM controller ...