It's an API to run ggml compatible models: llama, gpt4all, rwkv, whisper, vicuna, koala, gpt4all-j, cerebras, falcon, dolly, starcoder, and many others. Serge is a web interface for chatting with ...
直接使用包内置资源初始化, 不依赖 GitHub 下载. 在网络受限, 代理不稳定, 企业内网或离线环境下更稳妥 ...