What is Kuzco?
Kuzco is an open-source Swift package that enables running large language models locally on iOS, macOS, and Mac Catalyst. Built on llama.cpp, it provides developers with privacy-first, high-performance AI integration without relying on cloud services. Its simple API, async/await support, and flexible configuration make it ideal for production-ready on-device AI applications.
Features
- Run LLMs entirely on-device with llama.cpp
- Supports multiple architectures like LLaMA, Mistral, and Phi
- Async/await API with streaming responses
- Flexible tuning for context, batch, and sampling
- Optimized for Apple Silicon and Intel Macs
Use Cases
- Build private AI chat apps
- Enable offline text generation
- Integrate LLMs into macOS productivity tools
- Develop AI-powered iOS assistants
