Run your own AI models locally while maintaining privacy and reducing costs with GPT Breeze's custom model server support.

Overview

GPT Breeze supports any local AI model server that provides an OpenAI-compatible API. This means you can:

• Keep your data private - All conversations stay on your device
• Reduce costs - No API fees for using your own models
• Work offline - Use AI even without internet connection
• Choose any model - Run specialized models for your specific needs

Key Benefits

• Complete data privacy and control
• Zero ongoing API costs after initial setup
• Offline capability for sensitive work
• Support for specialized and fine-tuned models

Getting Started

What You'll Need

• A local model server running on your computer
• Basic understanding of your local server's configuration
• 5-10 minutes for initial setup

Ollama (Recommended for Beginners)

Best for: Easy setup and model management