All projects
LitServe
AI
APIs
Production

LitServe Examples

·
GitHub
LitServe Examples

Overview

LitServe Examples is a collection of self-contained, production-ready examples showcasing how to deploy AI models at scale using LitServe.

| Category | Example | Description | |----------|---------|-------------| | Speech | Whisper STT API | OpenAI Whisper speech recognition | | Speech | Parler TTS | High-quality text-to-speech synthesis | | Speech | Chatterbox TTS | TTS with voice cloning & emotion control | | Vision | RF-DETR Object Detection | SOTA real-time object detection | | Embeddings | Jina CLIP v2 | Multimodal embeddings API | | Embeddings | ModernBERT Embed | Text embedding service | | LLMs | DeepSeek-R1 | Reasoning LLM deployment |

Highlights

  • Every example is self-contained in its own folder
  • Built-in batching, streaming, and auto-scaling via LitServe
  • Apache 2.0 licensed, Hacktoberfest-friendly