All projects
LitServe
Multimodal
LLM
MiniCPM
Chat with MiniCPM-V 2.6
Overview
MiniCPM-V 2.6 is the most capable model in the MiniCPM-V series — designed to deliver GPT-4V-level multimodal performance while running efficiently on mobile and edge hardware.
This project deploys it via LitServe for scalable REST API serving, supporting:
- Single image QA
- Multi-image reasoning
- Video understanding
Get Started
pip install -r requirements.txt
python server.py # LitServe API
python client.py # send queries