All projects
LitServe
Multimodal
LLM
MiniCPM

Chat with MiniCPM-V 2.6

·
Chat with MiniCPM-V 2.6

Overview

MiniCPM-V 2.6 is the most capable model in the MiniCPM-V series — designed to deliver GPT-4V-level multimodal performance while running efficiently on mobile and edge hardware.

This project deploys it via LitServe for scalable REST API serving, supporting:

  • Single image QA
  • Multi-image reasoning
  • Video understanding

Get Started

pip install -r requirements.txt
python server.py   # LitServe API
python client.py   # send queries