MiniCPM-V-4_5 CPU Deployment

  • Modes: int4 (default) and fp16
  • Running on CPU
Precision Mode (CPU)

int4 as default. fp16 uses bf16/fp32 on CPU.