model-optimizer

关于

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

收录记录

1. GitHub Trending

   2026年9月25日 – 2026年9月27日 · 2 次收录