Wikitopia
LMDeploy
productInference Toolkit
Try in Playground →
Overview
Developed byShanghai AI Laboratory
Maintained byInternLM Team
LicenseApache License 2.0
Open source✓ Open Source
Use caseLLM serving and inference optimization
Technical
Protocols
OpenAI API
Integrates with
PyTorch
Also see
Based onTurboMind
Knowledge graph stats
Claims17
Avg confidence92%
Avg freshness99%
Last updatedUpdated 4 days ago
Trust distribution
100% unverified
Governance
Not assessed
Contribute governance data →

LMDeploy

product

Toolkit by MMRazor for compressing, deploying, and serving large language models

Compare with...

supports model

ValueTrustConfidenceFreshnessSources
InternLM○UnverifiedHighFresh1
Vicuna○UnverifiedHighFresh1
Llama○UnverifiedHighFresh1
ChatGLM○UnverifiedModerateFresh1

primary use case

ValueTrustConfidenceFreshnessSources
LLM serving and inference optimization○UnverifiedHighFresh1
Large Language Model Inference and Serving○UnverifiedHighFresh1

maintained by

ValueTrustConfidenceFreshnessSources
InternLM Team○UnverifiedHighFresh1
OpenMMLab○UnverifiedHighFresh1

developed by

ValueTrustConfidenceFreshnessSources
Shanghai AI Laboratory○UnverifiedHighFresh1
OpenMMLab○UnverifiedHighFresh1

pricing model

ValueTrustConfidenceFreshnessSources
Free○UnverifiedHighFresh1

open source

ValueTrustConfidenceFreshnessSources
true○UnverifiedHighFresh1

license type

ValueTrustConfidenceFreshnessSources
Apache License 2.0○UnverifiedHighFresh1

based on

ValueTrustConfidenceFreshnessSources
TurboMind○UnverifiedHighFresh1

integrates with

ValueTrustConfidenceFreshnessSources
PyTorch○UnverifiedModerateFresh1

supports protocol

ValueTrustConfidenceFreshnessSources
OpenAI API○UnverifiedModerateFresh1

requires

ValueTrustConfidenceFreshnessSources
CUDA○UnverifiedModerateFresh1

Commonly Used With

PyTorch

Related entities

Claim count: 17Last updated: 4/6/2026Edit history