inference
productllm
Try in Playground →RSS
Overview
LicenseApache-2.0
Open source✓ Open Source
Primary languagePython
Knowledge graph stats
Claims0
Avg confidence91%
Avg freshness100%
Last updatedUpdated 1h ago
Trust distribution
100% unverified
Governance
EU Riskgpai standard
GPAIStandard

inference

product

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Compare with...

data source

ValueTrustConfidenceFreshnessSources
GitHubUnverifiedHighFresh0

license type

ValueTrustConfidenceFreshnessSources
Apache-2.0UnverifiedHighFresh0

source code url

ValueTrustConfidenceFreshnessSources
https://github.com/xorbitsai/inferenceUnverifiedHighFresh0

open source

ValueTrustConfidenceFreshnessSources
trueUnverifiedHighFresh0

github topic

ValueTrustConfidenceFreshnessSources
wizardlmUnverifiedHighFresh0
whisperUnverifiedHighFresh0
vllmUnverifiedHighFresh0
qwenUnverifiedHighFresh0
pytorchUnverifiedHighFresh0
openai-apiUnverifiedHighFresh0
mistralUnverifiedHighFresh0
machine-learningUnverifiedHighFresh0
llmUnverifiedHighFresh0
llamacppUnverifiedHighFresh0
llama3UnverifiedHighFresh0
llamaUnverifiedHighFresh0
inferenceUnverifiedHighFresh0
glm4UnverifiedHighFresh0
ggmlUnverifiedHighFresh0
gemmaUnverifiedHighFresh0
flan-t5UnverifiedHighFresh0
deploymentUnverifiedHighFresh0
chatglmUnverifiedHighFresh0
artificial-intelligenceUnverifiedHighFresh0

last code update

ValueTrustConfidenceFreshnessSources
2026-04-10T07:22:18ZUnverifiedHighFresh0

programming language

ValueTrustConfidenceFreshnessSources
PythonUnverifiedHighFresh0

github watchers

ValueTrustConfidenceFreshnessSources
9212UnverifiedHighFresh0

github open issues

ValueTrustConfidenceFreshnessSources
70UnverifiedHighFresh0

github forks

ValueTrustConfidenceFreshnessSources
814UnverifiedHighFresh0

github stars

ValueTrustConfidenceFreshnessSources
9212UnverifiedHighFresh0

Related entities

Claim count: 0Last updated: 4/10/2026Edit history