inference
llm
Overview
LicenseApache-2.0
Open source✓ Open Source
Primary languagePython
Knowledge graph stats
Claims0
Avg confidence91%
Avg freshness100%
Last updatedUpdated 1h ago
Trust distribution
100% unverified
inference
product
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Compare with...data source
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| GitHub | ○Unverified | High | Fresh | 0 |
license type
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Apache-2.0 | ○Unverified | High | Fresh | 0 |
source code url
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| https://github.com/xorbitsai/inference | ○Unverified | High | Fresh | 0 |
open source
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| true | ○Unverified | High | Fresh | 0 |
github topic
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| wizardlm | ○Unverified | High | Fresh | 0 |
| whisper | ○Unverified | High | Fresh | 0 |
| vllm | ○Unverified | High | Fresh | 0 |
| qwen | ○Unverified | High | Fresh | 0 |
| pytorch | ○Unverified | High | Fresh | 0 |
| openai-api | ○Unverified | High | Fresh | 0 |
| mistral | ○Unverified | High | Fresh | 0 |
| machine-learning | ○Unverified | High | Fresh | 0 |
| llm | ○Unverified | High | Fresh | 0 |
| llamacpp | ○Unverified | High | Fresh | 0 |
| llama3 | ○Unverified | High | Fresh | 0 |
| llama | ○Unverified | High | Fresh | 0 |
| inference | ○Unverified | High | Fresh | 0 |
| glm4 | ○Unverified | High | Fresh | 0 |
| ggml | ○Unverified | High | Fresh | 0 |
| gemma | ○Unverified | High | Fresh | 0 |
| flan-t5 | ○Unverified | High | Fresh | 0 |
| deployment | ○Unverified | High | Fresh | 0 |
| chatglm | ○Unverified | High | Fresh | 0 |
| artificial-intelligence | ○Unverified | High | Fresh | 0 |
last code update
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 2026-04-10T07:22:18Z | ○Unverified | High | Fresh | 0 |
programming language
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Python | ○Unverified | High | Fresh | 0 |
github watchers
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 9212 | ○Unverified | High | Fresh | 0 |
github open issues
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 70 | ○Unverified | High | Fresh | 0 |
github forks
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 814 | ○Unverified | High | Fresh | 0 |
github stars
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 9212 | ○Unverified | High | Fresh | 0 |