Wikitopia
Llama.cpp
productLLM inference frameworks
Try in Playground →
Overview
Developed byGeorgi Gerganov
LicenseMIT License
Open source✓ Open Source
Use caseCPU-based LLM inference
Integrates with
Hugging Face models
Knowledge graph stats
Claims19
Avg confidence93%
Avg freshness100%
Last updatedUpdated 4 days ago
WikidataQ125998452
Trust distribution
100% unverified
Governance
Not assessed
Contribute governance data →

Llama.cpp

product

C++ implementation for efficient inference of LLaMA models on consumer hardware

Compare with...

pricing model

ValueTrustConfidenceFreshnessSources
free○UnverifiedHighFresh1

open source

ValueTrustConfidenceFreshnessSources
true○UnverifiedHighFresh1

written in

ValueTrustConfidenceFreshnessSources
C++○UnverifiedHighFresh1

based on

ValueTrustConfidenceFreshnessSources
C++○UnverifiedHighFresh1
GGML library○UnverifiedHighFresh1
GGML○UnverifiedHighFresh1

license type

ValueTrustConfidenceFreshnessSources
MIT License○UnverifiedHighFresh1

supports model

ValueTrustConfidenceFreshnessSources
Meta Llama models○UnverifiedHighFresh1
GGML format models○UnverifiedHighFresh1
GGUF format models○UnverifiedHighFresh1

primary use case

ValueTrustConfidenceFreshnessSources
CPU-based LLM inference○UnverifiedHighFresh1
CPU-based inference for large language models○UnverifiedHighFresh1

developed by

ValueTrustConfidenceFreshnessSources
Georgi Gerganov○UnverifiedHighFresh1

supports platform

ValueTrustConfidenceFreshnessSources
cross-platform○UnverifiedHighFresh1

requires

ValueTrustConfidenceFreshnessSources
no GPU dependencies○UnverifiedHighFresh1

integrates with

ValueTrustConfidenceFreshnessSources
Hugging Face models○UnverifiedModerateFresh1

alternative to

ValueTrustConfidenceFreshnessSources
PyTorch○UnverifiedModerateFresh1
Transformers library inference○UnverifiedModerateFresh1
PyTorch inference○UnverifiedModerateFresh1

Alternatives & Similar Tools

PyTorch
alternative to
Compare →
Transformers library inference
alternative to
Compare →
PyTorch inference
alternative to
Compare →

Commonly Used With

Hugging Face models

Related entities

Claim count: 19Last updated: 4/6/2026Edit history