Sign in

Browse by category

More

Alternatives

Best llama.cpp alternatives in 2026

llama.cpp is C and C++ engine for running local LLMs, with a server and tools. These 9 alternatives come from the same rankings, ordered by editorial score. Connected products carry a small, disclosed lift.

9 alternatives From best local LLM runners How we rank Share

Ranked alternatives

  1. Ollama

    Also runs on macOS, Linux, Windows. The simplest way to run open models locally on macOS, Linux and Windows, with an MIT-licensed runtime. Cloud models and higher tiers are paid, and speed depends on your hardware.

    Best for Running open models from a command line

    macOSLinuxWindowsFree plan, paid upgradesOpen source

    92.0of 100
    Visit Alternatives

  2. LM Studio

    Also runs on Windows, macOS, Linux. The friendliest graphical way to download and chat with local models, with a local server for other tools. The app is closed source, unlike llama.cpp or Jan, and it is aimed at desktops rather than servers.

    Best for Trying local models through a polished desktop app

    WindowsmacOSLinuxFree

    89.0of 100
    Visit Alternatives

  3. GPT4All

    Also runs on Windows, macOS, Linux. A desktop app for Windows, macOS and Linux with local document chat and an MIT license. It offers fewer controls than the llama.cpp engine it builds on.

    Best for Desktop chat with local documents

    WindowsmacOSLinuxFree and open sourceOpen source

    87.5of 100
    Visit Alternatives

  4. Jan

    Also runs on macOS, Windows, Linux. An open-source desktop chat app for macOS, Windows and Linux that runs offline and can connect to cloud providers. It is a finished app rather than an engine, so it gives less developer control than llama.cpp.

    Best for Offline chat on a personal computer

    macOSWindowsLinuxFree and open sourceOpen source

    86.0of 100
    Visit Alternatives

  5. KoboldCpp

    Also runs on Windows, Linux, macOS. Single-file AGPL-3.0 runner for GGUF models, with the KoboldAI Lite interface and image, speech and music generation on Windows, Linux and macOS. Its copyleft license and wider feature set place it below Ollama.

    Best for Single-file local writing and chat with GGUF models

    WindowsLinuxmacOSFree and open sourceOpen source

    84.5of 100
    Visit Alternatives

  6. textgen

    Also runs on Linux, Windows, macOS. AGPL-3.0 desktop app for local models with text, vision and tool-calling support, an OpenAI- and Anthropic-compatible API and portable builds for Linux, Windows and macOS. It suits people comfortable with local setup.

    Best for Local models with an API for apps and tools

    LinuxWindowsmacOSFree and open sourceOpen source

    82.5of 100
    Visit Alternatives

  7. llamafile

    Also runs on macOS, Linux, Windows. Packages a model and its runtime into one executable that runs on macOS, Linux, Windows and BSD. Windows cannot run executables over 4 GB, which rules out larger models there.

    Best for Sharing a model as a single portable file

    Command linemacOSLinuxWindowsFree and open sourceOpen source

    81.0of 100
    Visit Alternatives

  8. MLX LM

    Also runs on macOS. MIT-licensed Python package for running and tuning models with MLX on Mac, installed with pip or conda. Large models need macOS 15.0 or later, and the tool is limited to Mac computers, so it ranks below the cross-platform runners.

    Best for Python scripting of local models on a Mac

    macOSCommand lineFree and open sourceOpen source

    80.0of 100
    Visit Alternatives

  9. LocalAI

    A self-hosted server for text, image, voice and video models, MIT licensed and usable without a GPU. It runs as a server, so it is less direct for a personal chat app.

    Best for Self-hosted AI server for several model types

    Self-hostedFree and open sourceOpen source

    79.0of 100
    Visit Alternatives

Narrow the alternatives

llama.cpp alternatives for Linux

llama.cpp alternatives for Windows

llama.cpp alternatives for macOS

Compare llama.cpp head to head

Or build your own comparison table with llama.cpp and up to three other products.

About llama.cpp alternatives

What is the best alternative to llama.cpp?
On listme.name the highest-scored alternative is Ollama, followed by LM Studio. The right choice depends on price, platform and whether you need open source.
Is there a free alternative to llama.cpp?
Yes. Free options include Ollama, LM Studio, GPT4All.

Before you switch

Learning Center
1:16Intermediate · 6 min readLock-in and exit costs: check how you leave before you commitLearn what lock-in is, run an export test on real data, compare open formats and local versus hosted storage, and plan an exit with your EU data rights in mind.1:20Beginner · 5 min readHow to run a software trial that tells you somethingRun a software trial that answers your question. Set criteria first, use real files, test import, export and sharing, then decide before the end date.

Articles that mention llama.cpp

All articles