textgen
Open-source desktop app for running local language models
- #7 of 10 in best local LLM runners
- Free and open source
- Free to use
- Open source
- LinuxWindowsmacOS
Ranked 7 of 10 in best local LLM runners
AGPL-3.0 desktop app for local models with text, vision and tool-calling support, an OpenAI- and Anthropic-compatible API and portable builds for Linux, Windows and macOS. It suits people comfortable with local setup.
Best for Local models with an API for apps and tools
About textgen
textgen is a desktop app for loading and running local language models. Its README lists text and vision models, tool-calling and web search, and it offers an API compatible with OpenAI and Anthropic clients. The portable builds cover CUDA, Vulkan, ROCm and CPU-only setups on Linux, Windows and macOS.
The repository is AGPL-3.0 licensed and had about 47,700 stars when checked. The README says the project is open source with no telemetry. Users who want a chat-first app may compare LM Studio or Jan, which are also in this ranking.
Key features
- Local model desktop app
- Vision and tool calling
- Web search
- OpenAI and Anthropic API
- CUDA, Vulkan, ROCm and CPU builds
Strengths
- AGPL-3.0 open source with no telemetry
- Portable builds for Linux, Windows and macOS
- OpenAI and Anthropic compatible API
Limits
- AGPL-3.0 copyleft applies to modified versions run as a service
- Vision and tool features depend on the model used
Where textgen ranks
How textgen compares
| Product | Score | Price | Platforms | Interface | Model format | Cloud option |
|---|---|---|---|---|---|---|
#5 Jan | 86.0 | Free and open source | macOSWindowsLinux | Desktop chat app with local API | Local models | Optional cloud providers |
#6 KoboldCpp | 84.5 | Free and open source | WindowsLinuxmacOS | Web interface (KoboldAI Lite) | GGUF | Not listed |
| #7textgen | 82.5 | Free and open source | LinuxWindowsmacOS | Desktop app | Local models loaded from disk | Not listed |
#8 llamafile | 81.0 | Free and open source | Command linemacOSLinuxWindows | Single executable | Single-file model bundles | Not listed |
#9 MLX LM | 80.0 | Free and open source | macOSCommand line | Command line and Python | MLX format models | Not listed |
The full comparison table for best local LLM runners has all 10 products.
Alternatives to textgen
All 9 alternatives
OllamaRun open AI models locally with a simple command-line install
llama.cppC and C++ engine for running local LLMs, with a server and tools
LM StudioDesktop app for downloading and chatting with local language models
GPT4AllDesktop app for running local open-source models on Windows, macOS and Linux- JanOpen-source desktop app for running AI models on your computer
- KoboldCppSingle-file GGUF runner with the KoboldAI Lite web interface
Questions about textgen
- Is textgen free?
- textgen can be used without paying: AGPL-3.0 desktop app is free; models are downloaded separately. Check the vendor’s pricing page for current limits.
- Is textgen open source?
- Yes. textgen publishes its source code under the AGPL-3.0 license.
- Which platforms does textgen support?
- textgen is available on: Linux, Windows, macOS.
- What is textgen best for?
- Local models with an API for apps and tools. In our ranking of local LLM runners it is number 7 of 10 with a score of 82.5.
Show this ranking on your site
If you make or maintain textgen, this badge links back to this page and shows its current rank. It updates when the ranking does.
<a href="https://listme.name/software/textgen"><img src="https://listme.name/badge/textgen.svg" height="28" alt="Ranked #7 of 10 local LLM runners on listme.name"></a>Articles that mention textgen
All articles- Roundups · 6 min readBest ChatGPT alternatives for chat, search and local modelsCompare ChatGPT alternatives by free limits, privacy, model access, coding and research. See hosted chatbots, search-first tools and local model runners.
- Explainers · 5 min readLocal LLM runners explained: running models on your computerWhat running an AI model locally means, how hardware limits it, when it makes sense, and how local runners such as Ollama compare with hosted chatbots.
