Simple CLI and local API
Ollama
A practical starting point when you want short commands, model management and a local API without configuring the inference engine manually.
Software that runs models on your hardware
Local AI tools for running LLMs on your PC
Choose the software that matches your workflow, then verify that the model and GGUF quantization fit your RAM and VRAM. Tool choice affects usability; model size and context length determine whether it runs.
Choose by workflow
Four focused options, not an indiscriminate directory.
Desktop interface
LM Studio
Suited to users who prefer discovering, downloading and chatting with local models from a graphical desktop application.
Control and integration
llama.cpp
The lower-level choice for direct GGUF execution, command-line control, local serving and hardware-specific tuning.
Open-source desktop app
Jan
A desktop-oriented option for local conversations and model management, with an interface intended to keep the workflow on your machine.
Local AI tool comparison
| Tool | Interface | Best fit | Start here |
|---|---|---|---|
| Ollama | CLI and local API | Fast setup and application integration | Run locally guide |
| LM Studio | Desktop GUI | Visual model discovery and chat | Choose by GPU |
| llama.cpp | CLI, server and library | Direct GGUF control and tuning | Understand GGUF |
| Jan | Desktop GUI | Open-source desktop workflow | Search Jan models |
Software features change over time. Hardware compatibility on AI Local Check is calculated from the selected model, quantization, context and available memory rather than from the tool name alone.
Before installing
Check the hardware first
A polished interface cannot make an oversized model fit. Start with the memory requirement, then choose the tool.
Current GGUF catalog