MODEL DIRECTORY

Supported Local AI Models

Browse verified GGUF text and reasoning models ready for local execution with Ollama, LM Studio, or llama.cpp. Click any model to calculate required VRAM, RAM and tokens per second for your setup.

Showing 165 models Updated continuously from Hugging Face
bartowski GGUF Ready

Qwen2.5-32B-Instruct

bartowski/Qwen2.5-32B-Instruct-GGUF

892,605 93
Calculate
unsloth GGUF Ready

GLM-5.3-Flash

unsloth/GLM-5.3-Flash-GGUF

832,042 512
Calculate
Qwen GGUF Ready

Qwen3-8B

Qwen/Qwen3-8B-GGUF

708,623 361
Calculate
Qwen GGUF Ready

Qwen3-4B

Qwen/Qwen3-4B-GGUF

660,418 213
Calculate
Qwen GGUF Ready

Qwen2.5-7B-Instruct

Qwen/Qwen2.5-7B-Instruct-GGUF

656,626 204
Calculate
unsloth GGUF Ready

gpt-oss-20b

unsloth/gpt-oss-20b-GGUF

572,896 893
Calculate
unsloth GGUF Ready

Qwen3-Coder-30B-A3B-Instruct

unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF

472,768 1189
Calculate
LiquidAI GGUF Ready

LFM2.5-2.6B

LiquidAI/LFM2.5-2.6B-GGUF

464,762 395
Calculate
Qwen GGUF Ready

Qwen2.5-1.5B-Instruct

Qwen/Qwen2.5-1.5B-Instruct-GGUF

412,901 190
Calculate
Qwen GGUF Ready

Qwen2.5-0.5B-Instruct

Qwen/Qwen2.5-0.5B-Instruct-GGUF

385,994 164
Calculate
unsloth GGUF Ready

Ornith-1.0-9B

unsloth/Ornith-1.0-9B-GGUF

380,855 64
Calculate
bartowski GGUF Ready

Meta-Llama-3.1-8B-Instruct

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

372,944 428
Calculate
unsloth GGUF Ready

GLM-5.3

unsloth/GLM-5.3-GGUF

356,051 114
Calculate
Qwen GGUF Ready

Qwen3-14B

Qwen/Qwen3-14B-GGUF

332,419 156
Calculate
Qwen GGUF Ready

Qwen2.5-Coder-7B-Instruct

Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

328,262 606
Calculate
janhq GGUF Ready

Jan-v3.5-4B

janhq/Jan-v3.5-4B-gguf

315,713 39
Calculate
LiquidAI GGUF Ready

LFM2.5-1.2B-Instruct

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

283,883 233
Calculate
bartowski GGUF Ready

Kwaipilot_KAT-Coder-V2.5-Dev

bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF

281,804 145
Calculate
LiquidAI GGUF Ready

LFM2.5-230M

LiquidAI/LFM2.5-230M-GGUF

261,764 127
Calculate
Qwen GGUF Ready

Qwen2.5-3B-Instruct

Qwen/Qwen2.5-3B-Instruct-GGUF

252,364 226
Calculate
ggml-org GGUF Ready

gpt-oss-120b

ggml-org/gpt-oss-120b-GGUF

249,731 81
Calculate
unsloth GGUF Ready

GLM-4.7-Flash

unsloth/GLM-4.7-Flash-GGUF

242,369 738
Calculate
Qwen GGUF Ready

Qwen2.5-Coder-1.5B-Instruct

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

239,455 154
Calculate
unsloth GGUF Ready

Qwen-AgentWorld-35B-A3B

unsloth/Qwen-AgentWorld-35B-A3B-GGUF

238,754 253
Calculate
unsloth GGUF Ready

Qwen3-1.7B

unsloth/Qwen3-1.7B-GGUF

232,942 81
Calculate
Qwen GGUF Ready

Qwen3-0.6B

Qwen/Qwen3-0.6B-GGUF

227,232 108
Calculate
unsloth GGUF Ready

flint

unsloth/flint-GGUF

221,711 339
Calculate
LiquidAI GGUF Ready

LFM2.5-24B-A2B

LiquidAI/LFM2.5-24B-A2B-GGUF

219,554 242
Calculate
ggml-org GGUF Ready

NVIDIA-Nemotron-3.5-Lightning-30B-A3B

ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

201,887 36
Calculate
unsloth GGUF Ready

Ornith-1.5-122B

unsloth/Ornith-1.5-122B-GGUF

199,280 86
Calculate
Qwen GGUF Ready

Qwen2.5-Coder-14B-Instruct

Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

189,286 266
Calculate
unsloth GGUF Ready

Llama-3.2-3B-Instruct

unsloth/Llama-3.2-3B-Instruct-GGUF

181,241 89
Calculate
bartowski GGUF Ready

Qwen2.5-14B-Instruct

bartowski/Qwen2.5-14B-Instruct-GGUF

167,230 75
Calculate
unsloth GGUF Ready

NVIDIA-Nemotron-3.5-Bolt-E4B

unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF

162,308 153
Calculate
unsloth GGUF Ready

Qwen3-Coder-Next

unsloth/Qwen3-Coder-Next-GGUF

161,372 896
Calculate
unsloth GGUF Ready

DeepSeek-R1-0528-Qwen3-8B

unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF

156,725 479
Calculate
bartowski GGUF Ready

Llama-3.2-1B-Instruct

bartowski/Llama-3.2-1B-Instruct-GGUF

152,083 184
Calculate
bartowski GGUF Ready

Qwen_Qwen3-4B

bartowski/Qwen_Qwen3-4B-GGUF

143,593 22
Calculate
bartowski GGUF Ready

DeepSeek-R1-Distill-Qwen-7B

bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF

136,745 149
Calculate
Qwen GGUF Ready

Qwen3-32B

Qwen/Qwen3-32B-GGUF

116,808 77
Calculate
unsloth GGUF Ready

GLM-5.2

unsloth/GLM-5.2-GGUF

116,215 647
Calculate
bartowski GGUF Ready

Qwen_Qwen3-0.6B

bartowski/Qwen_Qwen3-0.6B-GGUF

115,286 28
Calculate
unsloth GGUF Ready

Phi-4-mini-instruct

unsloth/Phi-4-mini-instruct-GGUF

115,004 160
Calculate
Qwen GGUF Ready

Qwen3-30B-A3B

Qwen/Qwen3-30B-A3B-GGUF

108,354 88
Calculate
google GGUF Ready

gemma-7b

google/gemma-7b

108,318 3463
Calculate
LiquidAI GGUF Ready

LFM2.5-350M

LiquidAI/LFM2.5-350M-GGUF

105,649 108
Calculate
unsloth GGUF Ready

DeepSeek-R1-Distill-Qwen-1.5B

unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

102,047 167
Calculate
lmstudio-community GGUF Ready

gemma-3-1b-it

lmstudio-community/gemma-3-1b-it-GGUF

100,317 9
Calculate
lmstudio-community GGUF Ready

Qwen3-4B-Instruct-2507

lmstudio-community/Qwen3-4B-Instruct-2507-GGUF

99,871 20
Calculate
bartowski GGUF Ready

microsoft_Phi-4-mini-instruct

bartowski/microsoft_Phi-4-mini-instruct-GGUF

98,892 52
Calculate
LiquidAI GGUF Ready

LFM3-1.7B

LiquidAI/LFM3-1.7B-GGUF

97,184 136
Calculate
google GGUF Ready

gemma-2b

google/gemma-2b

95,538 1265
Calculate
Qwen GGUF Ready

Qwen2.5-Coder-3B-Instruct

Qwen/Qwen2.5-Coder-3B-Instruct-GGUF

94,393 184
Calculate
unsloth GGUF Ready

gemma-3-270m-it

unsloth/gemma-3-270m-it-GGUF

91,902 179
Calculate
bartowski GGUF Ready

Nanbeige_Nanbeige4.3-33B

bartowski/Nanbeige_Nanbeige4.3-33B-GGUF

90,952 22
Calculate
LiquidAI GGUF Ready

LFM2.5-8B-A1B

LiquidAI/LFM2.5-8B-A1B-GGUF

90,842 327
Calculate
bartowski GGUF Ready

NousResearch_Hermes-4-14B

bartowski/NousResearch_Hermes-4-14B-GGUF

82,636 63
Calculate
bartowski GGUF Ready

Qwen_Qwen3-4B-Instruct-2507

bartowski/Qwen_Qwen3-4B-Instruct-2507-GGUF

75,844 25
Calculate
bartowski GGUF Ready

DeepSeek-R1-Distill-Qwen-32B

bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF

75,521 332
Calculate
unsloth GGUF Ready

Qwen3-Next-80B-A3B-Instruct

unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF

73,381 202
Calculate
bartowski GGUF Ready

Qwen_Qwen3-30B-A3B-Instruct-2507

bartowski/Qwen_Qwen3-30B-A3B-Instruct-2507-GGUF

72,877 31
Calculate
bartowski GGUF Ready

DeepSeek-R1-Distill-Qwen-14B

bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF

72,012 259
Calculate
bartowski GGUF Ready

meta-llama_Llama-4-Scout-17B-16E-Instruct-old

bartowski/meta-llama_Llama-4-Scout-17B-16E-Instruct-old-GGUF

68,172 33
Calculate
TheBloke GGUF Ready

Llama-2-7B-Chat

TheBloke/Llama-2-7B-Chat-GGUF

63,657 517
Calculate
bartowski GGUF Ready

L3-8B-Stheno-v3.2

bartowski/L3-8B-Stheno-v3.2-GGUF

63,235 78
Calculate
bartowski GGUF Ready

Llama-3.3-70B-Instruct

bartowski/Llama-3.3-70B-Instruct-GGUF

60,444 77
Calculate
bartowski GGUF Ready

SmolLM2-135M-Instruct

bartowski/SmolLM2-135M-Instruct-GGUF

58,815 18
Calculate
ggml-org GGUF Ready

stories15M_MOE

ggml-org/stories15M_MOE

58,436 8
Calculate
MaziyarPanahi GGUF Ready

Meta-Llama-3-8B-Instruct

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

57,664 103
Calculate
bartowski GGUF Ready

gemma-2-2b-it

bartowski/gemma-2-2b-it-GGUF

56,282 103
Calculate
bartowski GGUF Ready

Ling-3.0-tiny

bartowski/Ling-3.0-tiny-GGUF

53,504 54
Calculate
bartowski GGUF Ready

DeepSeek-Coder-V2-Lite-Instruct

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

52,138 201
Calculate
MaziyarPanahi GGUF Ready

gemma-3-4b-it

MaziyarPanahi/gemma-3-4b-it-GGUF

51,926 20
Calculate
bartowski GGUF Ready

c4ai-command-r7b-12-2024

bartowski/c4ai-command-r7b-12-2024-GGUF

51,711 16
Calculate
bartowski GGUF Ready

Qwen_Qwen3-1.7B

bartowski/Qwen_Qwen3-1.7B-GGUF

51,300 24
Calculate
bartowski GGUF Ready

TheDrummer_Cydonia-24B-v4.3

bartowski/TheDrummer_Cydonia-24B-v4.3-GGUF

49,399 84
Calculate
LiquidAI GGUF Ready

LFM2.5-2.6B-DSpark

LiquidAI/LFM2.5-2.6B-DSpark-GGUF

48,998 59
Calculate
bartowski GGUF Ready

Qwen2.5-72B-Instruct

bartowski/Qwen2.5-72B-Instruct-GGUF

48,636 48
Calculate
MaziyarPanahi GGUF Ready

Mistral-7B-Instruct-v0.3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

47,799 147
Calculate
MaziyarPanahi GGUF Ready

Phi-3.5-mini-instruct

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

47,060 34
Calculate
MaziyarPanahi GGUF Ready

Mixtral-8x22B-v0.1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

46,776 78
Calculate
TheBloke GGUF Ready

Mistral-7B-Instruct-v0.2

TheBloke/Mistral-7B-Instruct-v0.2-GGUF

46,420 523
Calculate
Qwen GGUF Ready

Qwen2.5-Coder-32B-Instruct

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

46,309 237
Calculate
MaziyarPanahi GGUF Ready

sqlcoder-7b-2

MaziyarPanahi/sqlcoder-7b-2-GGUF

46,167 14
Calculate
unsloth GGUF Ready

GLM-4.5-Air

unsloth/GLM-4.5-Air-GGUF

45,058 190
Calculate
unsloth GGUF Ready

DeepSeek-R1-Distill-Llama-8B

unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF

44,767 313
Calculate
MaziyarPanahi GGUF Ready

solar-pro-preview-instruct

MaziyarPanahi/solar-pro-preview-instruct-GGUF

43,852 29
Calculate
MaziyarPanahi GGUF Ready

Llama-3-8B-Instruct-32k-v0.1

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

43,306 59
Calculate
ibm-granite GGUF Ready

granite-4.1-8b-fp8

ibm-granite/granite-4.1-8b-fp8

41,702 14
Calculate
MaziyarPanahi GGUF Ready

Mistral-Nemo-Instruct-2407

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

41,636 55
Calculate
MaziyarPanahi GGUF Ready

Qwen2-7B-Instruct

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

40,630 10
Calculate
MaziyarPanahi GGUF Ready

Mistral-Small-Instruct-2409

MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF

40,322 4
Calculate
MaziyarPanahi GGUF Ready

Yi-Coder-9B-Chat

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

40,205 10
Calculate
unsloth GGUF Ready

DeepSeek-R1-Distill-Llama-70B

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

40,188 124
Calculate
unsloth GGUF Ready

Nemotron-3-Nano-30B-A3B

unsloth/Nemotron-3-Nano-30B-A3B-GGUF

40,114 334
Calculate
MaziyarPanahi GGUF Ready

Mistral-Small-24B-Instruct-2501

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

40,019 12
Calculate
MaziyarPanahi GGUF Ready

Yi-Coder-1.5B-Chat

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

39,963 20
Calculate
MaziyarPanahi GGUF Ready

Ministral-3-3B-Reasoning-2512

MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF

39,525 6
Calculate
MaziyarPanahi GGUF Ready

WizardLM-2-7B

MaziyarPanahi/WizardLM-2-7B-GGUF

39,218 83
Calculate
MaziyarPanahi GGUF Ready

phi-4

MaziyarPanahi/phi-4-GGUF

39,021 10
Calculate
MaziyarPanahi GGUF Ready

firefunction-v2

MaziyarPanahi/firefunction-v2-GGUF

38,818 19
Calculate
MaziyarPanahi GGUF Ready

mistral-small-3.1-24b-instruct-2503-hf

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

38,726 2
Calculate
MaziyarPanahi GGUF Ready

gemma-3-12b-it

MaziyarPanahi/gemma-3-12b-it-GGUF

38,549 19
Calculate
MaziyarPanahi GGUF Ready

Yi-1.5-6B-Chat

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

38,530 9
Calculate
MaziyarPanahi GGUF Ready

Llama-3-8B-Instruct-64k

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

38,529 14
Calculate
bartowski GGUF Ready

HuggingFaceTB_SmolLM3-3B

bartowski/HuggingFaceTB_SmolLM3-3B-GGUF

38,152 12
Calculate
MaziyarPanahi GGUF Ready

Meta-Llama-3.1-70B-Instruct

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

38,138 41
Calculate
MaziyarPanahi GGUF Ready

mathstral-7B-v0.1

MaziyarPanahi/mathstral-7B-v0.1-GGUF

38,092 8
Calculate
bartowski GGUF Ready

Qwen_Qwen3-Coder-Next

bartowski/Qwen_Qwen3-Coder-Next-GGUF

37,559 30
Calculate
bartowski GGUF Ready

Qwen_Qwen3-8B

bartowski/Qwen_Qwen3-8B-GGUF

36,988 41
Calculate
bartowski GGUF Ready

Altworld_Hemmingway-1

bartowski/Altworld_Hemmingway-1-GGUF

36,756 58
Calculate
MaziyarPanahi GGUF Ready

gemma-3-27b-it

MaziyarPanahi/gemma-3-27b-it-GGUF

36,307 8
Calculate
MaziyarPanahi GGUF Ready

Mistral-Large-Instruct-2411

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

36,278 2
Calculate
MaziyarPanahi GGUF Ready

QwQ-32B

MaziyarPanahi/QwQ-32B-GGUF

36,222 4
Calculate
MaziyarPanahi GGUF Ready

INTELLECT-2

MaziyarPanahi/INTELLECT-2-GGUF

35,891 3
Calculate
MaziyarPanahi GGUF Ready

DeepSeek-V3-0324

MaziyarPanahi/DeepSeek-V3-0324-GGUF

35,879 23
Calculate
MaziyarPanahi GGUF Ready

Meta-Llama-3.1-405B-Instruct

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

35,790 15
Calculate
TheBloke GGUF Ready

Mistral-7B-Instruct-v0.1

TheBloke/Mistral-7B-Instruct-v0.1-GGUF

35,690 615
Calculate
unsloth GGUF Ready

Qwen3-Next-80B-A3B-Thinking

unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF

34,054 85
Calculate
unsloth GGUF Ready

DeepSeek-R1

unsloth/DeepSeek-R1-GGUF

33,372 1125
Calculate
Qwen GGUF Ready

Qwen2.5-Coder-0.5B-Instruct

Qwen/Qwen2.5-Coder-0.5B-Instruct-GGUF

33,179 40
Calculate
bartowski GGUF Ready

Dolphin3.0-Llama3.1-8B

bartowski/Dolphin3.0-Llama3.1-8B-GGUF

32,385 34
Calculate
bartowski GGUF Ready

cognitivecomputations_Dolphin-Mistral-24B-Venice-Edition

bartowski/cognitivecomputations_Dolphin-Mistral-24B-Venice-Edition-GGUF

30,095 173
Calculate
NousResearch GGUF Ready

Hermes-4.3-36B

NousResearch/Hermes-4.3-36B-GGUF

29,042 96
Calculate
bartowski GGUF Ready

cognitivecomputations_Dolphin3.0-Mistral-24B

bartowski/cognitivecomputations_Dolphin3.0-Mistral-24B-GGUF

28,772 25
Calculate
bartowski GGUF Ready

TheDrummer_Magidonia-24B-v4.3

bartowski/TheDrummer_Magidonia-24B-v4.3-GGUF

28,433 16
Calculate
bartowski GGUF Ready

gemma-2-9b-it

bartowski/gemma-2-9b-it-GGUF

27,444 236
Calculate
bartowski GGUF Ready

zai-org_GLM-4.7-Flash

bartowski/zai-org_GLM-4.7-Flash-GGUF

27,186 58
Calculate
MaziyarPanahi GGUF Ready

Qwen3-30B-A3B-Instruct-2507

MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF

26,936 4
Calculate
bartowski GGUF Ready

Qwen_Qwen3-14B

bartowski/Qwen_Qwen3-14B-GGUF

26,435 44
Calculate
bartowski GGUF Ready

Ateron_Gemma-4-Novelist-Eclipse-31B

bartowski/Ateron_Gemma-4-Novelist-Eclipse-31B-GGUF

26,060 11
Calculate
bartowski GGUF Ready

Qwen2.5-Math-1.5B-Instruct

bartowski/Qwen2.5-Math-1.5B-Instruct-GGUF

25,675 4
Calculate
bartowski GGUF Ready

LiquidAI_LFM2.5-1.2B-Instruct

bartowski/LiquidAI_LFM2.5-1.2B-Instruct-GGUF

25,200 6
Calculate
microsoft GGUF Ready

Phi-3-mini-4k-instruct

microsoft/Phi-3-mini-4k-instruct-gguf

25,143 624
Calculate
bartowski GGUF Ready

mistralai_Devstral-Small-2-24B-Instruct-2512

bartowski/mistralai_Devstral-Small-2-24B-Instruct-2512-GGUF

24,075 56
Calculate
bartowski GGUF Ready

nvidia_NVIDIA-Nemotron-Nano-9B-v2

bartowski/nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUF

23,935 37
Calculate
microsoft GGUF Ready

bitnet-b1.58-2B-4T

microsoft/bitnet-b1.58-2B-4T-gguf

23,586 304
Calculate
google GGUF Ready

gemma-7b-it

google/gemma-7b-it

23,503 1261
Calculate
unsloth GGUF Ready

GLM-4.7-Flash-REAP-23B-A3B

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

23,413 285
Calculate
bartowski GGUF Ready

deepseek-ai_DeepSeek-R1-0528

bartowski/deepseek-ai_DeepSeek-R1-0528-GGUF

23,241 11
Calculate
TheBloke GGUF Ready

CodeLlama-7B-Instruct

TheBloke/CodeLlama-7B-Instruct-GGUF

23,022 152
Calculate
bartowski GGUF Ready

SmolLM2-360M-Instruct

bartowski/SmolLM2-360M-Instruct-GGUF

22,272 6
Calculate
bartowski GGUF Ready

NemoMix-Unleashed-12B

bartowski/NemoMix-Unleashed-12B-GGUF

22,091 135
Calculate
MaziyarPanahi GGUF Ready

gpt-oss-20b-Derestricted

MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF

21,934 4
Calculate
TheBloke GGUF Ready

Llama-2-7B

TheBloke/Llama-2-7B-GGUF

21,902 207
Calculate
MaziyarPanahi GGUF Ready

GLM-4.6V-Flash

MaziyarPanahi/GLM-4.6V-Flash-GGUF

21,782 7
Calculate
bartowski GGUF Ready

Qwen2.5-Math-7B-Instruct

bartowski/Qwen2.5-Math-7B-Instruct-GGUF

21,121 16
Calculate
MaziyarPanahi GGUF Ready

Nemotron-Orchestrator-8B

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

19,814 6
Calculate
MaziyarPanahi GGUF Ready

Trinity-Mini

MaziyarPanahi/Trinity-Mini-GGUF

19,752 1
Calculate
bartowski GGUF Ready

dolphin-2.9-llama3-8b

bartowski/dolphin-2.9-llama3-8b-GGUF

19,675 19
Calculate
MaziyarPanahi GGUF Ready

Ministral-3-14B-Reasoning-2512

MaziyarPanahi/Ministral-3-14B-Reasoning-2512-GGUF

19,621 1
Calculate
MaziyarPanahi GGUF Ready

NVIDIA-Nemotron-Nano-12B-v2

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

19,552 4
Calculate
MaziyarPanahi GGUF Ready

Qwen3-4B-Thinking-2507

MaziyarPanahi/Qwen3-4B-Thinking-2507-GGUF

19,401 2
Calculate
bartowski GGUF Ready

moonshotai_Kimi-Linear-48B-A3B-Instruct

bartowski/moonshotai_Kimi-Linear-48B-A3B-Instruct-GGUF

19,322 30
Calculate
bartowski GGUF Ready

Qwen_Qwen3-Next-80B-A3B-Instruct

bartowski/Qwen_Qwen3-Next-80B-A3B-Instruct-GGUF

18,761 22
Calculate
bartowski GGUF Ready

Hermes-3-Llama-3.2-3B

bartowski/Hermes-3-Llama-3.2-3B-GGUF

18,583 16
Calculate
bartowski GGUF Ready

RecursiveSI_flint

bartowski/RecursiveSI_flint-GGUF

17,955 7
Calculate
bartowski GGUF Ready

Qwen_Qwen3-30B-A3B

bartowski/Qwen_Qwen3-30B-A3B-GGUF

17,765 60
Calculate
bartowski GGUF Ready

magnum-v4-12b

bartowski/magnum-v4-12b-GGUF

17,037 12
Calculate
unsloth GGUF Ready

GLM-4.7

unsloth/GLM-4.7-GGUF

17,015 225
Calculate
LiquidAI GGUF Ready

LFM2-2.6B

LiquidAI/LFM2-2.6B-GGUF

16,911 63
Calculate
bartowski GGUF Ready

Spark-X2.6-4B

bartowski/Spark-X2.6-4B-GGUF

16,614 15
Calculate
bartowski GGUF Ready

Nanbeige_Nanbeige4.2-3B

bartowski/Nanbeige_Nanbeige4.2-3B-GGUF

16,526 43
Calculate
TheBloke GGUF Ready

Mistral-7B-OpenOrca

TheBloke/Mistral-7B-OpenOrca-GGUF

16,495 242
Calculate
bartowski GGUF Ready

google_gemma-3-1b-it

bartowski/google_gemma-3-1b-it-GGUF

16,291 19
Calculate

More models we cover

Established GGUF releases that are no longer in the live top list but still have a full requirements page.

Frequently asked questions about local models

What is the GGUF model format?

GGUF (GPT-Generated Unified Format) is the standard format used by llama.cpp, Ollama, LM Studio, and Jan to run large language models on consumer hardware. It stores weights and quantization metadata in a single, fast-loading binary file.

How do I know which model fits on my computer?

Select any model above to open our interactive calculator. It reads the model's exact weight sizes and calculates required memory for KV cache and system overhead across various context windows (4K, 8K, 32K+).

Can't find the model you need?

You can search for any GGUF repository directly on the homepage search bar, or browse models categorized by graphics card.