🔮Unsloth-Modellkatalog

Unsloth-LLMs-Verzeichnis für alle Unsloth Dynamisch GGUF-, 4-Bit- und NVFP4-Modelle auf Hugging Face.

QwenGemmaDeepSeekLlamaMistralGLM

GGUFs ermöglichen es Ihnen, Modelle in Tools wie Unsloth Desktop✨ und llama.cpp. Verwenden Sie Instruct (4-Bit) safetensors für Inferenz oder Feinabstimmung über Unsloth.

Neue & empfohlene Modelle:

Modell	Variante	GGUF	4-Bit
Qwen3.8 (neu)	27B	Link	NVFP4
	2.4T-A95B	Link
Muse Glimmer (neu)	30B	Link	Link
DeepSeek-V4 (neu)	V4-Pro-0813	Link
	Flash-0731	Link	Link
NVIDIA Nemotron-3.5 (neu)	30B Lightning	Link
Kimi	K3	Link	Link
Qwen3.6	27B	Link • MTP	NVFP4
	35B-A3B	Link • MTP	NVFP4
Gemma 4	QAT	Link	Link
	12B	Link	NVFP4
	26B-A4B	Link	NVFP4
	31B	Link	Link • NVFP4
	E4B	Link	Link • NVFP4
	E2B	Link	Link • NVFP4
DiffusionGemma	26B-A4B	Link	—
Kimi	K2.7-Code	Link	—
	K2.6	Link	—
NVIDIA Nemotron 3	Nano-Omni-30B-A3B	Link	—
Qwen3.5	35B-A3B	Link	—
	27B	Link	—
	122B-A10B	Link	—
	0.8B	Link	—
	2B	Link	—
	4B	Link	—
	9B	Link	—
	397B-A17B	Link	—
Qwen3	Coder-Next	Link	—
NVIDIA Nemotron 3	Super-120B-A12B	Link	Link
	Nano-4B	Link	—
GLM	4.7-Flash	Link	—
	5	Link	—
Kimi	K2.5	Link	—
gpt-oss	120B	Link	Link
	20B	Link	Link
MiniMax	M2.5	Link	—
NVIDIA Nemotron 3	30B	Link	—
Qwen-Image	2512	Link	—
	Edit-2511	Link	—
Ministral 3	3B	Instruct • Reasoning	Instruct • Reasoning
	8B	Instruct • Reasoning	Instruct • Reasoning
	14B	Instruct • Reasoning	Instruct • Reasoning
Devstral 2	24B	Link	—
	123B	Link	—
Mistral Large 3	675B	Link	Link
Qwen3-Next	80B-A3B-Instruct	Link	Link
	80B-A3B-Thinking	Link	—
Qwen3-VL	2B-Instruct	Link	Link
	2B-Thinking	Link	Link
	4B-Instruct	Link	Link
	4B-Thinking	Link	Link
	8B-Instruct	Link	Link
	8B-Thinking	Link	Link
	30B-A3B-Instruct	Link	—
	30B-A3B-Thinking	Link	—
	32B-Instruct	Link	Link
	32B-Thinking	Link	Link
	235B-A22B-Instruct	Link	—
	235B-A22B-Thinking	Link	—
Qwen3-2507	30B-A3B-Instruct	Link	—
	30B-A3B-Thinking	Link	—
	235B-A22B-Instruct	Link	—
Qwen3-Coder	30B-A3B	Link	—
GLM	4.7	Link	—
	4.6V-Flash	Link	—
DeepSeek-V3.1	Terminus	Link	—
	V3.1	Link	—

DeepSeek-Modelle:

Modell	Variante	GGUF	Instruct (4-Bit)
DeepSeek-V3.1	Terminus	Link
	V3.1	Link
DeepSeek-V3	V3-0324	Link	—
	V3	Link	—
DeepSeek-R1	R1-0528	Link	—
	R1-0528-Qwen3-8B	Link	Link
	R1	Link	—
	R1 Zero	Link	—
	Distill Llama 3 8 B	Link	Link
	Distill Llama 3.3 70 B	Link	Link
	Distill Qwen 2.5 1.5 B	Link	Link
	Distill Qwen 2.5 7 B	Link	Link
	Distill Qwen 2.5 14 B	Link	Link
	Distill Qwen 2.5 32 B	Link	Link

Llama-Modelle:

Modell	Variante	GGUF	4-Bit
Muse Glimmer	30B	Link	Link
Llama 4	Scout 17 B-16 E	Link	Link
	Maverick 17 B-128 E	Link	—
Llama 3.3	70 B	Link	Link
Llama 3.2	1 B	Link	Link
	3 B	Link	Link
	11 B Vision	—	Link
	90 B Vision	—	Link
Llama 3.1	8 B	Link	Link
	70 B	—	Link
	405 B	—	Link
Llama 3	8 B	—	Link
	70 B	—	Link
Llama 2	7 B	—	Link
	13 B	—	Link
CodeLlama	7 B	—	Link
	13 B	—	Link
	34 B	—	Link

Gemma-Modelle:

Modell	Variante	GGUF	Instruct (4-Bit)
Gemma 4	E2B	Link	Link
	E4B	Link	Link
	26B-A4B	Link	—
	31B	Link	Link
FunctionGemma	270M	Link	—
Gemma 3n	E2B	Link	Link
	E4B	Link	Link
Gemma 3	270M	Link	Link
	1 B	Link	Link
	4 B	Link	Link
	12 B	Link	Link
	27 B	Link	Link
MedGemma	4 B (Vision)	Link	Link
	27 B (Vision)	Link	Link
Gemma 2	2 B	Link	Link
	9 B	—	Link
	27 B	—	Link

Qwen-Modelle:

Modell	Variante	GGUF	Instruct (4-Bit)
Qwen3.8 (neu)	27B	Link	NVFP4
	2.4T-A95B	Link
Qwen3.6	27B	Link	—
	35B-A3B	Link	—
Qwen3.5	35B-A3B	Link	—
	27B	Link	—
	122B-A10B	Link	—
	0.8B	Link	—
	2B	Link	—
	4B	Link	—
	9B	Link	—
	397B-A17B	Link	—
Qwen3	Coder-Next	Link	—
Qwen-Image	2512	Link	—
	Edit-2511	Link	—
Qwen3-VL	2B-Instruct	Link	Link
	2B-Thinking	Link	Link
	4B-Instruct	Link	Link
	4B-Thinking	Link	Link
	8B-Instruct	Link	Link
	8B-Thinking	Link	Link
Qwen3-Coder	30B-A3B	Link	—
	480B-A35B	Link	—
Qwen3-2507	30B-A3B-Instruct	Link	—
	30B-A3B-Thinking	Link	—
	235B-A22B-Thinking	Link	—
	235B-A22B-Instruct	Link	—
Qwen 3	0.6 B	Link	Link
	1.7 B	Link	Link
	4 B	Link	Link
	8 B	Link	Link
	14 B	Link	Link
	30 B-A3B	Link	Link
	32 B	Link	Link
	235 B-A22B	Link	—
Qwen 2.5 Omni	3 B	Link	—
	7 B	Link	—
Qwen 2.5 VL	3 B	Link	Link
	7 B	Link	Link
	32 B	Link	Link
	72 B	Link	Link
Qwen 2.5	0.5 B	—	Link
	1.5 B	—	Link
	3 B	—	Link
	7 B	—	Link
	14 B	—	Link
	32 B	—	Link
	72 B	—	Link
Qwen 2.5 Coder (128 K)	0.5 B	Link	Link
	1.5 B	Link	Link
	3 B	Link	Link
	7 B	Link	Link
	14 B	Link	Link
	32 B	Link	Link
QwQ	32 B	Link	Link
QVQ (Vorschau)	72 B	—	Link
Qwen 2 (Chat)	1.5 B	—	Link
	7 B	—	Link
	72 B	—	Link
Qwen 2 VL	2 B	—	Link
	7 B	—	Link
	72 B	—	Link

GLM-Modelle:

Modell	Variante	GGUF	Instruct (4-Bit)
GLM	4.7-Flash	Link	—
	5	Link	—
	4.6V-Flash	Link	—
	4.6	Link	—
	4.5-Air	Link	—

Mistral-Modelle:

Modell	Variante	GGUF	Instruct (4-Bit)
Magistral	Klein (2506)	Link	Link
	Klein (2509)	Link	Link
	Klein (2507)	Link	Link
Mistral Small	3.2-24 B (2506)	Link	Link
	3.1-24 B (2503)	Link	Link
	3-24 B (2501)	Link	Link
	2409-22 B	—	Link
Devstral	Small-24 B (2507)	Link	Link
	Small-24 B (2505)	Link	Link
Pixtral	12 B (2409)	—	Link
Mistral NeMo	12 B (2407)	Link	Link
Mistral Large	2407	—	Link
Mistral 7 B	v0.3	—	Link
	v0.2	—	Link
Mixtral	8 × 7 B	—	Link

Phi-Modelle:

Modell	Variante	GGUF	Instruct (4-Bit)
Phi-4	Reasoning-plus	Link	Link
	Reasoning	Link	Link
	Mini-Reasoning	Link	Link
	Phi-4 (Instruct)	Link	Link
	mini (Instruct)	Link	Link
Phi-3.5	mini	—	Link
Phi-3	mini	—	Link
	mittel	—	Link

Andere Modelle (GLM, Orpheus, Smol, Llava usw.):

Modell	Variante	GGUF	Instruct (4-Bit)
GLM	4.5-Air	Link	—
	4.5	4.5	—
	4-32B-0414	4-32B-0414	—
Grok 2	270B	Link	—
Baidu-ERNIE	4.5-21B-A3B-Thinking	Link	—
Hunyuan	A13B	Link	—
Orpheus	0.1-ft (3B)	Link	Link
LLava	1.5 (7 B)	—	Link
	1.6 Mistral (7 B)	—	Link
TinyLlama	Chat	—	Link
SmolLM 2	135 M	Link	Link
	360 M	Link	Link
	1.7 B	Link	Link
Zephyr-SFT	7 B	—	Link
Yi	6 B (v1.5)	—	Link
	6 B (v1.0)	—	Link
	34 B (Chat)	—	Link
	34 B (Basis)	—	Link