> For the complete documentation index, see [llms.txt](https://unsloth.ai/docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://unsloth.ai/docs/docs.md).

# Unsloth Docs

Unsloth lets you run and train AI models on your own local hardware via an open-source UI.

Our docs will guide you through running & training your own LLM locally.

<a href="https://unsloth.ai/download" class="button primary" data-icon="down-to-bracket">Download</a><a href="/pages/0M3SoK9xrgfNCqWbWpMu#features" class="button secondary" data-icon="sparkles">Features</a><a href="https://github.com/unslothai/unsloth" class="button secondary" data-icon="github">GitHub</a>

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-cover data-type="image">Cover image</th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>Qwen3.8-Flash-Next</strong></td><td>New multimodal MoE model with Qwen4 arch.</td><td><a href="/files/2cyEI2777q7PdMsiBlV0">/files/2cyEI2777q7PdMsiBlV0</a></td><td><a href="/pages/Ef8lrnBt1lmETOqIFCHj">/pages/Ef8lrnBt1lmETOqIFCHj</a></td></tr><tr><td><strong>GLM-5.3-Flash</strong></td><td>The new 320B model aka <code>ox-alpha</code> by Z.ai.</td><td><a href="/files/nCrmh8PBO6NvIPyEWwk0">/files/nCrmh8PBO6NvIPyEWwk0</a></td><td><a href="/pages/0rzkFBbEB4pMiyscrTYW">/pages/0rzkFBbEB4pMiyscrTYW</a></td></tr><tr><td><strong>Meet Unsloth Desktop</strong></td><td>The first desktop app to run and train models.</td><td><a href="/files/XZEkfMzpyz0aroG4AkM9">/files/XZEkfMzpyz0aroG4AkM9</a></td><td><a href="/pages/0M3SoK9xrgfNCqWbWpMu">/pages/0M3SoK9xrgfNCqWbWpMu</a></td></tr></tbody></table>

<table data-view="cards" data-full-width="false"><thead><tr><th></th><th></th><th data-hidden data-card-cover data-type="image">Cover image</th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>Qwen3.8-27B is here!</strong></td><td>Run and train Qwen3.8-27B in Unsloth.</td><td><a href="/files/T7cO71XRMo56f8iAJlTI">/files/T7cO71XRMo56f8iAJlTI</a></td><td><a href="/pages/0rzkFBbEB4pMiyscrTYW">/pages/0rzkFBbEB4pMiyscrTYW</a></td></tr><tr><td><strong>Meta Muse Glimmer</strong></td><td>Meta's new 30B open model.</td><td><a href="/files/6Mfar7OZnC0seQ85ClWM">/files/6Mfar7OZnC0seQ85ClWM</a></td><td><a href="/pages/1hXO5DDKxmP1zKUUnBnA">/pages/1hXO5DDKxmP1zKUUnBnA</a></td></tr><tr><td><strong>DeepSeek-V4-Flash-0731</strong></td><td>The new 284B model released on July 31.</td><td><a href="/files/vWDCobEuT1Be0ZMswwnt">/files/vWDCobEuT1Be0ZMswwnt</a></td><td><a href="/pages/2f4eyCpdyRknNuEtv22n">/pages/2f4eyCpdyRknNuEtv22n</a></td></tr></tbody></table>

### ⚡ Quickstart

Unsloth supports MacOS, Linux, [Windows](/docs/get-started/install/windows-installation.md), [NVIDIA](/docs/get-started/install/pip-install.md), [AMD](/docs/get-started/install/amd.md), Intel and CPU setups. See: [Unsloth Requirements](/docs/get-started/fine-tuning-for-beginners/unsloth-requirements.md). Download the native desktop app for your operating system:

<a href="https://unsloth.ai/download" class="button primary" data-icon="down-to-bracket">Download Unsloth Desktop</a>

* <i class="fa-apple">:apple:</i> [Download for macOS](https://unsloth.ai/download/mac)
* <i class="fa-windows">:windows:</i> [Download for Windows](https://unsloth.ai/download/windows)
* <i class="fa-linux">:linux:</i> [Download for Linux](https://unsloth.ai/download/linux)

Or, if you prefer manual installation:

**MacOS, Linux, WSL:**

```bash
curl -fsSL https://unsloth.ai/install.sh | sh
```

**Windows PowerShell:**

```bash
irm https://unsloth.ai/install.ps1 | iex
```

{% columns %}
{% column width="50%" %}
{% content-ref url="/pages/BAeSP6aOxvSeDUzCgKOK" %}
[Complete LLM Directory](/docs/models/tutorials.md)
{% endcontent-ref %}

{% content-ref url="/pages/nw2c1elNySGBBav8WP9B" %}
[Fine-tuning Guide](/docs/get-started/fine-tuning-llms-guide.md)
{% endcontent-ref %}
{% endcolumn %}

{% column width="50%" %}
{% content-ref url="/pages/nQlzs5BcvqlaEjhsgbtY" %}
[Models](/docs/get-started/unsloth-model-catalog.md)
{% endcontent-ref %}

{% content-ref url="/pages/7sCtc6YWnJBYthTjQsr7" %}
[Unsloth API](/docs/basics/api.md)
{% endcontent-ref %}
{% endcolumn %}
{% endcolumns %}

### 👾 Unsloth Start

{% columns %}
{% column width="58.333333333333336%" %}
[Unsloth Start](/docs/integrations/unsloth-start.md) lets you connect [Claude Code](/docs/basics/claude-code.md), [Codex](/docs/basics/codex.md) and other agents to local models via the `unsloth start` command.

Start Unsloth, load a model, open your project folder, and then run:

```bash
unsloth start claude
```

Replace `claude` with any agent below:
{% endcolumn %}

{% column width="41.666666666666664%" %}

<figure><img src="/files/HrMdgp7HDGelphJEpwCG" alt="" width="563"><figcaption><p>Claude Code running with Qwen3.5 locally.</p></figcaption></figure>
{% endcolumn %}
{% endcolumns %}

| Agent                                                              | Command                  |
| ------------------------------------------------------------------ | ------------------------ |
| <i class="fa-claude">:claude:</i> Claude Code                      | `unsloth start claude`   |
| <i class="fa-openai">:openai:</i> OpenAI Codex                     | `unsloth start codex`    |
| <i class="fa-caduceus">:caduceus:</i> Hermes Agent                 | `unsloth start hermes`   |
| <i class="fa-lobster">:lobster:</i> OpenClaw                       | `unsloth start openclaw` |
| <i class="fa-rectangle-vertical">:rectangle-vertical:</i> OpenCode | `unsloth start opencode` |

### 🦥 Why Unsloth?

* We directly collab with teams behind [gpt-oss](https://docs.unsloth.ai/new/gpt-oss-how-to-run-and-fine-tune#unsloth-fixes-for-gpt-oss), [Qwen3](https://www.reddit.com/r/LocalLLaMA/comments/1kaodxu/qwen3_unsloth_dynamic_ggufs_128k_context_bug_fixes/), [Llama 4](https://github.com/ggml-org/llama.cpp/pull/12889), [Mistral](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B/discussions/18), [Gemma 1-3](https://news.ycombinator.com/item?id=39671146) and [Phi-4](https://unsloth.ai/blog/phi4), where we’ve **fixed critical bugs** that greatly improved model accuracy. Andrej Karpathy for example has [praised our work](https://x.com/karpathy/status/1765473722985771335).
* Unsloth streamlines local training, inference, data, and deployment
* Unsloth supports inference and training for 500+ models: [vision](/docs/basics/vision-fine-tuning.md), [TTS](/docs/basics/text-to-speech-tts-fine-tuning.md), [embedding](/docs/basics/embedding-finetuning.md), [RL](/docs/get-started/reinforcement-learning-rl-guide.md)

### ⭐ Features

Unsloth lets you run and train models for text, [audio](https://unsloth.ai/docs/basics/text-to-speech-tts-fine-tuning), [embedding](https://unsloth.ai/docs/new/embedding-finetuning), [vision](https://unsloth.ai/docs/basics/vision-fine-tuning) and more. Unsloth provides many key features for both inference and training:

#### Inference

* Run and train LLMs, diffusion, embedding, audio models: [Qwen3.8](/docs/models/qwen3.8.md), [Kimi K3](https://unsloth.ai/docs/models/kimi-k3), MiniMax-H3, [Muse Glimmer](https://unsloth.ai/docs/models/muse-glimmer), [DeepSeek-V4](https://unsloth.ai/docs/models/deepseek-v4), [Gemma 4](https://unsloth.ai/docs/models/gemma-4).
* **Agents & Tools:** Use local models with [Claude Code](https://unsloth.ai/docs/basics/claude-code), [Codex](https://unsloth.ai/docs/basics/codex), and [MCP](https://unsloth.ai/docs/basics/mcp), including tool calling and code execution.
* **Search & RAG:** Use private and unlimited web search, deep research, auto-compaction (rolling context window) and RAG.
* **Image and video:** Run and train [image](https://unsloth.ai/docs/basics/diffusion-image) and video diffusion or multimodal models
* **Remote & LAN:** Access your local models from any device on [LAN](https://unsloth.ai/docs/basics/lan) or remotely through secure [Cloudflare](https://unsloth.ai/docs/basics/how-to-serve-local-llms-anywhere-secure-remote-access-with-cloudflare-and-unsloth) HTTPS.
* **Connect:** Serve models through an [OpenAI compatible API](https://unsloth.ai/docs/basics/api). Also connect your ChatGPT/Codex subscription and [cloud providers](https://unsloth.ai/docs/integrations/connections)

#### Train & Deploy

* **Fine-tuning:** Train LLMs, diffusion, TTS, and embedding models 2× faster with 70% less VRAM with [no accuracy loss](https://unsloth.ai/blog#training)
* **Complete support:** Supports [reinforcement learning](https://unsloth.ai/docs/get-started/reinforcement-learning-rl-guide), LoRA, QLoRA, full fine tuning, pretraining, RL, GRPO, DPO, and FP8.
* **Export & Deploy:** [Export](https://unsloth.ai/docs/new/studio/export) or Deploy models with including [GGUF](https://unsloth.ai/docs/basics/inference-and-deployment/saving-to-gguf), NVFP4, FP8 and more formats.
* **Datasets:** Build datasets from PDFs, CSVs, DOCX files, and more with [Data Recipes](https://unsloth.ai/docs/new/studio/data-recipe).

### **Latest models**

<table data-column-title-hidden data-card-wrap="false" data-view="cards"><thead><tr><th></th><th data-hidden data-card-cover data-type="image">Cover image</th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><h4>Qwen3.8</h4></td><td><a href="/files/T7cO71XRMo56f8iAJlTI">/files/T7cO71XRMo56f8iAJlTI</a></td><td><a href="/pages/CLyZKmpoJZpdaJXhLW4v">/pages/CLyZKmpoJZpdaJXhLW4v</a></td></tr><tr><td><h4>Meta Muse Glimmer</h4></td><td><a href="/files/6Mfar7OZnC0seQ85ClWM">/files/6Mfar7OZnC0seQ85ClWM</a></td><td></td></tr><tr><td><h4>Kimi K3</h4></td><td><a href="/files/TmfHDmv3BQb1Nfu0j133">/files/TmfHDmv3BQb1Nfu0j133</a></td><td><a href="/pages/WXhlrui6wK2vphF835XS">/pages/WXhlrui6wK2vphF835XS</a></td></tr><tr><td><h4>DeepSeek V4</h4></td><td><a href="/files/85y4U7RWZAZ0QTmgRGvX">/files/85y4U7RWZAZ0QTmgRGvX</a></td><td><a href="/pages/2f4eyCpdyRknNuEtv22n">/pages/2f4eyCpdyRknNuEtv22n</a></td></tr><tr><td><h4>Qwen3.6</h4></td><td><a href="/files/9q8wsfzbD8FrBu5tMwyp">/files/9q8wsfzbD8FrBu5tMwyp</a></td><td><a href="/pages/NpuhjPsxi8BKhuS8nnyY">/pages/NpuhjPsxi8BKhuS8nnyY</a></td></tr><tr><td><h4>GLM-5.2</h4></td><td><a href="/files/INMF5VptPzi2sTVbB02o">/files/INMF5VptPzi2sTVbB02o</a></td><td><a href="/pages/cZiZ00cwk1GGz1O1TOHo">/pages/cZiZ00cwk1GGz1O1TOHo</a></td></tr><tr><td><h4>Gemma 4</h4></td><td><a href="/files/Hi2ZAIfyCNvFganYz8Dk">/files/Hi2ZAIfyCNvFganYz8Dk</a></td><td><a href="/pages/VnmWq1kNppQrTqCI6aLH">/pages/VnmWq1kNppQrTqCI6aLH</a></td></tr><tr><td><h4>MiniMax M3</h4></td><td><a href="/files/RdQBx7sOTMt9KSvTW1BB">/files/RdQBx7sOTMt9KSvTW1BB</a></td><td><a href="/pages/hDMe4SBsxYeSiKWmNuP7">/pages/hDMe4SBsxYeSiKWmNuP7</a></td></tr><tr><td><h4>DiffusionGemma</h4></td><td><a href="/files/Te5bV0YXetWmaOCpjMDw">/files/Te5bV0YXetWmaOCpjMDw</a></td><td><a href="/pages/vTAENqjMpaMcreC9lp4b">/pages/vTAENqjMpaMcreC9lp4b</a></td></tr></tbody></table>

### **Video Demo**

{% embed url="<https://www.youtube.com/watch?v=_1hgTTuber4>" %}

{% columns %}
{% column width="50%" %}
{% content-ref url="/pages/OktH76Rsg2WQ12B4KR5H" %}
[Unsloth Updates](/docs/new/changelog.md)
{% endcontent-ref %}

{% content-ref url="/pages/gEugERiAw2ztDNt98JVR" %}
[Inference & Deployment](/docs/basics/inference-and-deployment.md)
{% endcontent-ref %}
{% endcolumn %}

{% column width="50%" %}
{% content-ref url="/pages/55c8159250801d9ea2207b9eb88a9a11b331d3ad" %}
[Unsloth Start](/docs/integrations/unsloth-start.md)
{% endcontent-ref %}

{% content-ref url="/pages/QznsvWxKKvrY6PdiByzz" %}
[Dynamic 3.0 GGUFs](/docs/basics/dynamic-3.0-ggufs.md)
{% endcontent-ref %}
{% endcolumn %}
{% endcolumns %}

<figure><img src="/files/loMei7rYNgzP5dknOQWu" alt="" width="188"><figcaption></figcaption></figure>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://unsloth.ai/docs/docs.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.