For the complete documentation index, see llms.txt. This page is also available as Markdown.

Unsloth Updates

Unsloth Changelog for our latest releases, improvements and fixes.

To use the latest changes, update Unsloth.

New releasesv0.1.48-beta

DeepSeek-V4 + NVFP4

Unsloth can now export NVFP4, FP8, and imatrix GGUFs after training; act as a llama-swap API system; add Japanese and Brazilian Portuguese support; and includes MLX, safetensors, tool calling, healing support, and more. Unsloth core makes GRPO 1.3x faster, adds HTTP fallback for stalled downloads, improves offline mode, speeds up MoE training by 3-5x, and fixes many bugs. This release series uses unsloth>=2026.7.1.

DeepSeek-V4-Flash is now supported with Thinking toggles and our improved chat template fixes.

Smarter OpenAI-Compatible API Serving

Run one local API endpoint with safer model swapping and better agent-tool recovery.

  • API requests can opt into automatic switching between downloaded local GGUFs, while unknown model names safely keep using the current model.

  • /v1/models now returns clean model IDs and the local GGUF catalog instead of local .gguf paths.

  • Idle auto-unload can free VRAM after inactivity, and tool-call healing can now be controlled per request.

Export Improvements

Exports are more flexible and avoid unnecessary downloads.

  • Select multiple export formats at once, including portable FP8/INT8, GGUF LoRA, source-matched exports, imatrix GGUF, and compressed FP8/FP4.

  • Multi-checkpoint exports avoid more repeated base-model downloads.

  • FP8, INT8, and GGUF-LoRA exports now respect trust_remote_code, and GGUF export handles missing quantization settings more reliably.

RAG and File Chat

File chat is more useful on real documents.

  • RAG attachments can now use whole-document context, with customizable embedding models and Hugging Face search.

  • File chat reads more PDFs and Word documents correctly, including right-to-left text, Indic text, and DOCX tables.

  • Local RAG checks are more reliable behind proxy setups.

Unsloth Polish and Reliability

Everyday use should feel smoother and more stable.

  • Long training and chat runs are less likely to freeze silently.

  • Compare mode, model switching, model cancellation, Hub browsing, and Hub Discover are more reliable.

  • Project exports, chat exports, settings, guided tours, file dialogs, update screens, and reasoning UI are cleaner and more consistent.

Installer, Hardware, and Platform Fixes

Unsloth installs and runs more reliably across platforms.

  • macOS installs no longer require CMake or Homebrew when a prebuilt llama.cpp is available, and Apple Silicon support handles paths with spaces and unified memory sizing better.

  • Windows startup, UTF-8 handling, ROCm RAG embedding, and ROCm-on-WSL GPU support were improved.

  • Blackwell GPU prebuilt selection, GGUF fit checks, tensor parallelism for vision/mmproj GGUFs, and local llama.cpp reuse are now more reliable.

Training, Models, and Kernels

Training and model loading are more reliable across more setups.

  • GRPO now supports sequence packing by default, avoids repeated shared prompts, and handles DDP logit scaling correctly.

  • Full fine-tuning, RL precision settings, gradient checkpointing, DDP RoPE buffers, and MoE LoRA detection were fixed.

  • FP8 quantization/dequantization, Llama 3 RoPE scaling with Transformers v5, PEFT 0.19 LoRA reloads, and fast_generate error messages were improved.

New releasesv0.1.47-beta

GLM 5.2 + Hub + 3x longer contexts

GLM-5.2 is now supported in Unsloth Studio! All reasoning levels supported. 3x longer context lengths are now achievable with our new auto fit algorithm with MTP, allowing longer chats. Bypass permissions mode, forkable chats, queue-able chats, a new hub for model discovery, parallel modules + HTTPS Cloudflare support and more! Use unsloth studio --secure for secure HTTPS global access!

Better context length algorithm

As per PR 1 and PR 2, we made Unsloth Studio's determination of memory usage and context length much better, achieving 3x longer context overall:

Scenario
KV
before
after

1x 32GB pipeline (~31 GB free)

f16

23,040

64,000

q8_0

43,520

114,944

q4_0

82,432

199,680

2x 32GB pipeline

any

262,144

262,144

2x 24GB tensor (~23 GB free)

f16

134,049

262,144

q8_0

252,329

262,144

Chat Canvas, Forking & Queueing

  • Edit assistant messages in place and re-run from any point in the thread.

  • Fork a thread to branch a conversation without losing the original.

  • Temporary (incognito) chats that leave nothing behind.

  • Queue new prompts while a generation is still running instead of waiting.

  • Chat "artifacts" are now canvas, with inline HTML canvas cards that auto-render, a Code view, and DiffusionGemma keeps its raw code visible inline instead of collapsing.

  • Chat search now covers every message and surfaces your own messages first.

Hub (Redesigned)

  • Full-page Hub with a trending feed, search, and custom model paths support.

  • README preview in a split-view feed so you can read before you download.

  • Downloads default to the faster Xet transport, with automatic HTTP fallback if a transfer stalls.

  • New "Load on selection" toggle to set load options before a model loads.

  • Google logo shown for DiffusionGemma and future Gemma derivatives.

Models & Inference

  • DeepSeek-OCR and more vision models now load and run without errors.

  • Fixed fast inference on the latest vLLM (0.22+) so speed-ups work again.

  • Tensor parallelism is more reliable: if the faster MTP path fails, it now recovers on its own instead of crashing.

  • DiffusionGemma now shows the image forming live as it denoises, with accurate speed stats.

Security & Cloudflare Encrypted Studios

  • New --secure Cloudflare-only mode for end-to-end encrypted studios, with server-side tools staying enabled under --secure. Use unsloth studio --secure!

  • Bypass Permissions mode to skip confirmations and disable the tool sandbox when you want it.

  • Auto detect Hugging Face Virus scanning + dangerous files in repos.

Logging and API

  • New API server monitor in Studio.

  • Faster API calling and less latency

  • Much better streamlined logs - now with throughput and latency and removed a lot of bloated logs.

Hardware & Backend

  • Better support for Blackwell RTX 50X and 60X GPUs

  • Fix silent downgrading to CPU and not GPU

  • torchao version is now selected from the installed torch.

  • Installer now auto-repairs a broken or CPU-only PyTorch install and warns on silent CPU fallback, across NVIDIA + AMD on Win/Linux/Mac/WSL.

  • Frees the chat model's VRAM when training starts, but only when the GPU is actually tight (no needless reloads otherwise).

  • If llama-server hard-crashes at startup, Studio now steps through a recovery ladder instead of just failing.

Training & General Fixes & Parallel Modules

  • MLX training updates.

  • Improved GRPO training reliability with vLLM.

  • Training startup made more reliable, with clearer errors for invalid VLM batches.

  • Studio now cleans up leftover backend processes more reliably after crashes, restarts, or interrupted shutdowns.

  • Export, Chat, Training, Recipes are all individualized / compartmentalized! This means you can do all 4 in parallel now! You can chat / do inference while you wait for a training run or an export!

To update Unsloth or install a new Unsloth Studio, you must use:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex
New releasesv0.1464-beta

DiffusionGemma + Gemma 4 MTP

Ensure you install the latest v0.1.464-beta or 2026.6.7. DiffusionGemma, Gemma 4 MTP and MiniMax-M3 are all now supported.

Hub + Download Manager (Experimental)

  • Added a new Hub page for browsing, downloading, and managing Hugging Face models and datasets.

  • Unsloth can now detect models and datasets already on your machine and show them alongside downloaded assets.

  • Downloaded GGUF models now have direct Run / New Chat actions.

RAG / Chat with Files (Experimental)

  • Added Chat with Files in Studio, letting you ask questions over your own documents and knowledge bases.

  • Supports hybrid search, citations, PDF previews, per-thread documents, and a built-in search_knowledge_base tool.

New Update Button + Hardware Support

  • Unsloth now uses constant fresh up to date llama.cpp prebuilts across CUDA, ROCm, Windows, Linux, and macOS.

  • Added an in-app Update llama.cpp button so users can update the local backend without reinstalling Studio.

  • Improved Windows / WSL AMD support, Strix Halo ROCm support, Blackwell CUDA selection, and clearer installer messages.

Local Chat, Tools & API Compatibility

  • Local tool calling is more reliable, with better ordering of tool cards, fewer duplicate tool loops, and support for tool use with GGUF vision models.

  • Improved OpenAI-compatible API and Anthropic-compatible API behavior for local Studio servers, including better errors, token usage, stop reasons, and Claude Code compatibility.

Training & Fixes

  • Improved MLX support with better model labels, generation speed stats, and fixes for VLM training.

  • Fixed several training and dataset edge cases, including non-writable Hugging Face caches and custom dataset mappings.

  • Added many UI polish fixes across chat, menus, model picker, dark mode, import/export, and settings.

To update Unsloth or install a new Unsloth Studio, you must use:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex
New releasesv0.1.44-beta

Gemma 4 12B, New UI, MCP, Projects

This update focuses mainly on Gemma 4 12B, MCP, Projects, Canvas, CUDA 13.3 and the new chat UI. Next week we'll have an even bigger update.

Gemma 4 12B

Google releases Gemma 4 12B, a new model that runs locally on 8GB RAM. GGUF / Guide

Gemma 4 12B Unified supports image, audio and 256K context. Run and train the model via Unsloth Studio.

MCP

  • Remote MCP server support, including custom headers and OAuth

  • Local command-based MCP server support

  • MCP can now be turned on from the chat composer

  • Built-in presets for common MCP servers

New Chat UI

  • Projects, Canvas, MCP, RAG and Compare controls now live in the plus menu

  • Search and Code controls are easier to access from the composer

  • Menus, overlays, icons and clickable controls are more consistent across Studio

Projects

  • Organize related chats into dedicated project workspaces

  • Move existing chats into projects

  • Create and manage projects directly from the sidebar

Experimental Canvas / Artifacts

  • Opens generated HTML in a dedicated canvas panel inside Unsloth Studio

  • Supports interactive outputs, including browser based visualizations and CDN-loaded packages

  • Lets you switch between rendered preview and source code

Install, Runtime and Hardware

  • Windows prebuilt installs no longer require the early CUDA Toolkit check

  • Linux llama.cpp prebuilts now match the detected runtime cudart major

  • ROCm gfx detection is forwarded into prebuilt selection

  • Blackwell, B300 and ARM64 Linux support updates

To update Unsloth or install a new Unsloth Studio, you must use:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex
New releasesv0.1.43-beta

CUDA 13.3, Windows, Mac

To update Unsloth or install a new Unsloth Studio, you must use:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex

Mac Updates

  • Re-enabled llama.cpp prebuilt binaries for Apple Silicon (M1-M4) - Mac OS 14 / 15 / 26 (Tahoe)

  • Apple Silicon Mac OS 13 (Ventura) is source build

  • Intel (x86_64) for Mac OS 13.3 / 14 / 15 / 26 (Tahoe) uses llama.cpp prebuilt binaries

  • Intel for Max 13.0 - 13.2 is source build

Windows Updates

  • CUDA 13.3 llama.cpp prebuilt binaries now work for Windows

  • For CUDA 13.2, CUDA 13.1 and below, Windows devices uses CUDA 12.4 fallback - we'll work on CUDA 13.1 binaries soon.

CUDA 13.3 Update

  • CUDA 13.3 non Linux binaries work. We'll still use CUDA 13.1 for now

  • CUDA 13.3 solves the CUDA 13.2 gibberish problem - see https://github.com/unslothai/unsloth/issues/4849

Blackwell GPUs Update

  • For now Blackwell will have delayed releases of llama.cpp prebuilt binaries sine CUDA 12.4 does not work - we are working to resolve this soon.

New releasesv0.1.42-beta

An update before Revamp.

Hey guys, we're doing one more-ish update before a major revamp which is likely coming this week or next week. Our revamp will change a lot of things, especially with new major features and a lot of design changes.

  • NEW: API calling support now with image generation + editing, proper web search, code execution, auto prompt caching. Connect OpenAI, Anthropic and more.

  • Proper support for non-English languages e.g. Japanese, Chinese, Indian etc.

Many of you may have missed our previous release which only lasted for one day. We introduced:

  • Connect to external inference backends: vLLM, Ollama, llama-server

  • Security improvements

  • Auto MTP speculative decoding for MTP GGUFs; get the best settings customized for your hardware.

API provider calling & external connections

  • You can now connect Unsloth to any API cloud provider (OpenAI, Anthropic, OpenRouter etc.)

  • Built-in web search for OpenAI, Anthropic, OpenRouter and Kimi

  • Built-in code execution for OpenAI and Anthropic (Anthropic containers persist and are reused across turns)

  • Prompt caching is enabled for OpenAI and Anthropic models saving 50 to 90% of costs.

  • Image generation + editing

  • API key now optional for local providers (llama.cpp / vLLM / Ollama)

  • Auto-load models when adding a cloud provider

Other Unsloth Studio updates

  • OpenDocument chat attachments

  • o3 reasoning summary payload

  • Sending/prompting non-English languages (e.g. Japanese, Chinese) now works properly

  • IME composer hardening, RTL dir="auto", long log-line truncation fix

  • Tool reasoning trace rendering in UI

  • Fully offline support: cached GGUF discovery and offline DNS auto-detect for both inference and training

Unsloth Studio security improvements

  • Authentication rate-limiting, proxy-aware so reverse proxies don't bypass it

  • Sandboxed worker with a tightened blocklist (bash, hf upload, NOFILE)

  • Path containment so workers can't escape their in-flight tmp dirs

  • Strict schema validation across the Studio API

  • Tightened CSP / security headers (only legitimate favicon hosts allowed)

  • Removed the torch.load fallback on training_args.bin so untrusted pickles can never execute on model load

  • Hardened Tauri desktop release flow

  • Frontend auth: singleflight token refresh, current-password input on changes, working logout, shared 422 helper

  • Cancel cleanup now scoped strictly to in-flight tmp dirs so it can never delete user state

New releasesv0.1.41-beta

MTP + Unsloth Fixes

Lots of bug fixes, UI, UX fixes to Studio! To get the latest updates do:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex

Fixes

  1. Fix unsloth studio update not working well

  2. Fix getting stuck on reset-password page

  3. More offline mode support

  4. Improve MTP not being faster on Macs, CPUs and GPUs - now it's much better!

  5. Fix Desktop Shortcut not working after update

  6. Many many UI UX bug fixes

New releasesModel releasev0.1.405-beta

Qwen3.6 MTP + API Connections

We've got lots of new updates for Unsloth v0.1.41-beta:

  • ~2x faster GGUF inference with automatically enabled MTP

  • API calling support for OpenAI, Anthropic etc. with auto prompt caching, web search, code execution

  • Connect to external inference backends: vLLM, Ollama, llama-server

  • Experimental MLX inference

  • Proper support for non-English languages

  • Security improvements

Run Qwen3.6 TutorialsMTP Guide

MTP speculative decoding support 1.4 to 2x faster inference!

  • Auto MTP speculative decoding for MTP GGUFs; warn when the bundled llama.cpp prebuilt is stale or too old for MTP

  • New pre-built llama.cpp binaries for MTP support!

API provider calling & external connections

  • You can now connect Unsloth to any API cloud provider (OpenAI, Anthropic, OpenRouter etc.)

  • Built-in web search for OpenAI, Anthropic, OpenRouter and Kimi

  • Built-in code execution for OpenAI and Anthropic (Anthropic containers persist and are reused across turns)

  • Prompt caching is enabled for OpenAI and Anthropic models saving 50 to 90% of costs.

  • API key now optional for local providers (llama.cpp / vLLM / Ollama)

  • Auto-load models when adding a cloud provider

MLX inference (Experimental)

  • MLX quants and models now can run locally on your Mac machines!

  • We'll be adding thinking, tools and web search soon!

Other Unsloth Studio updates

  • Sending/prompting non-English languages (e.g. Japanese, Chinese) now works properly

  • OpenDocument chat attachments

  • o3 reasoning summary payload

  • IME composer hardening, RTL dir="auto", long log-line truncation fix

  • Tool reasoning trace rendering in UI

  • Fully offline support: cached GGUF discovery and offline DNS auto-detect for both inference and training

  • Lots of UI/UX polish: dark theme refactor, right sidebar redesign, time-of-day sloth mascot, dismissable copyable toasts, larger chat composer, code-execution config polish, composer action pill styling, narrower Discord button

Training updates

  • Gemma attention mask fixes

  • Multi Image GRPO

  • GRPO hidden-state return experiments

  • New Continued Pretraining (CPT) training method as a first-class option

  • Gemma-4 MoE LoRA extractor registered to fix grouped_mm contraction crash

  • Opt-in fused lm_head + cross-entropy forward, with single-matmul path under UNSLOTH_RETURN_LOGITS=1

  • Pass batch size for eval

  • Eval/training paths now honour HF_DATASETS_OFFLINE alongside HF_HUB_OFFLINE

Unsloth Studio security improvements

  • Authentication rate-limiting, proxy-aware so reverse proxies don't bypass it

  • Sandboxed worker with a tightened blocklist (bash, hf upload, NOFILE)

  • Path containment so workers can't escape their in-flight tmp dirs

  • Strict schema validation across the Studio API

  • Tightened CSP / security headers (only legitimate favicon hosts allowed)

  • Removed the torch.load fallback on training_args.bin so untrusted pickles can never execute on model load

  • Hardened Tauri desktop release flow

  • Frontend auth: singleflight token refresh, current-password input on changes, working logout, shared 422 helper

  • Cancel cleanup now scoped strictly to in-flight tmp dirs so it can never delete user state

New releasesv0.1.39-betav0.1.38-beta

Unsloth API endpoint

v0.1.39-beta bug fix May 5th 2026

Fixes chat history not being shown (existing chat history is not lost) and attachments not attaching correctly. The bug was render-only - use 2026.5.2 or directly call curl -fsSL https://unsloth.ai/install.sh | sh to update

You can use local LLMs with tools like Claude Code and Codex by connecting them to Unsloth’s API endpoint. This lets you run models like Qwen and Gemma locally, with additional features such as self-healing tool calling, code execution, and web search.

Using Unsloth as an API inference endpoint is beneficial not only because it is easy to setup and fast, but also because Unsloth provides:

New models

We've also got a handful of new models to run including NVIDIA Nemotron 3 Nano Omni, IBM Granite 4.1 and Mistral 3.5 Medium. We helped Mistral solve some issues with implementation in transformers and GGUFs.

Unsloth Updates

  • Stopped Studio training runs can now resume from checkpoints.

  • Chat threads now autosave and persist more reliably.

  • DPO training hangs in multi-process setups were fixed.

  • VLM GRPO support improved with MROPE updates.

  • Studio’s stop button now properly stops generation.

  • Fix chat template disappearing after browser refresh.

New releasesv0.1.37-beta

Brand New UI Redesign

Hey guys, we revamped the entire Unsloth Studio UI and UX experience to put an emphasis on chat and training:

  • Added a collapsible sidebar based on community feedback

  • You can now delete chats and search past conversations

  • New Preserve Thinking toggle for models that support it like Qwen3.6

  • Cleaner, more consistent design with easier navigation

  • Expanded Settings page with options to change your profile picture, name, and more

  • No more entering your Hugging Face token twice

  • gpt-oss now has low, medium and high thinking toggles.

  • Now uses latest llama.cpp prebuilt, even on Linux CUDA

  • Lots of bug, consistency and stability fixes

  • Kimi-K2.6 can now be run!

  • We also added experimental API support. Guides, announcement etc will come next week.

Qwen3.6 was also also previously already supported in Unsloth Studio for running and training. You can train and run Qwen3.6-27B right now!

Model releaseNew releases

Qwen3.6-27B + Kimi K2.6

Qwen3.6-27B can now run (18GB RAM) and be fine-tuned in Unsloth Studio. Kimi K2.6 can also be ran in Unsloth (350GB RAM).

Unsloth Studio received many new updates so please update. Details and writeup coming in the next few days.

Model releaseNew releases

Qwen3.6

Qwen3.6 can now run and be fine-tuned in Unsloth Studio. The model runs on 23GB RAM and is the strongest mid-sized LLM on nearly all benchmarks.

Model release

Gemma 4 Update + MiniMax-M2.7

Gemma 4 GGUFs are now updated with Google's official chat template fixes (which fixed/improved tool-calling), along with the latest llama.cpp fixes. Update to the latest llama.cpp, re-download quants and you shouldn't see unused token issues anymore. MiniMax-M2.7 is out now! You can run the model locally with our GGUFs in 4-bit quantization on 128GB RAM / unified memory. MiniMax-M2.7 GGUF

New releasesv0.1.36-beta

Gemma 4 Fixes

We’ve updated Gemma 4 with many fixes. These bugs are universal and affected all training packages and implementations and did not originate from Unsloth. We identified the bugs, fixed them, and Gemma 4 training now works properly in Unsloth.

You only need 8GB VRAM to train Gemma-4-E2B locally. Unsloth trains Gemma 4 ~1.5x faster while using ~60% less VRAM than FA2 setups. For the full guide and notebooks on Gemma 4 training, see our blog.

Gemma 4 Training Fixes

  1. Gradient accumulation no longer causes loss explosions. Previously, losses could spike to 300–400; expected loss is around 10–15.

  2. Fixed the IndexError affecting 26B and 31B inference in transformers.

  3. Fixed gibberish outputs for E2B/E4B when use_cache=False. See issue #45242.

  4. Fixed float16 audio overflow from -1e9 values.

If you see losses above 13–15, for example 100 or 300 - gradient accumulation is likely being handled incorrectly. This is fixed in both Unsloth and Unsloth Studio.

Gemma 4 Quant Re-uploads

We also updated our Gemma 4 GGUFs so you will need to re-download. Again, these quant issues are not related to or caused by Unsloth:

  1. CUDA: check for buffer overlap before fusing - critical fix for <unused24> tokens - PR #21566

  2. kv-cache: support attention rotation for heterogeneous iSWA - PR #21513

  3. vocab: add byte token handling to BPE detokenizer for Gemma 4 - PR #21488

  4. convert: set "add bos" == True for Gemma 4 - PR #21500

  5. common: add Gemma 4 specialized parser - PR #21418

  6. llama-model: read final_logit_softcapping for Gemma 4 - PR #21390

  7. llama: add custom newline split for Gemma 4 - PR #21406

Unsloth Studio Updates

  • Add speculative decoding support (ngram-mod, on by default)

  • Llama.cpp updated to use latest version with all Gemma 4 Fixes

  • Fix Qwen3.5 and Gemma 4 training issues

  • Enable exporting and saving of Gemma 4 models

  • Harden sandbox security for terminal and python tools

  • Let recipes use the model loaded in Chat

  • Fix empty chat threads on navigation (and whenever switching tabs) and stabilize new chat flow

  • Allow non-LLM recipes to run and move Data tab first in executions

  • Reuse HF cached repo casing to prevent duplicate downloads

New releasesv0.1.36-beta

Google - Gemma 4

  • You can now run and train the Gemma 4 models in Unsloth.

  • Intel Mac now works

  • Pre-compiled binaries for llama.cpp for 2 Gemma-4 fixes:

    • vocab: fix Gemma4 tokenizer (#21343)

    • fix: gemma 4 template (#21326)

  • Tool calls for smaller models are now more stable and don't cut off anymore

  • Pre-compiled binaries for Windows, Linux, Mac, WSL devices - CPU and GPU

  • Speculative Decoding added for non vision models (Gemma-4 is vision sadly and Qwen3.5)

  • Context length is now properly applied.

  • Web search now actually gets web content and not just summaries

  • 90% reduced HF API calls - less rate limits

New releasesImprovements

+50% tool call accuracy + more support

  • Tool calls for all models are now +30% to +80% more accurate.

  • Web search now actually gets web content and not just summaries

  • Number of tool calls allowed are increased to 25 from 10

  • Tool calls now terminate much better, so looping / repetitions will be reduced

  • More tool call healing and de-duplication logic to stop tool callings from leaking XML as well

  • Tested with unsloth/Qwen3.5-4B-GGUF (UD-Q4_K_XL), web search + code execution + thinking enabled.

Metric
Before
After

XML leaks in response

10/10

0/10

URL fetches used

0

4/10 runs

Runs with correct song names

0/10

2/10

Avg tool calls

5.5

3.8

Avg response time

12.3s

9.8s

New features

  • Added custom folders so you can use any GGUFs in any folder - for now access in Advanced Settings in Chat and Custom Folders

  • Update button now visible

  • Install script styling all updated!

  • Preliminary Automatic Multi GPU support for inference and training - useful for large models that don't fit on 1 GPU - Studio auto will allocate GPU resources

  • Intel Macs should work out of the box

Much smoother and faster Studio

  • Fixed timeouts of downloads of large models - no more timeouts seen.

  • Fixed Hugging Face rate limiting - HF API calls reduced by 90%

  • Fixed bun on Windows and faster installs

New releasesFixesImprovements

New Important Updates

It’s only been 2 days since our previous release, but we’ve got a more important updates:

  • Inference is now 20–30% faster. Previously, tool-calling and repeat penalty could slow inference below normal speeds. Inference tokens/s should now perform the same as llama-server / llama.cpp.

  • Now Auto-detects older or pre-existing models downloaded from LM Studio, Hugging Face, and similar sources.

  • Inference token/s speed is now calculated correctly. Previously, tokens/s included startup time, which made the displayed speed look slower than it actually was. It should now reflect 'true' inference speed.

  • CPU usage no longer spikes. Previously, inline querier identity changed every render, causing useLiveQuery to resubscribe continuously.

  • Unsloth Studio now has a shutdown x button and shuts down properly. Previously, closing it after opening from the desktop icon would not close it properly. Now, launching from the shortcut also opens the terminal, and closing that terminal fully exits Unsloth Studio. If you still have it open from a previous session you can restart your computer or run lsof -i :8888 then kill -9 <PID>.

  • Even better tool-calling and websearch with reduced errors.

  • Updated documentation with lots of new info on deleting models, uninstalling etc.

  • Cleaner, smarter install and setup logging across Windows and Linux. Output is now easier to read with consistent formatting, quieter by default for a smoother experience, and supports richer --verbose diagnostics when you want full technical detail.

  • You can now view your training history!

New releasesFixesImprovements

First Release post Unsloth Studio

Hey guys, this is our first release since we launched Unsloth Studio. Lots of new features and fixes:

  • You can now update Unsloth Studio! Please update via the same install commands.

  • Windows CPU or GPU now works seamlessly. Please reinstall!

  • App shortcuts. Once installed, you can now launch in Windows, MacOS and Linux via a shortcut icon in the Start / Launch and Desktop.

  • Pre-compiled llama.cpp binaries and mamba_ssm - 6x faster installs! Also <300MB in size for binaries.

  • 50% reduced installation sizes (-7GB or more savings), 2x faster installs and faster resolving. 50% smaller pypi sizes.

  • Tool calling improved. Better llama.cpp parsing, no raw tool markup in chat, faster inference, a new Tool Outputs panel, timers.

  • MacOS and CPU now have Data Recipes enabled with multi-file uploading.

  • AMD support preliminary for Linux only machines - auto detects.

  • Settings sidebar redesign. Settings are now grouped into Model, Sampling, Tools, and Preferences

  • Context length now adjustable. Keep in mind this is not needed as llama.cpp smartly uses the exact context you need via --fit on

  • Multi-file upload. Data recipes now support multiple drag-and-drop uploads for PDF, DOCX, TXT, and MD, with backend extraction, saved uploads, and improved previews.

  • Colab with free T4 GPUs with Unsloth Studio now fixed! Try it here. Due to pre-compiled binaries, it's also 20x faster!

  • Better chat observability. Studio now shows llama-server timings and usage, a context-window usage bar, and richer source hover cards.

  • Better UX overall - clickable links, better LaTeX parsing, tool / code / web tooltips for default cards and much more!

  • LiteLLM - Unsloth Studio and Unsloth were NOT affected by the recent LiteLLM compromise. Nemo Data Designer used LiteLLM only up to 1.80, not the affected 1.82.7 or 1.82.8, and has since removed it entirely.

  • We now have a new one line install command, just run:

Fixes:

  • Windows/setup improvements. Fixed silent Windows exits, Anaconda/conda-forge startup crashes, broken non-NVIDIA Windows installs, and missing early CUDA/stale-venv setup checks.

  • System prompts fixed. They work again for non-GGUF text and vision inference.

  • Persistent system prompts and presets. Custom system prompts and chat presets now persist across reloads and page changes.

  • GGUF export expanded. Full fine-tunes, not just LoRA/PEFT, can now export to GGUF. Base model resolution is more reliable, and unsupported export options are disabled in the UI.

  • Chat scroll/layout fixes. Fixed scroll-position issues during generation, thinking-panel layout shift, and viewport jumps when collapsing reasoning panels.

  • Smarter port conflict detection. Studio now detects loopback conflicts, can identify the blocking process when possible, and gives clearer fallback-port messages.

FixesImprovements

New Tool calling + Windows Stability

  • Claude Artifacts works so HTML can be executed like a snake game inside the chat

  • +30% more accurate tool calls esp for small models + Timer for tool calls

  • Tool + Web Search outputs can be saved + Toggle auto healing tool on/off

  • Many bug fixes - Windows CPU works, Mac more seamless, faster and smaller installs

Last updated

Was this helpful?