Qwen 3.5-122B runs as a daily driver on Mac Studio - 3 bugs fixed, a silent switch

BuildSubscribers only Jul 12, 2026 at 11:177Add to bookmarks

Qwen 3.5-122B runs as a daily driver on Mac Studio - 3 bugs fixed, a silent switch
Illustration : Léa Fontaine

An engineer documents on his blog three patches that transform a large Qwen 3.5 model (via MLX) into a reliable daily companion on a Mac Studio. Local hardware is making progress in practical applications, patch by patch.

In plain terms. An engineer documents (mrzk.io, July 2026) three bugs he fixed in the MLX stack to run a large open-weight Qwen 3.5 model as a daily driver on a Mac Studio. A weak but tangible signal: local computing catches up, one patch at a time.

Context

MLX is Apple's framework for inference on M-series chips; it leverages unified memory. Fitting a Qwen 3.5 model (ranging from ~100 to 235 billion parameters depending on the variant) on a well-configured Mac Studio (up to 512 GB of unified RAM on M3 Ultra) is theoretically possible through quantization. The blog documents what goes wrong in practice—the exact name of the tested variant is to be verified in the post.

Under the hood - the nature of the patches

According to the post, three bugs were blocking daily use:

  1. A long context bug - generation degraded beyond a certain number of tokens.
  2. A quantization bug - the 4-bit conversion produced invalid outputs on certain layers of the model.
  3. A sampling bug - an edge case in token selection affected quality.

The exact details (patched layer, fix mechanism, upstream PR) are in the post—read for those who want to reproduce.

Analysis

What the post says, beyond the patches, is that the Apple + Qwen stack reaches a level where it's worth debugging. It's the transition from "it works in demo" to "I rely on it every day." The hardware cost remains significant—a Mac Studio configured for this use costs several thousand dollars—but becomes achievable for a pro whose data cannot leave their machine.

Scenarios

Base (55%): The Apple + Qwen/DeepSeek/Llama stack becomes a credible choice for 3-5% of high data-sensitivity developers by mid-2027. Optimistic (25%): A Qwen or equivalent model reaches frontier-class level on a consumer machine; the equation changes. Pessimistic (20%): The fragmentation of the stack (MLX, llama.cpp, vLLM, exllama) weakens everything; each model requires its own patch.

Build-side implications

  • Local computing regains a clear use case: data sensitivity + latency + marginal costs tending toward zero.
  • Attention shifts from benchmarks to time-to-fix—how many bugs between a model's release and its real-world reliability.
  • The open-weight ecosystem grows the contribution surface: every upstream patch counts.

Risks

Dependency on MLX (Apple can break the API), quality of 4-bit quantizations on large models, stability of weights under prolonged load.

So what

The "cloud vs. local" debate is not ideological. It's technical and plays out bug by bug. This type of post—unspectacular, very concrete—is the best indicator of a coming shift.

Content reserved for members

Create a free account to access all our content and the weekly review.

Article produced by artificial intelligence, reviewed under human editorial control.

Our newsroom
Your Linux servers, as a desktop.
TermalOSSponsored
Ops, reimagined

Your Linux servers, as a desktop.

Agentless SSH monitoring, a full remote desktop and an AI ops copilot — no agents to install. Everything stays on your machine.

SSHMonitoringAI Ops
Get early access
Was this article helpful?

10 people liked this article

Like
A
Aiko NakamuraSenior software engineer
🇬🇧 Senior engineer, large-scale platforms. Writes about building with AI.
Share:
Comments (7)

Sign in to join the discussion.

LecteurDuDimanche 13 Jul 2026 · 05:08

Est-ce que ces corrections pourraient aussi améliorer la gestion des langues ?

LitLover42 13 Jul 2026 · 07:32

Peut-être, mais pour les langues, il faudrait des ajustements plus précis que ces correctifs généraux.

sandrine.b 13 Jul 2026 · 05:01

C'est bien de rendre ces modèles plus fiables, mais est-ce que ça les rend aussi plus précis sur les cas rares ?

Dr. L. 13 Jul 2026 · 04:37

Ces patches pourraient aussi améliorer l'efficacité sur des machines moins puissantes ?

1
curio_usa 12 Jul 2026 · 07:39

Est-ce que ces corrections pourraient aider à faire tourner des modèles similaires sur d'autres appareils Apple Silicon ?

Emma_London 12 Jul 2026 · 07:01

Impressionnant ! Ça donne quoi sur d'autres machines ?

unLecteurCurieux 12 Jul 2026 · 06:58

Super de voir l'IA tourner en local ! Mais ça ne ralentit pas le modèle sur d'autres tâches ?

FoodieChicago 12 Jul 2026 · 06:50

Intéressant de voir l'avancée. Est-ce que ces correctifs améliorent aussi l'efficacité du modèle ou juste les bugs ?

Your Linux servers, as a desktop.
TermalOSSponsored
Ops, reimagined

Your Linux servers, as a desktop.

Agentless SSH monitoring, a full remote desktop and an AI ops copilot — no agents to install. Everything stays on your machine.

Get early access
Topics
Explore
Information