Skip to content
Newsroom
Research Aug 4, 2026 by Rajat Jain

Mind Lab's Macaron-V1: Five LoRA Experts on GLM-5.1

Mind Lab's Macaron-V1 attaches five 1B-parameter LoRA experts to GLM-5.1, switching dynamically — claiming to beat GLM-5.2 via continual-learning distillation.

Mind Lab's Macaron-V1: Five LoRA Experts on GLM-5.1

Mind Lab claims its Macaron-V1 model surpasses GLM-5.2 in its benchmarks — built not by training a bigger dense model, but by attaching five LoRA expert modules, each around one billion parameters, to GLM-5.1, with dynamic switching between experts per task.

The architecture is a bet on a specific future: continual learning — experts that accumulate as the model is used, distilled into a dedicated LoRA adapter that is continually updated as the model is called.

Key facts

  • The build: Macaron-V1 = GLM-5.1 base + 5 LoRA expert modules (~1B parameters each).
  • The switch: the system dynamically routes to the expert best suited to the task — task-based expert selection, not per-token mixing.
  • The claim: surpasses GLM-5.2 on Mind Lab’s benchmarks (self-reported; independent replication pending).
  • The novelty: continual learning — accumulated usage data gets distilled into a dedicated, continually-updated LoRA adapter, so the model gets better with use rather than requiring scheduled retrains.
  • Cost angle: a 5×1B-LoRA overlay is dramatically cheaper to train per expert than a full 300B-class model checkpoint cycle.

Why it matters

  • The open-weight stack is learning to upgrade in place. If continual-learning LoRAs work reliably, open-weights models stop needing “monolithic retrains” to improve — the economics of capability improve by an order of magnitude.
  • Task-specialized routing is the post-dense frontier. Five experts beat one dense model on diverse tasks is the mixture-of-experts philosophy made dynamic at the fine-tune layer.
  • It challenges the leaderboard narrative: Macaron-V1 beating GLM-5.2 (its own base’s successor, on Mind Lab’s evals) suggests augmentation can outpace retraining — a claim worth replicating independently.

What to watch

  • Independent benchmarks and weights availability — does Mind Lab release Macaron-V1 open-weights, enabling third-party retests?
  • The distillation pipeline’s real-world data — how much usage data is needed to tune a new expert, and how good is the routing accuracy at scale.
  • Whether the big labs absorb continual-learning expert stacks into their own release cadence.

Official source

Updated August 10, 2026.

#Research #Open Source #Mixture of Experts #Continual Learning