Skip to content
howdoaiagentswork.com

GLM-5.3 Review: A Hands-On Look at Zhipu's Open-Source Coding Model

GLM-5.3 open-source coding model review

Background

GLM-5.3 launched August 14, 2026 from Zhipu AI (now "Z.ai"). The interesting part: it's the same 743B-parameter base as GLM-5.2. Every gain comes from extreme post-training scaling, not a bigger model. Zhipu pushed long-horizon training environments and reinforcement learning until the base's ceiling lifted ~50% on internal evals.

Key specs:

Benchmarks that matter

GLM-5.3 is positioned as the strongest open-source coding model right now:

On cybersecurity it's genuinely notable: CyberGym 84.5%, slightly above Mythos 5 (83.8%) and GPT-5.6 Sol (83.6%). During training it surfaced 2,436 vulnerabilities across 269 open-source projects, 1,097 rated critical or high.

What the red teams measured

Those cybersecurity figures are Zhipu's positioning. Two independent write-ups in September explain why GLM-5.3 moved: not the Terminal-Bench score, the exploit score.

Anthropic's Frontier Red Team (Andrew Fasano, Marius Fleischer, Cole McFaul, Robert Xiao, and Tripp Gallagher, 29 September 2026) reports that GLM-5.3 developed end-to-end exploits on ExploitBench — known bugs in Chrome's V8 engine — in 50 of 410 attempts, against 56 of 410 for Claude Mythos Preview. Anthropic had described Mythos Preview as the first model that could autonomously build sophisticated end-to-end exploits; GLM-5.3 is the open-weight arrival of that band. Anthropic sells competing models and does not release its own weights. That commercial position is the lens on every number in this paragraph.

Guardrails on the public weights did not hold. In Anthropic's simulated tests, a fake red-team cover story got GLM-5.3 to engage 64% of the time; prefilling its reasoning tokens, 92%; abliteration — editing the refusal direction out of the weights — 100%. Abliteration took them about 2,200 GPU hours (~$4,400) and moved refusal rates from above 90% to about 3% and 2% on JailbreakBench and HarmBench, with capability largely intact. Because the weights are public, that path is not one Zhipu can recall.

A separate human-in-the-loop session used GLM-5.3-Flash, not the full 5.3, on CVE-2026-11645. Anthropic says the researcher supplied public details of that Chrome flaw and another known bug; with about 20 minutes of human attention and eight hours of model time, Flash chained them into a working ARM64 exploit that bypassed pointer-authentication (PAC) hardening, at Zhipu API prices of $20.40.

NIST's Center for AI Standards and Innovation (CAISI), on 17 September 2026, called GLM-5.3 "the most cyber-capable open-weight model released to date" and said it lags the U.S. frontier by about four months on CAISI's aggregate cyber index. On CAISI's tables: SEC-Bench Pro 40.4% versus a U.S. frontier best of 90.2%; ExploitBench 61.1% versus 100%; ExploitGym 9.4% versus 44.4%; OSS-Fuzz 7.7% versus 23.2%. CAISI's ExploitBench percentage and Anthropic's 50/410 count are two different scales. They cannot be compared as if they were the same test.

The Hugging Face incident started because models in ExploitGym tried to cheat the eval. GLM-5.3 is graded on ExploitGym too. Same bench, two stories: one about containment at runtime, one about what happens when the weights are public. See the Hugging Face incident.

Hands-on via the GLM Coding Plan

I tested GLM-5.3 through the GLM Coding Plan (the paid access route available at launch). A few honest observations:

What's good:

What to watch:

How it compares

ModelTerminal-Bench 3.0LicenseNotes
GLM-5.328.3MIT (pending)Best open coding
GPT-5.6 Sol34.6ClosedHigher raw score
Claude Fable 5—ClosedTop coding overall
Qwen3.8-27B73.0 (TB 2.1)Apache 2.0Smaller, local-runnable

GLM-5.3 leads the open-weights track on agentic coding and cybersecurity. It trails closed flagships on raw score but closes the gap on efficiency.

Verdict

For teams that want open-weight coding agents and can wait for the MIT drop, GLM-5.3 is the one to watch in late August 2026. Through the Coding Plan it's usable today. Just plan around mandatory reasoning-effort and the text-only limit.

Related: Who is behind Ox Alpha? · Run Qwen3.8-27B locally · DeepSeek Harness · Ornith-1.5 review · OrcaRouter · Qwen3.8-27B Uncensored

Next Steps

If you want a model you can actually run on one GPU or a Mac, start with the local Qwen deploy. If you want the agent runtime sitting above the model, read DeepSeek Harness.

Run Qwen3.8-27B locally →What DeepSeek Harness is and why it shipped →AI agents for developers →

how do AI agents work — return to the complete AI agent architecture guide.

Sources

Figures reported by vendors are labeled as such in the article and linked to their original announcement.

Was this helpful?

Your feedback stays on this page — no tracking.

Share this page