Compare model versions

Diff

Before

**Cybersecurity-focused CRACK · native FP8 speed on Hopper**

<img src="dealign_logo.png" width="220" alt="dealignai logo" />

a **CRACK** release by [dealignai](https://huggingface.co/dealignai) · Twitter [@dealignai](https://twitter.com/dealignai)

</div>

---

After

**Cybersecurity-focused CRACK · native FP8 speed on Hopper**

<img src="dealign_logo.png" width="220" alt="dealignai logo" />

a **CRACK** release by [dealignai](https://huggingface.co/dealignai) · Twitter [@dealignai](https://twitter.com/dealignai)

</div>

---

> [!IMPORTANT]
> **Runtime notes** — field-tested on 8× DGX Spark GB10 by [@0xMagnus](https://huggingface.co/0xMagnus) ([discussion](https://huggingface.co/dealignai/GLM-5.3-UNCENSORED-FP8/discussions/3)):
>
> - **`reasoning_effort` only honors `"low"` and `"high"`.** Every other value — `off`, `medium`, `max`, unset, or an unquoted YAML `off:` (parses as boolean `false`) — falls through to `max`. There is no way to disable reasoning on this checkpoint; pass `"low"` for minimum.
> - **On FP8, prefer `low` for agent / tool-loop use.** At `high`/`max` the model can spend the whole `max_tokens` budget inside `<think>` and return zero answer tokens (finish=`length`); sampling params (temp 0 + rep 1.05, temp 0.7 / top-p 0.95) do not rescue it. It is budget exhaustion, not a loop. If you must run `high`/`max`, give `max_tokens ≥ 8000`.
> - **Reasoning text is in `message.reasoning`**, not `message.reasoning_content`.
> - **MTP:** non-functional on stock vLLM, but reported working on ciprianveg's B12X sparse-MLA vLLM fork with `--draft-attention-backend B12X_MLA_SPARSE` (+48% decode on coding prompts).
> - **1M context via decode-context-parallel is closed** on `glm_moe_dsa` in vLLM today (DSA indexer `k_cache` is replicated across DCP ranks while MLA KV is sharded → `page size is not divisible by target page size and cannot be padded` for `fp8_ds_mla`). Practical TP8 H200 ceiling: ~131K w/MTP, ~160K w/o. Pipeline-parallel (PP2 × TP4) profiles fine, but the MTP draft does not implement `SupportsPP`.