LLM Symbol Dictionary

Use this dictionary whenever referring to LLM hyperparameters, shapes, and efficiency metrics across this project. It is a unified superset covering gpt‑oss, qwen3, qwen3‑moe, llama3, llama4, gemma3, and seed‑oss. When a feature is unused, assign the trivial setting (e.g., dense models: $E{=}e{=}1$, $N_{L,\text{moe}}{=}0$; MQA: $h_{kv}{=}1$; tied embeddings: $\mathbb{1}_{\text{tie}}{=}1$).

Unit key: “[-]” dimensionless; “[#]” count; “[features]” channel width; “[tokens]” token length; “[bytes]”, “[FLOP/s]”, “[bytes/s]”.

1) Core transformer topology

• $N_L$ — [#] Transformer block (layer) count.
• $d$ — [features] Model hidden size (residual width).