Logan Robbins logan-robbins
logan-robbins
/ microgpt_dnb.py
Created
March 5, 2026 19:45
— forked from karpathy/microgpt.py
microgpt_dnb — Karpathy's microgpt + Dynamic Notes Bus for parallel decoding
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| microgpt_dnb.py — Fork of Karpathy's microgpt with Dynamic Notes Bus | |
| Original: https://gist.github.com/karpathy/8627fe009c40f57531cb18360106ce95 | |
| Paper: https://arxiv.org/abs/2512.10054 | |
| Code: https://github.com/logan-robbins/parallel-decoder-transformer | |
| Karpathy's microgpt is the complete GPT algorithm in ~200 lines of pure Python. | |
| This fork adds ~100 lines to show where the Dynamic Notes Bus (DNB), Shared | |
| Notes Cross-Attention (SNC), and Planner Head fit inside the transformer to |