This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| GPU | Arch | Year | FP32 | FP16/BF16 | FP8 | FP4 | Bandwidth | Memory | Ops:byte | |
|---|---|---|---|---|---|---|---|---|---|---|
| P100 SXM2 | Pascal | 2016 | 10.6 | 21.2 (FP16) | -- | -- | 720 GB/s | 16 GB HBM2 | 29 | |
| V100 SXM | Volta | 2017 | 15.7 | 125 (FP16) | -- | -- | 900 GB/s | 32 GB HBM2 | 139 | |
| A100 SXM | Ampere | 2020 | 19.5 | 312 (BF16) | -- | -- | 2039 GB/s | 80 GB HBM2e | 153 | |
| H100 SXM | Hopper | 2022 | 67 | 989 (BF16) | 1979 | -- | 3350 GB/s | 80 GB HBM3 | 295 | |
| B200 HGX | Blackwell | 2024 | 75 | 2250 (BF16) | 4500 | 9000 | 7700 GB/s | 180 GB HBM3e | 292 | |
| B300 NVL72 | Blackwell Ultra | 2025 | ~90 | 2500 (BF16) | 5000 | 15000 | 8000 GB/s | 288 GB HBM3e | 313 | |
| DGX Spark | Blackwell | 2025 | 31 | ~125 (BF16) | ~250 | ~500 | 273 GB/s | 128 GB LPDDR5x | ~458 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Install "sshpass" on macOS Catalina. | |
| # | |
| # - sshpass allows you to easily automate password entry | |
| # prompts for ssh sessions. | |
| # | |
| # Don't mess around with terminal if you | |
| # don't know what any of this means, please. | |
| # Evaluate for learning purposes at your own risk. | |
| # | |
| # Licensed under MIT. See below. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # This is an example of the Stack Exchange Tier 1 HAProxy config | |
| # The only things that have been changed from what we are running are: | |
| # 1. User names have been removed | |
| # 2. All Passwords have been remove | |
| # 3. IPs have been changed to use the example/documentation ranges | |
| # 4. Rate limit numbers have been changed to randome numbers, don't read into them | |
| userlist stats-auth | |
| group admin users $admin_user | |
| user $admin_user insecure-password $some_password |