Glenn's Digital Garden
Explorer
entities
Meta
Microsoft
Satya Nadella
nodes
Azure HBv4
Azure ND A100 v4
Azure ND H100 v5
Azure ND MI200 v4
Azure ND MI300X v5
Cray EX235a
Cray EX235n
Cray EX254n
Cray EX255a
Cray EX425
papers
Azure Accelerated Networking: SmartNICs in the Public Cloud
Big Tech Is Rushing to Find Clean Power to Fuel AI’s Insatiable Appetite
Carbon-Removal Firms Have One Very Big Backer. That’s a Problem
Datacenters to emit 3x more carbon dioxide because of genAI
Notice of Request for Information (RFI) on Frontiers in AI for Science, Security, and Technology (FASST) Initiative
Nuclear finance will rely on consumers’ stomach for risk
Powering AI and Data Center Infrastructure Recommendations July 2024
Revisiting Reliability in Large-Scale Machine Learning Research Clusters
The Intelligence Age
The National Security Case for Public AI - Vanderbilt Policy Accelerator
processors
AMD MI250X
AMD MI300A
AMD MI300X
AMD MI325X
AMD MI355X
Custom A100 GPUs
Custom H100 GPUs
Intel Ponte Vecchio
Microsoft Maia 100
NVIDIA A100
NVIDIA B200
NVIDIA GH200
NVIDIA Grace
NVIDIA H100
NVIDIA H200
systems
ALCF Aurora
Bristol Isambard-AI
CINECA Leonardo
CSCS Alps
JSC JUPITER
LLNL El Capitan
Meta's H100 clusters
Microsoft Eagle
NERSC Perlmutter
OLCF Frontier
R-CCS Fugaku
R-CCS FugakuNEXT
Sandia Red Storm
TACC Horizon
TACC Vista
xAI Colossus
tags
usa
U.S. Department of Energy
Papers
AMD CDNA
AMD Zen
Availability
Azure SmartNICs
Benchmarking blobfuse
Broadcom Tomahawk 5
Cables and connectors
Canadian HPC
Capex
Coarse-Grained Reconfigurable Array
Component reliability
Cray EX
DAOS
Darshan
Digital gardens
Distillation
Dragonfly topology
Dragonfly+ topology
DRAM architecture
ECC schemes
Excursions
FASST
Frontier models
frontier models for science
Google TPUv4
Government's role in AI
GPU terminology decoder ring
GPUaaS
GSP and SMC
High-Performance Linpack
InfiniBand
Job Mean Time To Interrupt
Job reliability
LLM inferencing
LLM training
LLM training at scale
LLM training datasets
LPDDR5 Reliability
Lustre
Memory bandwidth
Meta Llama-3.1
Meta Movie Gen
Microsoft supercomputers
Minipack2
Model FLOPs Utilization
MTBF, FIT, and AFR
Multi-plane topologies
NAIRR
Network flow
Networking for LLM training
Neuromorphic computing
New Frontiers
NSF LCCF
Nuclear energy
NVIDIA GB200
Obsidian
OPT-175B
Palisades nuclear plant
PCIe Gen6
Podman
Read-it-later apps
Reasoning models
Reliability
Scaling laws
Signal modulation
Slingshot
Storage for LLM training
Structured sparsity
Superintelligence
Sustainability in HPC
Synthetic data
System architect
Tensor cores and Matrix cores
Three Mile Island
Total Board Power
Ultra Ethernet
VAST
Wisdom
Search
Search
Search
Dark mode
Light mode
Home
❯
tags
❯
Tag: anecdotes
Tag: anecdotes
2 items with this tag.
Oct 29, 2024
LLM training at scale
anecdotes
Oct 22, 2024
OPT-175B
anecdotes
model