A specialized processor originally designed for rendering graphics but now the dominant hardware for AI workloads. GPUs excel at the parallel matrix multiplication operations that transformers require. NVIDIA controls approximately 80-90% of the AI GPU market through products like the H100 and Blackwell architectures.
Discussed in Chapter 2 of This Is Server Country