How to Think About GPUs
Link: jax-ml.github.io/scaling-book/…
Discussion: news.ycombinator.com/item?id=4…
How to Think About GPUs | How To Scale Your Model
We love TPUs at Google, but GPUs are great too. This chapter takes a deep dive into the world of NVIDIA GPUs – how each chip works, how they’re networked together, and what that means for LLMs, especially compared to TPUs.jax-ml.github.io
Paultron-3030
in reply to Blurry Moon • • •