Which GPU(s) to Get for Deep Learning?

Version History

•2023-01-30: Improved font and recommendation chart. Added 5 years cost of ownership electricity perf/USD chart. Updated Async copy and TMA functionality. Slight update to FP8 training. General improvements.

•2023-01-16: Added Hopper and Ada GPUs. Added GPU recommendation chart. Added information about the TMA unit and L2 cache.

Previous update was September 2020, so (considering both of these together) this is a significant release.