Search Results

The Best GPUs for Deep Learning in 2023 — An In-depth Analysis

30 Jan 2023

https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/

Here, I provide an in-depth analysis of GPUs for deep learning/machine learning and explain what is the best GPU for your use-case and budget.

TPUs vs GPUs for Transformers (BERT) — Tim Dettmers

17 Oct 2018

https://timdettmers.com/2018/10/17/tpus-vs-gpus-for-transformers-bert/

Here I develop a theoretical model of TPUs vs GPUs for transformers as used by BERT and show that current GPUs are about 32% to 54% slower for this task.

Tim Dettmers — Making deep learning accessible.

https://timdettmers.com/

Making deep learning accessible.

Tim Dettmers — Page 2 of 2 — Making deep learning accessible.

https://timdettmers.com/page/2/

Making deep learning accessible.

Academia Archives — Tim Dettmers

https://timdettmers.com/category/academia/

PhD Life Archives — Tim Dettmers

https://timdettmers.com/category/academia/phd-life/

Deep Learning Archives — Tim Dettmers

https://timdettmers.com/category/deep-learning/

Hardware Archives — Tim Dettmers

https://timdettmers.com/category/hardware/

In-depth blog posts with complete analysis of hardware for deep learning. I compare GPUs and other accelerators and explain how they work.

Science Archives — Tim Dettmers

https://timdettmers.com/category/science/

Neuroscience Archives — Tim Dettmers

https://timdettmers.com/category/science/neuroscience/

In-depth blog posts that cross-analyze the interfaces between deep learning, neuroscience, and hardware.