05.14.2020 - TensorFloat-32 in the A100 GPU Accelerates AI Training, HPC Up to 20x

As with all computing, you’ve got to get your math right to do AI well. Because deep learning is a young field, there’s still a lively debate about which types of math are needed, for both training and inferencing. In November, we explained the differences among popular formats such as single-, double-, half-, multi- and Read article >

The post TensorFloat-32 in the A100 GPU Accelerates AI Training, HPC Up to 20x appeared first on The Official NVIDIA Blog.