Performance

For an extended period, graphics processing units (GPUs) have stood as the exclusive choice for training deep neural network (DNN) …

Triton is a language and compiler for writing highly efficient custom Deep-Learning primitives. The aim of Triton is to provide an open-source environment for expressing tensor math workloads that offers high flexibility, developer productivity and end to end performance.

In this paper, we present a methodology to understand GPU microarchitectural features and improve performance for compute-intensive …