Flash RNN-T: Making Room to Train Speech Recognition
Flash RNN-T cuts peak GPU memory by 46% and training-step time by 22% when training RNN-T speech recognition models. See how tiled loss computation, activation checkpointing and fused GPU kernels make streaming ASR training faster and cheaper.