Commit 45daab91 authored by Xiaoqiang Zheng's avatar Xiaoqiang Zheng Committed by TensorFlower Gardener
Browse files

A fp16 implemention for ReluGrad. 

On V100 with Cuda 9, it reduces the average ReluGrad kernel time in Resnet50 from 249.44 us to
175.60 us, a 42% speedup.
On Titan-X Pascal with Cuda 9, it reduces the average ReluGrad kernel time in
Resnet50 from 747.98 us to 509.37 us, a 46.8% improvement.

PiperOrigin-RevId: 187545504
parent ac794863
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment