Commit d6f9d610 authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Switch the softmax to use the new deterministic reductions on the GPU, 

results in a speed up of 10-40x on the existing ImageNet benchmarks and 2-3x
on the newly added transformer benchmarks.

Update the benchmark to also run on the GPU.

Remove duplicate cpu tests.

PiperOrigin-RevId: 168596693
parent f445958e
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment