Commit 5f28bab2 authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Avoid excessive cpu<->gpu memory swaps, compute shape ops on the CPU. This 

results in +10% perf improvement for tensor2tensor Transformer model training
step times, and +37% perf improvement for tensor2tensor Transformer model
decoding.

PiperOrigin-RevId: 212804933
parent da02a441
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment