Commit d0e81bce authored by Benjamin Kramer's avatar Benjamin Kramer Committed by TensorFlower Gardener
Browse files

[XLA:GPU] Set default kernel unrolling factor to 4

NVidia GPUs have 4-wide vector stores, so this is the natural unrolling factor
there. After recent fixes LLVM properly vectorizes the stores, giving a decent
performance win across the board and a huge performance win for F16 kernels.

At the moment the unrolling has no cost model and only applies to loop fusions.
All of the loop fusions I looked at were memory bound, unrolling them is a
clear win. When we add a cost model and/or auto tune later it has to be at
least as good as unrolling all the loop fusions.

PiperOrigin-RevId: 194249951
parent dc03c644
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment