Commit 8fe37b7b authored by Justin Lebar's avatar Justin Lebar Committed by TensorFlower Gardener
Browse files

[XLA] Improve precision of and fix nans in f16 erfc implementation. 

Edge-cases were not handled properly, resulting in catastrophic precision loss
and NaNs for reasonable inputs.

May have affected f32 as well (for more extreme inputs), I didn't check.

Relevant to #25052.

PiperOrigin-RevId: 230998627
parent 7bb36fb6
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment