Speed up HeapSimulator's UniqueOperandSourceBuffers.

Instead of constructing a temporary set, adding all its members to
our big set, then flattening into a vector, add the members to our
vector directly, then sort it and remove duplicates at the end.

PiperOrigin-RevId: 161565289