Recent code change added some lines that inadvertently passed scopes in seq2seq,

so reverting these lines because they breaks old trained models and are not needed.
(The code change in question only added support for float16.)
Change: 130430562