Add debugging checks for setting cuda stream, so it will check fail if the
stream is not set or set to a wrong one when running cudnn methods that conceptually require a stream. Also add missing cudnnSetStream()s for DoRnnForwardImpl() and DoRnnBackwardImpl(). Implementation details: 1. a current_cudnn_stream_ member is added which will be set in cudnnSetStream() 2. a different macro is used to wrap cudnn methods that require a stream in order to verify whether the provided stream is same as current_cudnn_stream_, and the program will check fail if not PiperOrigin-RevId: 192783913
Loading
Please sign in to comment