Commit ceff2486 authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Performance improvements for gRPC-based TensorFlow system. Rather than

going:

  Tensor -> TensorProto inside RecvTensorResponse -> grpc::ByteBuffer

We hand-encode the protocol buffer data to go directly from:

  Tensor -> grpc::ByteBuffer.

For tensors that support memcpy of their underlying data, we also
arrange for the representation of the actual Tensor data in the
grpc::ByteBuffer to share the underlying Tensor backing store, rather
than doing another copy.

Improves walltime performance of an RPC benchmark with large tensors
by ~26.3%, and cpu time by 35.4%.
Change: 128225572
parent 8d1f819d
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment