projects / platform / upstream / tensorflow.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: da60097) | patch
Add a parameter to the adaptive shared batcher which allows the user to set a lower...
authorA. Unique TensorFlower <gardener@tensorflow.org>
Wed, 16 May 2018 21:53:11 +0000 (14:53 -0700)
committerTensorFlower Gardener <gardener@tensorflow.org>
Wed, 16 May 2018 21:55:51 +0000 (14:55 -0700)
commit42b657e5f619a336ec26cb8390f569b690f5f8de
treee36c08a6fcee7b40b4bc07882c3b681b1b85f134tree | snapshot
parentda600975c13b00e5bc5fa64bb358bddb21baea2dcommit | diff
Add a parameter to the adaptive shared batcher which allows the user to set a lower bound for in_flight_batches_limit.

This can help prevent overloads which may occur during large traffic shifts - a small value learned during a period of low load can be unsuitable at high load.

PiperOrigin-RevId: 196893320
tensorflow/core/kernels/batching_util/adaptive_shared_batch_scheduler.h diff | blob | history
tensorflow/core/kernels/batching_util/adaptive_shared_batch_scheduler_test.cc diff | blob | history
Domain: Machine Learning / ML Framework;