This post just introduces this paper "Large Model Support in TensorFlow by Graph Rewriting" and it is published as a pull request in the TensorFlow repository for contributing to the TensorFlow community. With TFLMS, we were able to train ResNet-50 and 3DUnet with 4.7x and 2x larger batch size, respectively. Quite amazing...
Showing posts with label TFLMS. Show all posts
Showing posts with label TFLMS. Show all posts
Monday, September 17, 2018
Subscribe to:
Posts (Atom)