Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Sourceby@bin-fan
416 reads
416 reads

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

by Bin Fan7mJune 11th, 2020
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source. Alibaba Cloud Container Service Team's case study (White Paper here) Our goal was to reduce the cost and complexity of data access for Deep Learning training in a hybrid environment, which resulted in over 40% reduction in training time and cost. The merger of these technologies as a combined solution is emerging as the industry trend for DL training. We designed and implemented a model training architecture based on container and data orchestration technologies as shown below:

People Mentioned

Mention Thumbnail
Mention Thumbnail

Companies Mentioned

Mention Thumbnail
Mention Thumbnail

Coin Mentioned

Mention Thumbnail
featured image - Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source
Bin Fan HackerNoon profile picture
Bin Fan

Bin Fan

@bin-fan

VP of Open Source and Founding Member @Alluxio

About @bin-fan
LEARN MORE ABOUT @BIN-FAN'S
EXPERTISE AND PLACE ON THE INTERNET.
L O A D I N G
. . . comments & more!

About Author

Bin Fan HackerNoon profile picture
Bin Fan@bin-fan
VP of Open Source and Founding Member @Alluxio

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite