SDS-3.x 000_7-sds-3-x-ddl Introduction to Distributed Deep Learning

SDS-3.x: Scalable Data Science and Distributed Machine Learning

000_7-sds-3-x-ddl: Introduction to Distributed Deep Learning

Topics: Introduction to Distributed Deep Learning (DDL) with Horovod over Tensorflow/keras and Pytorch. DDL of various CNN architectures for image segmentation with horovod, MLFlow and hyper-parameter tuning through SparkTrials.

• 000_7-sds-3-x-ddl as book

1. Distributed Deep Learning with Horovod over Tensorflow/keras and Pytorch

• DDL Intro
• MNIST on tensorflow and keras
• MNIST on pytorch

2. Distributed Image Segmentation

• Introduction to Image Segmentation
• U-Net
• PSP-Net
• PSP-Net Tuning
• PSP-Net on Horovod