ML Systems ⁷

2025

CMU 10-414/714: Deep Learning Systems (2020) - 深度学习系统 Hw0 03-04

CMU 10-414/714: Deep Learning Systems (2020) - 深度学习系统 04 Automatic Differentiation 03-03

Paper Reading: Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM 02-26

Paper Reading: Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism 02-26

Paper Reading: PipeDream: Generalized Pipeline Parallelism for DNN Training [SOSP2019] 02-24

CMU 10-414/714: Deep Learning Systems (2020) - 深度学习系统 02-03 Neural Networks 02-10

CMU 10-414/714: Deep Learning Systems (2020) - 深度学习系统 01 Softmax 02-05