PyTorch/XLA SPMD: Scale Up Model Training and Serving with Automatic Parallelization

Published in PyTorch Blog, 2023