Lightning-AI

PyTorch Lightning is a deep learning framework (Python) that automates engineering code such as backpropagation, mixed precision, multi-GPU, and distributed training, so the same model code scales from 1 to 10,000+ GPUs with zero changes.