参考：
https://www.bilibili.com/video/BV1jS411K72E/?spm_id_from=333.788&vd_source=34d74181abefaf9d8141bbf0d485cde7

https://github.com/chunhuizhang/pytorch_distribute_tutorials/blob/main/tutorials/deepspeed_accelerate/accelerate_basics_scripts.py

https://www.cnblogs.com/zhouwenyang/p/17851853.html

两台机器两机两卡训练，每台机器一张显卡

安装：

pip install accelerate
accelerate               0.31.0

代码：
accelerate_basics_scripts.py

from accelerate import Accelerator
import torch
import torch