Note that --use-env is set by default in torchrun.
If your script expects `--local-rank` argument to be set, please
change it to read from `os.environ['LOCAL_RANK']` instead. See
https://pytorch.org/docs/stable/distributed.html#launch-utility for
如果直接使用github里面的给的命令进行的话,回报错
# multiple gpu
./tools/dist_train.sh $config num_gpu
出现下面错误
test.py: error: unrecognized arguments: --local-rank=0
所以我们要加多一行让他认识到 local-rank
parser.add_argument('--local_rank', type=int, default=0)parser.add_argument('--local-rank', type=int, default=0) #你需要加的部分args = parser.parse_args()if 'LOCAL_RANK' not in os.environ:os.environ['LOCAL_RANK'] = str(args.local_rank)