目录
目录
Window下安装deepspeed
报错No module named 'torch._six':
升级安装
解决方法:
Window下安装deepspeed
pip install deepspeed==0.3.16
报错No module named 'torch._six':
Traceback (most recent call last):
File "\\tsclient\B\project\motion\DragNUWA-main\aa.py", line 4, in <module>
from deepspeed.runtime.utils import see_memory_usage
File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\__init__.py", line 9, in <module>
from .runtime.engine import DeepSpeedEngine
File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\runtime\engine.py", line 18, in <module>
from deepspeed.runtime.utils import see_memory_usage
File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\runtime\utils.py", line 18, in <module>
from torch._six import inf
ModuleNotFoundError: No module named 'torch._six'
升级安装
pip install deepspeed -U
又报错,
LINK : fatal error LNK1181: 无法打开输入文件“aio.lib”Traceback (most recent call last):File "<string>", line 2, in <module>File "<pip-setuptools-caller>", line 34, in <module>File "C:\Users\Administrator\AppData\Local\Temp\pip-install-sstq3xtg\deepspeed_ec1aceacdee5428b8b8e5a0f883c09d6\setup.py", line 182, in <module>abort(f"Unable to pre-compile {op_name}")File "C:\Users\Administrator\AppData\Local\Temp\pip-install-sstq3xtg\deepspeed_ec1aceacdee5428b8b8e5a0f883c09d6\setup.py", line 52, in abortassert False, msgAssertionError: Unable to pre-compile async_ioDS_BUILD_OPS=1[WARNING] async_io requires the dev libaio .so object and headers but these were not found.[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.[WARNING] One can disable async_io with DS_BUILD_AIO=0
解决方法:
[REQUEST] Hey, Microsoft...Could you PLEASE Support Your Own OS? · Issue #2427 · microsoft/DeepSpeed · GitHub
其中一个whl,支持python3.9 3.10
https://drive.google.com/drive/folders/117GSNHcJyzvMPTftl0aPBSwQVsU-z4bM