gym是强化学习的一个经典环境，已经更新成了gymnasium
基本的安装按照https://gymnasium.farama.org/environments/atari/adventure/

pip install gymnasium
pip install gymnasium[atari]
pip install gymnasium[all]

不同的环境需要如下配置：

• box-2d

pip install gymnasium[box2d]

• mujoco

pip install gymnasium[mujoco]

• atari

pip install gymnasium[accept-rom-license]
pip install ale-py

import gymnasium as gym
import ale_pygym.register_envs(ale_py)  # unnecessary but helpful for IDEsenv = gym.make('ALE/Breakout-v5', render_mode="human")  # remove render_mode in training
obs, info = env.reset()
episode_over = False
while not episode_over:action = policy(obs)  # to implement - use `env.action_space.sample()` for a random policyobs, reward, terminated, truncated, info = env.step(action)episode_over = terminated or truncated
env.close()

问题1[Failed building wheel for box2d-py]

  Building wheel for box2d-py (setup.py) ... errorerror: subprocess-exited-with-error× python setup.py bdist_wheel did not run successfully.│ exit code: 1╰─> [16 lines of output]Using setuptools (version 69.5.1).running bdist_wheelrunning buildrunning build_pycreating buildcreating build/lib.linux-x86_64-cpython-38creating build/lib.linux-x86_64-cpython-38/Box2Dcopying library/Box2D/Box2D.py -> build/lib.linux-x86_64-cpython-38/Box2Dcopying library/Box2D/__init__.py -> build/lib.linux-x86_64-cpython-38/Box2Dcreating build/lib.linux-x86_64-cpython-38/Box2D/b2copying library/Box2D/b2/__init__.py -> build/lib.linux-x86_64-cpython-38/Box2D/b2running build_extbuilding 'Box2D._Box2D' extensionswigging Box2D/Box2D.i to Box2D/Box2D_wrap.cppswig -python -c++ -IBox2D -small -O -includeall -ignoremissing -w201 -globals b2Globals -outdir library/Box2D -keyword -w511 -D_SWIG_KWARGS -o Box2D/Box2D_wrap.cpp Box2D/Box2D.ierror: command 'swig' failed: No such file or directory[end of output]note: This error originates from a subprocess, and is likely not a problem with pip.ERROR: Failed building wheel for box2d-pyRunning setup.py clean for box2d-py
Failed to build box2d-py
ERROR: Could not build wheels for box2d-py, which is required to install pyproject.toml-based projects

https://github.com/openai/gym/issues/3143#issuecomment-1560325924

Box2D is written in C++ and requires swig to bind C++ to Python.
For Windows users:

You can download swig here: https://www.swig.org/download.html
Mac users:

brew install swig
For Linux users:

apt-get install swig3.0
ln -s /usr/bin/swig3.0 /usr/bin/swig

问题2[ERROR: Failed building wheel for mujoco-py]

ModuleNotFoundError: No module named 'lockfile'[end of output]note: This error originates from a subprocess, and is likely not a problem with pip.ERROR: Failed building wheel for mujoco-pyRunning setup.py clean for mujoco-py
Failed to build mujoco-py
ERROR: Could not build wheels for mujoco-py, which is required to install pyproject.toml-based projects

 sudo apt install libosmesa6-dev libgl1-mesa-glx libglfw3sudo apt-get install libgl1-mesa-dev libgl1-mesa-glx libosmesa6-dev python3-pip python3-numpy python3-scipy