环境搭建

conda create -n spinningup python=3.6
conda activate spinningup
sudo apt-get update && sudo apt-get install libopenmpi-dev
git clone <https://github.com/openai/spinningup.git>
cd spinningup
pip install -e .

# test if success
python -m spinup.run ppo --hid "[32,32]" --env LunarLander-v2 --exp_name installtest --gamma 0.999
python -m spinup.run test_policy data/installtest/installtest_s0
python -m spinup.run plot data/installtest/installtest_s0

强化学习模型

Part 1: Key Concepts in RL — Spinning Up documentation (openai.com)