gym
numpy
scipy
torch>=1.4.0
tensorboard
