Starting out with the gym


#1

I’m new relatively new to machine learning and especially to working with the gym.
I want to use the MCTS algorithm to play pong-v0, but when I make some steps and render it, I don’t see anything happening besides my paddle moving. There’s no ball, no other player and I am not sure if I have to implement another player as well and if so, how I would do that. I don’t think it’s just a rendering issue, because I never get a reward or anything else new.
Any help is appreciated.


#2

For anybody who also runs into this problem, you have to execute the step function 20 times before the enemy paddle and the ball appear. I don’t know if it’s a bug or a very useless and frustrating feature…