Arxiv on Feb. 19th


Title: Monte Carlo Q-learning for General Game Playing
Authors: Hui Wang, Michael Emmerich, Aske Plaat
Categories: cs.AI
Comments: 15 pages 6 figures

Recently, the interest in reinforcement learning in game playing has been
renewed. This is evidenced by the groundbreaking results achieved by AlphaGo.
General Game Playing (GGP) provides a good testbed for reinforcement learning,
currently one of the hottest fields of AI. In GGP, a specification of games
rules is given. The description specifies a reinforcement learning problem,
leaving programs to find strategies for playing well. Q-learning is one of the
canonical reinforcement learning methods, which is used as baseline on some
previous work (Banerjee & Stone, IJCAI 2007). We implement Q-learning in GGP
for three small board games (Tic-Tac-Toe, Connect-Four, Hex). We find that
Q-learning converges, and thus that this general reinforcement learning method
is indeed applicable to General Game Playing. However, convergence is slow, in
comparison to MCTS (a reinforcement learning method reported to achieve good
results). We enhance Q-learning with Monte Carlo Search. This enhancement
improves performance of pure Q-learning, although it does not yet out-perform
MCTS. Future work is needed into the relation between MCTS and Q-learning, and
on larger problem instances. ,  1865kb)

No Responses Yet to “Arxiv on Feb. 19th”

  1. Leave a Comment

Leave a Reply

Please log in using one of these methods to post your comment: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: