ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Monte Carlo Tree Search in Poker Games

Andrej Babič (2013) Monte Carlo Tree Search in Poker Games. EngD thesis.

Download (4Mb)


    As a method of artificial intelligence, Monte Carlo tree search has been widely adopted in the last few years. The main reasons for this are its relatively simple implementation and a very low domain specific knowledge needed for it to work properly. In my thesis, I will present its implementation and analyse the key parameters for the Texas Hold'em poker game. The main challenge was to develop an agent which would be able to play poker on an acceptable level without consuming too much time for each decision. One of the main problems of the Monte Carlo tree search, compared with other methods that rely more heavily on domain specific knowledge, is its relative slowness. There are a lot of poker frameworks available online. One of the most popular is Meerkat API. Its online community is large, thus there are a lot of poker playing algorithms using it. Since my agent has been developed with Meerkat API as well, I have had no problems finding suitable opponents for the simulations. Within this thesis, a generic Java framework for Monte Carlo Tree Search algorithms was developed. The framework is open source and freely available online. It enables us to customize each portion of the Monte Carlo Tree Search algorithm, as well as gives us the possibility to monitor our simulations with several data visualizers. The simulation results have shown that a Monte Carlo Tree Search simulation can be a very challenging opponent in a game of Texas Hold'em. Unfortunately, its decision-making speed cannot be compared to other algorithms with more domain specific knowledge. Its speed is also further impaired by the fact that it is written in Java.

    Item Type: Thesis (EngD thesis)
    Keywords: artificial intelligence, Monte Carlo, tree search, poker, Texas Hold'em, Meerkat API, OpenTestBed
    Number of Pages: 51
    Language of Content: Slovenian
    Mentor / Comentors:
    Name and SurnameIDFunction
    izr. prof. dr. Branko Šter283Mentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=50070&select=(ID=9961812)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 2061
    Date Deposited: 20 Jun 2013 16:27
    Last Modified: 16 Jul 2013 12:48
    URI: http://eprints.fri.uni-lj.si/id/eprint/2061

    Actions (login required)

    View Item