ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Learning decision rules with evolutionary optimization

Matej Pičulin (2018) Learning decision rules with evolutionary optimization. PhD thesis.

Download (770Kb)


    One of successful predictive and descriptive approaches in machine learning is decision rule learning. Decision rules achieve reasonable classification accuracy and are interpretable, which is important to end users, who trust predictions more if they are supported with explanations. The challenge in mining decision rules is to find a short and comprehensible rule list with high classification accuracy. This led to many different types of classification rules like crisp rules, soft rules, probabilistic rules, etc. We developed two new methods for mining classification rules based on ant colony optimization, which is a successful discrete optimization method. In the first part of the dissertation, we present a new method called nAnt-Miner, which can, contrary to most other ant colony based approaches, handle numeric attributes. This leads to an increased search space and affects the running time and use of memory. We showed that the nAnt-Miner method is comparable to other ant colony optimization based rule learning methods, but is worse than fuzzy rules based method FURIA. The advantage of the nAnt-Miner method is that it can detect strong dependencies between attributes. In the second part of the dissertation we present the ProAnt-Miner method, which mines probabilistic rules. We introduce a novel interpretation of pheromone values for this approach. ProAnt-Miner is faster, achieves better prediction accuracy than nAnt-Miner, and uses less memory due to a different search graph. We showed that the ProAnt-Miner classification accuracy does not statistically differ from the state-of-the-art methods like FURIA and RIPPER. The ProAnt-Miner method has new rule form, which can give the user new insights. We evaluated both methods on real and artificial datasets.

    Item Type: Thesis (PhD thesis)
    Keywords: ant colony optimization, evolutionary computation, machine learning, rule learning, probabilistic rules, soft rules
    Number of Pages: 81
    Language of Content: Slovenian
    Mentor / Comentors:
    Name and SurnameIDFunction
    prof. dr. Marko Robnik Šikonja276Mentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=51012&select=(ID=1537991363)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 4297
    Date Deposited: 15 Oct 2018 12:57
    Last Modified: 27 Oct 2018 00:07
    URI: http://eprints.fri.uni-lj.si/id/eprint/4297

    Actions (login required)

    View Item