ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Improving deep random forests

Matej Klemen (2018) Improving deep random forests. EngD thesis.

Download (479Kb)


    The most frequently used deep learning models are deep neural networks. Although they have been successfully applied to various problems, they re- quire large training sets and careful tuning of parameters. An alternative to deep neural networks is the deep forest model, which we independently implemented to verify the replicability of results in (Zhou and Feng, 2017). We test if the accuracy of deep forest can be improved by including ran- dom subspace forests or by using stacking to combine predictions of cascade forest's last layer. We evaluate the original implementation and our improvements on five data sets. The algorithm with added stacking achieves equal or better results on all five data sets, whereas the addition of random subspace forests brings worse results on three data sets and better results on two data sets.

    Item Type: Thesis (EngD thesis)
    Keywords: deep learning, deep forest, ensemble methods, multi-grained scanning, cascade forest, stacking.
    Number of Pages: 25
    Language of Content: Slovenian
    Mentor / Comentors:
    Name and SurnameIDFunction
    prof. dr. Marko Robnik Šikonja276Mentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=51012&select=(ID=1537936579)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 4255
    Date Deposited: 22 Sep 2018 15:34
    Last Modified: 28 Sep 2018 13:47
    URI: http://eprints.fri.uni-lj.si/id/eprint/4255

    Actions (login required)

    View Item