ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Establishing Hadoop Map/Reduce cluster for teaching purposes

Jaka Plut (2016) Establishing Hadoop Map/Reduce cluster for teaching purposes. EngD thesis.

Download (1018Kb)


    Installation and configuration of Hadoop MapReduce distributed system is quite time-consuming and requires thorough compliance with instructions. As such, it can cause considerable inconveniences to new users who would like to get familiar with the MapReduce programming model. The aim of this thesis is to research the possibilities for straight forward installation and configuration of Hadoop distributed system. The thesis focuses on creating a distributed system using Hadoop software with the help of a solution called CDH, developed by an American company Cloudera Inc. The solution is based on Apache Hadoop platform. The company has released several versions of CDH software. The latest available CDH 5.5 can be run on different distributions of Linux operating system. The bachelor thesis is comprised out of instructions and tips which are necessary for the successful setup of such distributed system. The text researches various setup options and the creation of a system using predominantly virtualization. Furthermore, we are describing in detail, with examples, the process of running MapReduce jobs. In the end, we have a brief analysis which compares performance (scalability) of MapReduce jobs run on one, two and more nodes.

    Item Type: Thesis (EngD thesis)
    Keywords: Hadoop, setup, Linux, Cloudera
    Number of Pages: 78
    Language of Content: Slovenian
    Mentor / Comentors:
    Name and SurnameIDFunction
    izr. prof. dr. Matjaž Kukar267Mentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=51012&select=(ID=1536877507)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 3297
    Date Deposited: 22 Mar 2016 11:41
    Last Modified: 19 Apr 2016 14:15
    URI: http://eprints.fri.uni-lj.si/id/eprint/3297

    Actions (login required)

    View Item