Establishing Hadoop Map/Reduce cluster for teaching purposes

Jaka Plut (2016) Establishing Hadoop Map/Reduce cluster for teaching purposes. EngD thesis.

Preview

Abstract

Installation and configuration of Hadoop MapReduce distributed system is quite time-consuming and requires thorough compliance with instructions. As such, it can cause considerable inconveniences to new users who would like to get familiar with the MapReduce programming model. The aim of this thesis is to research the possibilities for straight forward installation and configuration of Hadoop distributed system. The thesis focuses on creating a distributed system using Hadoop software with the help of a solution called CDH, developed by an American company Cloudera Inc. The solution is based on Apache Hadoop platform. The company has released several versions of CDH software. The latest available CDH 5.5 can be run on different distributions of Linux operating system. The bachelor thesis is comprised out of instructions and tips which are necessary for the successful setup of such distributed system. The text researches various setup options and the creation of a system using predominantly virtualization. Furthermore, we are describing in detail, with examples, the process of running MapReduce jobs. In the end, we have a brief analysis which compares performance (scalability) of MapReduce jobs run on one, two and more nodes.

Item Type:

Thesis (EngD thesis)

Keywords:

Hadoop, setup, Linux, Cloudera

Number of Pages:

Language of Content:

Slovenian

Mentor / Comentors:

Name and Surname	ID	Function
izr. prof. dr. Matjaž Kukar	267	Mentor

Link to COBISS:

http://www.cobiss.si/scripts/cobiss?command=search&base=51012&select=(ID=1536877507)

Institution:

University of Ljubljana

Department:

Faculty of Computer and Information Science

Item ID:

3297

Date Deposited:

22 Mar 2016 11:41

Last Modified:

19 Apr 2016 14:15

URI:

http://eprints.fri.uni-lj.si/id/eprint/3297

Actions (login required)

View Item