ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Drone control using gestures

Jaka Cikač (2017) Drone control using gestures. MSc thesis.

Download (16Mb)


    Quadcopters are becoming more popular and integrated into modern society. From high resolution video recording to autonomous navigation at high speed, quadcopters even shine as an everyday toy. We are now familiar with controlling quadcopters via our mobile phones. In this work we set out to develop a quadcopter gesture control system. We aspired to develop a system that can be used on a low-cost quadcopter equipped with a simple RGB camera and a powerful embedded computer. We also assembled such a quadcopter. The system is split into three modules - action detection with optical flow, human pose estimation with convolutional neural networks and gesture classification with relational features computed on the human pose. The integrated system is developed with the help of OpenCV and meta operating system ROS. For the purpose of development and evaluation we also assembled our own dataset called DS2017, in which 640 gestures are performed by 20 people. We show that action detection can detect actions sufficiently well, the human pose estimation works very well at high speed and gesture classification achieves high accuracy.

    Item Type: Thesis (MSc thesis)
    Keywords: quadcopter, gesture recognition, human pose estimation, optical flow, human-robot interaction, convolutional neural networks, UAV
    Number of Pages: 133
    Language of Content: English
    Mentor / Comentors:
    Name and SurnameIDFunction
    izr. prof. dr. Danijel Skočaj296Mentor
    Ass. Prof. Dipl.-Ing. Dr. techn. Friedrich FraundorferComentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=51012&select=(ID=1537613507)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 3996
    Date Deposited: 04 Oct 2017 16:27
    Last Modified: 24 Oct 2017 09:18
    URI: http://eprints.fri.uni-lj.si/id/eprint/3996

    Actions (login required)

    View Item