ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Operational calculus on program spaces

Žiga Sajovic (2017) Operational calculus on program spaces. EngD thesis.

Download (478Kb)


    In this work we develop an algebraic language that represents a formal calculus for deep learning and is, at the same time a model which enables implementations and investigations of programs. To this purpose, we develop an abstract computational model of automatically differentiable programs. In the model, programs are elements of op. cit. programming spaces. Programs are viewed as maps from a finite-dimensional vector space to itself op. cit. virtual memory space. Virtual memory space is an algebra of programs, an algebraic data structure (one can calculate with). The elements of the virtual memory space give the expansion of a program into an infinite tensor series. We define a differential operator on programming spaces and, using its powers, implement the general shift operator and the operator of program composition. The algebraic language constructed in this way is a complete model of deep learning. It enables us to express programs in such a way, that their properties may be derived from their source codes.

    Item Type: Thesis (EngD thesis)
    Keywords: operator algebra, tensor algebra, neural networks, deep learning, automatic differentiation
    Number of Pages: 54
    Language of Content: Slovenian
    Mentor / Comentors:
    Name and SurnameIDFunction
    prof. dr. Borut Robič28Mentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=51012&select=(ID=1537542595)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 3943
    Date Deposited: 13 Sep 2017 16:00
    Last Modified: 26 Sep 2017 10:29
    URI: http://eprints.fri.uni-lj.si/id/eprint/3943

    Actions (login required)

    View Item