GRK 2340

Graduiertenkolleg "Computational Cognition"


Osnabrück University navigation and search


Main content

Top content

Using Deep Reinforcement Learning to Teach a Machine a World Understanding

For my PhD I am working on several techniques to try and teach a machine a semantic world understanding in a largely unsupervised fashion. I believe that this is very important to understand human cognition which is also mainly developed unsupervised in the first years of life and later in life with little supervision.

Top content

Agent Performance and Network Activations

Progressively growing neural networks

Viviane Clay

e-mail

Tel. +49 (0)541 969-3353
Fax +49 (0)541 969-2246
Room 50/206

Institute of Cognitive Science,
Wachsbleiche 27,
49090 Osnabrück, Germany

I think that a very important aspect of cognition is embodiment and believe that many of the shortcomings of current neural networks, such as vulnerability to adversarial attacks, originate from the lack of embodiment. Deep reinforcement learning is a great method to test this theory and to investigate how agents can develop an internal representation of the world with little or no rewards from the external environment.
This work is still at an early stage but here you can find some first results of my agent that I trained for the Unity Obstacle Tower Challenge.

I am especially interested in training RL agents without any rewards using mechanisms such as intrinsic curiosity. Through my background in cognitive science and neurobiology I am  implementing theories about the human brain into my machine learning algorithms. I use ideas such as predictive coding and replay to move from classical machine learning techniques to more biologically motivated models.

Publications

Clay V, König P, Kühnberger KU, & Pipa G (2021). Learning sparse and meaningful representations through embodiment
. Neural Networks 134: 23-41, ISSN 0893-6080 (Published online in 2020)
Code:
github

Clay*, V., Schrumpf*, J., Tessenow*, Y., Leder, H., Ansorge, U., & König, P. (2020). A quantitative analysis of the taxonomy of artistic styles.
Journal of Eye Movement Research, 13(2).
https://doi.org/10.16910/jemr.13.2.5

Clay V, König P and König S (2019). Eye tracking in virtual reality. https://doi.org/10.16910/jemr.12.1.3. J Eye Mov Res 12:3

König SU, Clay V, Nolte D, Duesberg L, Kuske N and König P (2019). Learning of spatial properties of a large-scale virtual city with an interactive map. https://doi.org/10.3389/fnhum.2019.00240. Front Hum Neurosci 13:240