Project C4 - Neurocognitive models of crossmodal language learning

PIs: Dr. Cornelius Weber, Prof. Dr. Stefan Wermter, Prof. Dr. Zhiyuan Liu

Project C4 will focus on the research question of how to build a neural cognitive model that integrates embodied and knowledge-based crossmodal information into language learning. The goals include the realisation of large-scale embodied and disembodied data collections, the investigation of neurocognitive mechanisms in computational models as well as data-driven representation models for language learning, and the integration and study of crossmodal models for large-scale technical systems. In particular, the project will examine a variety of language functions inspired by the processing in the human brain, study representation learning architectures for language learning from large-scale data and knowledge bases, and transfer them into prototypes for human-robot interaction.