University of Hamburg - to research, to teach, to educate and form, to homepage
leeres logo

Photo: UHH/Denstorf

Publications - Thematic Area C

Publications project C1 - Crossmodal speech representations and their implications in speech learning

Publications of the current funding period (2020-2024)

  • Li M, Su Y, Huang HY, Cheng J, Hu X, Zhang X, Wang H, Qin Y, Wang X, Linguidquist KA, Liu Z, Zhang D (2024). Language-Specific Representation of Emotion-Concept Knowledge Causally Supports Emotion Inference, iScience. 2024;0(0).. https://doi.org/10.1016/j.isci.2024.111401
  • Li Z, Hong B, Nolte G, Engel AK, Zhang D (2024). Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech, Social Cognitive and Affective Neuroscience, 19(1), nsae051. https://doi.org/10.1093/scan/nsae051
  • Wang R, Gong J, Zhao C, Xu Y, Hong B (2024). Distinct neural pathway and its information flow for blind individual’s Braille reading, NeuroImage, 300, 120852. https://doi.org/10.1016/j.neuroimage.2024.120852
  • Li J, Hong B, Nolte G, Engel AK, Zhang D (2023). EEG-based speaker–listener neural coupling reflects speech-selective attentional mechanisms beyond the speech stimulus, Cerebral Cortex, bhad347. https://doi.org/10.1093/cercor/bhad347
  • Li Z, Zhang D (2023). How does the human brain process noisy speech in real life? Insights from the second-person neuroscience perspective, Cognitive Neurodynamics, 18, 371–382. https://doi.org/10.1007/s11571-022-09924-w
  • Zhang X, Li J, Li Z, Hong B, Diao T, Ma X, Nolte G, Engel AK, Zhang D (2023). Leading and Following: Noise Differently Affects Semantic and Acoustic Processing during Naturalistic Speech Comprehension, NeuroImage, 282, 120404. https://doi.org/10.1016/j.neuroimage.2023.120404
  • Hu X, Wang F, Zhang D (2022). Similar brains blend emotion in similar ways: Neural representations of individual difference in emotion profiles, Neuroimage 247, 118819. https://doi.org/10.1016/j.neuroimage.2021.118819
  • Li Z, Hong B, Wang D, Nolte G, Engel AK, Zhang D (2022). Speaker–listener neural coupling reveals a right-lateralized mechanism for non-native speech-in-noise comprehension, Cereb Cortex, bhac302, online published. https://doi.org/10.1093/cercor/bhac302
  • Li J, Hong B, Nolte G, Engel AK, Zhang D (2022). Preparatory delta phase response is correlated with naturalistic speech comprehension performance, Cognitive Neurodynamics, 16, 337–352. https://doi.org/10.1007/s11571-021-09711-z
  • Liu D, Xu X, Li D, Li J, Yu X, Ling Z, Hong B (2022). Intracranial brain-computer interface spelling using localized visual motion response, NeuroImage, 119363. https://doi.org/10.1016/j.neuroimage.2022.119363
  • Chen J, Wang Y, Maye A, Hong B, Gao X, Engel AK, Zhang D (2021). A Spatially-coded Visual Brain-Computer Interface for Flexible Visual Spatial Information Decoding, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29: 926–933. https://doi.org/10.1109/TNSRE.2021.3080045
  • Guo N, Si X, Zhang Y, Ding Y, Zhou W, Zhang D, Hong B (2021). Speech frequency-following response in human auditory cortex is more than a simple tracking, NeuroImage, 226, 117545. https://doi.org/10.1016/j.neuroimage.2020.117545
  • Li Z, Li J, Hong B, Nolte G, Engel AK, Zhang D (2021). Speaker-Listener Neural Coupling Reveals an Adaptive Mechanism for Speech Comprehension in a Noisy Environment, Cerebral Cortex, 31(10), 4719–4729. https://doi.org/10.1093/cercor/bhab118
  • Liu D, Liu C, Chen J, Zhang D, Hong B (2021). Doubling the Speed of N200 Speller via Dual-Directional Motion Encoding, IEEE Transactions on Biomedical Engineering, 68, 204-213. https://doi.org/10.1109/TBME.2020.3005518
  • Yan Y, Qian T, Xu X, Han H, Ling Z, Zhou W, Liu H, Hong B (2020). Human cortical networking by probabilistic and frequency-specific coupling, NeuroImage, 207, 116363. https://doi.org/10.1016/j.neuroimage.2019.116363
  • Chen J, Maye A, Engel AK, Wang Y, Gao X, Zhang D (2019). Simultaneous Decoding of Eccentricity and Direction Information for a Single-Flicker SSVEP BCI, Electronics, 8(12), 1554. https://doi.org/10.3390/electronics8121554

Publications of the first funding period (2016-2019)

  • Zhang Q, Hu X, Hong B, Zhang B. (2019). A hierarchical sparse coding model predicts acoustic feature encoding in both auditory midbrain and cortex. PLoS Computational Biology.
  • Chen, J., Li, Z., Hong, B., Maye, A., Engel, A. K., & Zhang, D. (2019). A Single-Stimulus, Multitarget BCI Based on Retinotopic Mapping of Motion-Onset VEPs. IEEE Transactions on Biomedical Engineering, 66(2), 464-470.
  • Si X, Zhou W, Hong B. (2017). Cooperative cortical network for categorical processing of Chinese lexical tone. Proceedings of the National Academy of Sciences. 114(46):12303-12308.

Publications project C2 - Crossmodal learning of language – mechanisms and facilitation

Publications of the first funding period (2016-2019)

  • Huang, X., Zhang, H., Chen, C., Xue, G., & He, Q. (2019). The neuroanatomical basis of the Gambler's fallacy: A univariate and multivariate morphometric study. Human brain mapping, 40(3), 967-975.
  • Feng, K., Zhao, X., Liu, J., Cai, Y., Ye, Z., Chen, C., & Xue, G. (2019). Spaced learning enhances episodic memory by increasing neural pattern similarity across repetitions. Journal of Neuroscience, 39(27), 5351-5360.
  • Zhu, B., Chen, C., Shao, X., Liu, W., Ye, Z., Zhuang, L., ... & Xue, G. (2019). Multiple interactive memory representations underlie the induction of false memory. Proceedings of the National Academy of Sciences, 116(9), 3466-3475.
  • Xue, G. (2018). The neural representations underlying human episodic memory. Trends in cognitive sciences, 22(6), 544-561.
  • Qu, J., Qian, L., Chen, C., Xue, G., Li, H., Xie, P., & Mei, L. (2017). Neural pattern similarity in the left IFG and fusiform is associated with novel word learning. Frontiers in human neuroscience, 11, 424.
  • Xue, H., Zhao, L., Wang, Y., Dong, Q., Chen, C., & Xue, G. (2017). Anodal transcranial direct current stimulation over the left temporoparietal cortex facilitates assembled phonology. Trends in neuroscience and education, 8, 10-17.
  • Zhao, L., Chen, C., Shao, L., Wang, Y., Xiao, X., Chen, C., Yang, J., Zevin, Jason., & Xue, G. (2016). Orthographic and phonological representations in the fusiform cortex. Cerebral Cortex, 27(11), 5197-5210.

Publications project C4 - Vision- and action-embodied language learning

Publications of the current funding period (2020-2024)

  • Ahrens K, Lehmann HH, Lee JH, Wermter S (2024). Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models, Transactions on Machine Learning Research (TMLR),. https://doi.org/10.48550/arXiv.2312.08888
  • Caesar A, Özdemir O, Weber C, Wermter S (2024). Enabling action crossmodality for a pretrained large language model, Natural Language Processing Journal, Volume 7, pages 100072. https://doi.org/10.1016/j.nlp.2024.100072
  • Gaede C, Özdemir O, Weber C, Wermter S (2024). Embodying language models in robot action, Proceedings of the 32nd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2024), pages 625-630. https://doi.org/10.14428/esann/2024.es2024-143
  • Lee JH, Mikriukov G, Schwalbe G, Wermter S, Wolter D (2024). Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?, preprint arXiv:2409.13456. https://doi.org/10.48550/arXiv.2409.13456
  • Sun X, Zhao X, Lee JH, Lu W, Kerzel M, Wermter S (2024). Details Make a Difference: Object State-Sensitive Neurorobotic Task Planning, Proceedings of the International Conference on Artificial Neural Networks, pages 261-275. https://doi.org/10.1007/978-3-031-72341-4_18
  • Zhao X, Li M, Lu W, Weber C, Lee JH, Chu K, Wermter S (2024). Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024). https://doi.org/10.48550/arXiv.2309.13339
  • Ahrens K, Bengtson L, Lee JH, Wermter S (2023). Visually Grounded Continual Language Learning with Selective Specialization, Findings of the Association for Computational Linguistics: EMNLP 2023, pages 7037-7054. https://doi.org/10.18653/v1/2023.findings-emnlp.469
  • Carneiro H, Weber C, Wermter S (2023). Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledge, Neurocomputing, 545, 126721. https://doi.org/10.1016/j.neucom.2023.126271
  • Hu J, Yao Y, Wang C, Pan Y, Wang S, Chen Q, Yu T, Zhao Y, Han X, xue J, Li D, Liu Z, Sun M (2023). Large Multilingual Models Pivot Zero-shot Multimodal Learning Across Languages, arxiv preprint 2308.12038. https://doi.org/10.48550/arXiv.2308.12038
  • Lee JH, Lanza S, Wermter S (2023). From Neural Activations to Concepts: A Survey on Explaining Concepts in Neural Networks, preprint arXiv:2310.11884 [cs.AI]. https://doi.org/10.48550/arXiv.2310.11884
  • Li M, Zhao X, Lee JH, Weber C, Wermter S (2023). Internally Rewarded Reinforcement Learning, International Conference on Machine Learning (ICML), PMLR~202, 2023. https://doi.org/10.48550/arXiv.2302.00270
  • Plüster B, Ambsdorf J, Braach L, Lee JH, Wermter S (2023). Harnessing the Power of Multi-Task Pretraining for Ground-Truth Level Natural Language Explanations, preprint arXiv:2212.04231. https://doi.org/10.48550/arXiv.2212.04231
  • Qu L, Weber C, Wermter S (2023). Emphasizing unseen words: New vocabulary acquisition for end-to-end speech recognition, Neural Networks, Volume 161, pages 494-504. https://doi.org/10.1016/j.neunet.2023.01.027
  • Yao Y, Yu T, Zhang A, Li M, Xie R, Weber C, Liu Z, Zheng H, Wermter S, Chua T-S, Sun M (2023). Visually Grounded Commonsense Knowledge Acquisition, Proceedings of the AAAI Conference on Artificial Intelligence, Volume 37, Number 5, pages 6583-6592. https://doi.org/10.1609/aaai.v37i5.25809
  • Zhang A, Fei H, Yao Y, Ji W, Li L, Liu Z, Chua T-S (2023). VPGTrans: Transfer Visual Prompt Generator across LLMs, arxiv preprint. https://doi.org/10.48550/arXiv.2305.01278
  • Zhao X, Li M, Weber C, Hafez B, Wermter S (2023). Chat with the Environment: Interactive Multimodal Perception Using Large Language Models, 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 3590-3596. https://doi.org/10.1109/IROS55552.2023.10342363
  • Zhao X, Li M, Weber C, Hafez MB, Wermter S (2023). Chat with the environment: Interactive multimodal perception using large language models, Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). https://doi.org/10.48550/arXiv.2303.08268
  • Özdemir O, Kerzel M, Weber C, Lee JH, Hafez B, Bruns P, Wermter S (2023). Learning Bidirectional Action-Language Translation with Limited Supervision and Testing with Incongruent Input, Applied Artificial Intelligence, vol 37, e2179167. https://doi.org/10.1080/08839514.2023.2179167
  • Ahrens K, Kerzel M, Lee JH, Weber C, Wermter S (2022). Knowing earlier what right means to you: A comprehensive VQA dataset for grounding relative directions via multi-task learning., IJCAI Workshop on Spatio-Temporal Reasoning and Learning - Jul 2022.
  • Gryshchuk V, Weber C, Loo CK, Wermter S (2022). Go ahead and do not forget: Modular lifelong learning from event-based data, Neurocomputing, Volume 500, pages 1063-1074. https://doi.org/10.1016/j.neucom.2022.05.101
  • Lee JH, Yao Y, Özdemir O, Li M, Weber C, Liu Z, Wermter S (2022). Spatial relation learning in complementary scenarios with deep neural networks, Frontiers in Neurorobotics,. https://doi.org/10.3389/fnbot.2022.844753
  • Lee JH, Kerzel M, Ahrens K, Weber C, Wermter S (2022). What is right for me is not yet right for you: A dataset for grounding relative directions via multi-task learning, Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022. https://doi.org/10.24963/ijcai.2022/145
  • Lysa Y, Weber C, Becker D, Wermter S (2022). Word-by-Word Generation of Visual Dialog using Reinforcement Learning., Proceedings 31st ICANN 2022, LNCS 13531, pp. 123-135, 2022. https://doi.org/10.1007/978-3-031-15931-2_11
  • Sun X, Weber C, Kerzel M, Weber T, Li M, Wermter S (2022). Learning Visually Grounded Human-Robot Dialog in a Hybrid Neural Architecture, Proceedings 31st ICANN 2022, LNCS 13531, pp. 258-269, 2022. https://doi.org/10.1007/978-3-031-15931-2_22
  • Uc-Cetina V, Navarro-Guerrero N, Martin-Gonzalez A, Weber C, Wermter S (2022). Survey on reinforcement learning for language processing, Artif Intell Rev (2022). https://doi.org/10.1007/s10462-022-10205-5
  • Volquardsen C, Lee JH, Weber C, Wermter S (2022). More Diverse Training, Better Compositionality! Evidence from Multimodal Language Learning, Proceedings 31st ICANN 2022, LNCS 13531, pp. 417–428, 2022. https://doi.org/10.1007/978-3-031-15934-3_3
  • Yao Y, Dong B, Zhang A, Zhang Z, Xie R, Liu Z, Lin L, Sun M, Wang J (2022). Prompt Tuning for Discriminative Pre-trained Language Models., Findings of the Association for Computational Linguistics: ACL 2022, pages 3468–3473. https://doi.org/10.18653/v1/2022.findings-acl.273
  • Özdemir O, Kerzel M, Weber C, Lee JH, Wermter S (2022). Language Model-Based Paired Variational Autoencoders for Robotic Language Learning, IEEE Transactions on Cognitive and Developmental Systems. https://doi.org/10.1109/TCDS.2022.3204452
  • Özdemir O, Kerzel M, Weber C, Lee JH, Wermter S (2022). Learning Flexible Translation Between Robot Actions and Language Descriptions, Proc. Artificial Neural Networks and Machine Learning – ICANN 2022, pp 246-257, Lecture Notes in Computer Science, vol 13530. https://doi.org/10.1007/978-3-031-15931-2_21
  • Eisermann A, Lee JH, Weber C, Wermter S (2021). Generalization in Multimodal Language Learning from Simulation, 2021 International Joint Conference on Neural Networks (IJCNN) 2021, pp. 1-8. https://doi.org/10.1109/IJCNN52387.2021.9534275
  • Fang H, Carbajal G, Wermter S, Gerkmann T (2021). Variational Autoencoder for Speech Enhancement with a Noise-Aware Encoder, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021, pp. 676-680. https://doi.org/10.1109/ICASSP39728.2021.9414060
  • Gryshchuk V, Weber C, Loo CK, Wermter S (2021). Lifelong Learning from Event-based Data, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN '21), 146. https://doi.org/10.14428/esann/2021.ES2021-146
  • Li M, Weber C, Kerzel M, Lee JH, Zeng Z, Liu Z, Wermter S (2021). Robotic Occlusion Reasoning for Efficient Object Existence Prediction, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021) pp. 2686-2692. https://doi.org/10.1109/IROS51168.2021.9635947
  • Möller M, Twiefel J, Weber C, Wermter S (2021). Controlling the Noise Robustness of End-to-End Automatic Speech Recognition Systems, 2021 International Joint Conference on Neural Networks (IJCNN) 2021 Jul 18 (pp. 1-8). https://doi.org/10.1109/IJCNN52387.2021.9533390
  • Röder F, Özdemir O, Nguyen PDH, Wertmer S, Eppe M (2021). The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive Review, Frontiers in Psychology, 12:716671. https://doi.org/10.3389/fpsyg.2021.716671
  • Scholz J, Weber C, Hafez MB, Wermter S (2021). Improving Model-Based Reinforcement Learning with Internal State Representations through Self-Supervision, 2021 International Joint Conference on Neural Networks (IJCNN) 2021, pp. 1-8. https://doi.org/10.1109/IJCNN52387.2021.9534023
  • Wulur C, Weber C, Wermter S (2021). Planning-integrated Policy for Efficient Reinforcement Learning in Sparse-reward Environments, Proceedings of the International Joint Conference on Neural Networks (IJCNN 2021). https://doi.org/10.1109/IJCNN52387.2021.9533509
  • Yao Y, Zhang A, Han X, Li M, Weber C, Liu Z, Wermter S, Sun M (2021). Visual Distant Supervision for Scene Graph Generation, Conference: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 15796-15806. https://doi.org/10.1109/ICCV48922.2021.01552
  • Zhou J, Lv X, Yang C, Liu Z, Xu W, Jiang J, Li J, Sun M (2021). KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion, Findings of the Association for Computational Linguistics (ACL-IJCNLP 2021), pp. 1751-1763. https://doi.org/10.18653/v1%2F2021.findings-acl.153
  • Özdemir O, Kerzel M, Wermter S (2021). Embodied Language Learning with Paired Variational Autoencoders, IEEE International Conference on Development and Learning (ICDL), pages 1-6,. https://doi.org/10.1109/ICDL49984.2021.9515668
  • Heinrich S, Yao Y, Hinz T, Liu Z, Hummel T, Kerzel M, Weber C, Wermter S (2020). Crossmodal language grounding in an embodied neurocognitive model, Frontiers in Neurorobotics. 2020 Oct 14;14:52. https://doi.org/10.3389/fnbot.2020.00052

Publications of the first funding period (2016-2019)

  • Springenberg S., Lakomkin E., Weber C., Wermter S.(2019) Predictive Auxiliary Variational Autoencoder for Representation Learning of Global Speech Characteristics. Proc. International Conference on Spoken Language Processing (INTERSPEECH), 2019.
  • Yu, N., Weber, C., & Hu, X. (2019) Learning sparse hidden states in Long Short-Term Memory. Proc. 28th International Conference on Artificial Neural Networks and Machine Learning, ICANN 2019.
  • Xie, R., Heinrich, S., Liu, Z., Weber, C., Yao, Y., Wermter, S., & Sun, M. (2019). Integrating Image-based and Knowledge-based Representation Learning. IEEE Transactions on Cognitive and Developmental Systems, early access.
  • Heinrich, S., Springstübe, P., Knöppler, T., Kerzel, M., & Wermter, S. (2019). Continuous convolutional object tracking in developmental robot scenarios. Neurocomputing. 342, 137-144.
  • Weber, C. (2019). Lernverfahren fur neuronale Netze und Anwendungen in der Robotik. Mitt. Math. Ges. Hamburg, 39, 27-58
  • Hinz, T., Heinrich, S., & Wermter, S. (2019). Generating multiple objects at spatially distinct locations. International Conference on Learning Representations (ICLR), arxiv.org/abs/1901.00686
  • Zhang Z., Han X., Liu Z., Jiang X., Sun M., Liu Q. (2019). ERNIE: Enhanced Language Representation with Informative Entities. Proc. of the 57th Annual Meeting of the Association for Computational Linguistics (ACL).
  • Wang, X., Han, X., Lin, Y., Liu, Z., & Sun, M. (2018). Adversarial multi-lingual neural relation extraction. Proceedings of the 27th International Conference on Computational Linguistics, 1156-1166.
  • Han, X., Zhu, H., Yu, P., Wang, Z., Yao, Y., Liu, Z., & Sun, M. (2018). Fewrel: A large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. arXiv preprint arXiv:1810.10147.
  • Han, X., Yu, P., Liu, Z., Sun, M., & Li, P. (2018). Hierarchical Relation Extraction with Coarse-to-Fine Grained Attention. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 2236-2245.
  • Shen, S. Q., Chen, Y., Yang, C., Liu, Z. Y., & Sun, M. S. (2018). Zero-Shot Cross-Lingual Neural Headline Generation. IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), 26(12), 2319-2327.
  • Heinrich, S., & Wermter, S. (2018). Interactive natural language acquisition in a multi-modal recurrent neural architecture. Connection Science, 30(1), 99-133.
  • Heinrich, S., Alpay, T., Wermter, S. (2018). Adaptive and Variational Continuous Time Recurrent Neural Networks. Proc. IEEE ICDL-EpiRob 2018.
  • Heinrich, S., Kerzel, M., Strahl, E., Wermter, S. (2018). Embodied Multi-modal Interaction in Language learning: the EMIL data collection. Proc. ICDL-EpiRob Workshop on Active Vision, Attention, and Learning 2018.
  • Springstübe, P., Heinrich, S., Wermter, S. (2018). Continuous convolutional object tracking. Proc. ESANN, 2018.
  • Lin Y., Liu Z., Sun M. (2017). Neural Relation Extraction with Multi-lingual Attention. The 55th Annual Meeting of the Association for Computational Linguistics (ACL), 34-43.
  • Niu Y., Xie R., Liu Z., Sun M. (2017). Improved Word Representation Learning with Sememes. The 55th Annual Meeting of the Association for Computational Linguistics (ACL), 2049-2058.
  • Ng, H.G. et al., (2017). Hey Robot, Why Don't You Talk to Me? Proc. 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2017).
  • Xie, R., Liu Z., Luan H., Sun M. (2017). Image-embodied Knowledge Representation Learning. Proceedings of International Joint Conference on Artificial Intelligence.
  • Heinrich, S., Weber, C., Wermter, S., Xie, R., Lin, Y., Liu, Z. (2016). Crossmodal language grounding, learning, and teaching. NIPS2016 Workshop on Cognitive Computation, pp. 62-68, Barcelona, Spain.

Publications project C5 - Combining active vision with multimodal speech comprehension

Publications of the first funding period (2016-2019)

  • Alaçam, Ö. (2019). Enhancing natural language understanding through cross-modal interaction: Meaning recovery from acoustically noisy speech. In Proceedings of the 22nd Nordic Conference on Computational Linguistics (NoDaLiDa), Association for Computational Linguistics, Turku, Finland.
  • Alaçam, Ö., Menzel, W., and Staron, T. (2019-accepted). How does visual complexity influence predictive language processing in a situated context? In Proceedings of the 15th KONVENS – Bridging the gap between NLP and human understanding, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany.
  • Alaçam, Ö., Menzel, W. and Staron, T. (2019). Syntactic and Semantic Disambiguation in a Situated Language Setting. EuroCogsci. 2019. Bochum.
  • Qu, Q., & Damian, M. F. (2019). Orthographic effects in Mandarin spoken language production. Memory & cognition, 47(2), 326-334.
  • Lou, Y., Cai, H., Liu, X., & Li, X. (2019). Effects of self-enhancement on eye movements during reading. Frontiers in psychology, 10.
  • Qu, Q., & Damian, M. F. (2019). The role of orthography in second-language spoken word production: Evidence from Tibetan Chinese bilinguals. Quarterly Journal of Experimental Psychology.
  • Xu, P., Qu, Q., Shen, W., & Li, X. (2019). Co-activation of taxonomic and thematic relations in spoken word comprehension: Evidence from eye movements. Frontiers in psychology, 10, 964.
  • 韩海宾, 许萍萍, 屈青青, 程茜, & 李兴珊. (2019). 语言加工过程中的视听跨通道整合. 心理科学进展, 27(3), 475-489.
  • Chen, L., Zhou, X., Müller, H. J., & Shi, Z. (2018). What you see depends on what you hear: Temporal averaging and crossmodal integration. Journal of Experimental Psychology: General, 147(12), 1851.
  • Salama, A. R., Alaçam, Ö and Menzel, W. (2018) Text Completion using Context-Integrated Dependency Parsing. In the Proceedings of 3rd Workshop on Representation Learning for NLP, ACL 2018.
  • Qu, Q., Cui, Z. L., and Damian, M. F(2018). Orthographic effects in second-language spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(8), 1325 1332.
  • Alaçam, Ö., Staron, T., and Menzel, W. (2018). A multi-modal data-set for systematic analyses of linguistic ambiguities in situated contexts. In Annual International Symposium on Information Management and Big Data (pp. 106-122). Springer.
  • Staron, T., Alaçam, Ö., and Menzel, W. (2018). Incorporating Contextual Information for Language-Independent, Dynamic Disambiguation Tasks. In Proceedings of the 11th Language Resources and Evaluation Conference (LREC), Miyazaki, Japan.
  • 屈青青*，刘维琳，李兴珊 (2018). 汉语言语产生的语音加工单元—基于音位的研究. 心理科学进展, 26(9), 1535-1544.
  • Alaçam, Ö., Staron, T. and Menzel, W. (2017). Towards a Systematic Analysis of Linguistic and Visual Complexity in Disambiguation and Structural Prediction. In the Proceedings of the 5th International Conference on Information Management and Big Data 4-6 September 2017. Lima, Peru.
  • Alaçam, Ö. and Habel, C. (2017). Negation in Gesture Accompanying Speech: A Cross-Modal Study. Journal of Multimodal Communication Studies, Vol. 4, issue 1-2.
  • Shen, W., Qu, Q., Ni, A., Zhou, J., & Li, X. (2017). The time course of morphological processing during spoken word recognition in Chinese. Psychonomic Bulletin & Review, 1-7. doi:10.3758/s13423-017-1274-z.
  • Qu, Q. Q., & Damian, M. F. (2017). Orthographic effects in spoken word recognition: Evidence from Chinese, Psychonomic Bulletin & Review, 1-6.

Publications project C6 - Multisensory perception, learning and action for crossmodal tele-operations

Publications of the first funding period (2016-2019)

  • Zeng, H., & Chen, L. (2019). Robust temporal averaging of time intervals between action and sensation. Frontiers in psychology, 10, 511.
  • Chen, L. (2019). Discrimination of empty and filled intervals marked by auditory signals with different durations and directions of intensity change. PsyCh journal, 8(2), 187-202.
  • Shen, L., Han, B., Chen, L., & Chen, Q. (2019). Perceptual inference employs intrinsic alpha frequency to resolve perceptual ambiguity. PLoS biology, 17(3), e3000025.
  • Zheng, W., & Chen, L. (2019). Illusory perception of auditory filled duration is task‐and context‐dependent. British Journal of Psychology.
  • Li, B., Chen, L., & Fang, F. (2019). Somatotopic representation of tactile duration: evidence from tactile duration aftereffect. Behavioural brain research, 371, 111954.
  • He, D., Wang, Y., & Fang, F. (2019). The Critical Role of V2 Population Receptive Fields in Visual Orientation Crowding. Current Biology.
  • Katzakis, N., Chen,L., Ariza, O., Teather,R., and Steinicke, F.(2019).Evaluation of 3D Pointing Accuracy in the Fovea and Periphery in Immersive Head-Mounted Display Environments, IEEE Transaction on visualization and computer graphics
  • Wang, Y., Zhu, Z., Chen, B., & Fang, F. (2019). Perceptual learning and recognition confusion reveal the underlying relationships among the six basic emotions. Cognition and Emotion, 33(4), 754-767.
  • Chen, L.*, Zhou, X., Müller, H.J., Shi, Z. (in press) What you see depends on what you hear: temporal averaging and crossmodal integration, Journal of Experimental Psychology: General.
  • Zheng,W.* & Chen, L.* (2018). The Roles of Attentional Shifts and Attentional Reengagement in Resolving The Spatial Compatibility Effect in Tactile Simon-like Tasks. Scientific Reports, 8:8760. doi:10.1038/s41598-018-27114-9.
  • Wan, Y. & Chen, L.* (2018). Temporal Reference, Attentional Modulation, and Crossmodal Assimilation. Front. Comput. Neurosci. 12:39. doi: 10.3389/fncom.2018.00039.
  • Na R., Bi T., Tjan B.S., Liu Z. and Fang F. (2018). Effect of task difficulty on blood-oxygen-level-dependent signal: a functional magnetic resonance imaging study in a motion discrimination task. PLoS ONE 13(6): e0199440.
  • Wang Y., Zhu Z., Chen B. and Fang F. (2018) Perceptual learning and recognition confusion reveal the underlying relationships among the six basic emotions. Cognition and Emotion. https://doi.org/10.1080/02699931.2018.1491831
  • Yiltiz, H. & Chen, L.*（2018）. Emotional cues and social anxiety resolve ambiguous perception of biological motion. Exp Brain Res. 236：1409-1420
  • Tian,Y. & Chen, L.* (2018). Cross-modal attention modulates tactile subitizing but not tactile numerosity estimation. Attention, Perception, & Psychophysics, https://doi.org/10.3758/s13414-018-1507-x
  • Mo C.*, He D.* and Fang F. (2018). Attention priority map of face images in human early visual cortex. Journal of Neuroscience. 38(1), 149-157
  • Zhang, J., Langbehn, E., Krupke, D., Katzakis, N., & Steinicke, F. (2018). Detection Thresholds for Rotation and Translation Gains in 360° Video-Based Telepresence Systems. IEEE transactions on visualization and computer graphics, 24(4), 1671-1680.
  • Zhang, J., Langbehn, E., Krupke, D., Katzakis, N., & Steinicke, F. (2018). A 360 video-based robot platform for telepresent redirected walking.
  • Freiwald, J. P., Katzakis, N., & Steinicke, F. (2018). Camera time warp: compensating latency in video see-through head-mounted-displays for reduced cybersickness effects. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. 9.
  • Ariza, O., Bruder, G., Katzakis, N., & Steinicke, F. (2018). Analysis of Proximity-Based Multimodal Feedback for 3D Selection in Immersive Virtual Environments. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 327-334.
  • Katzakis, N., & Steinicke, F. (2018). Excuse me! perception of abrupt direction changes using body cues and paths on mixed reality avatars. arXiv preprint arXiv:1801.05085.
  • Chen N., Lu J., Shao H., Weng X. and Fang F. (2017). Neural mechanisms of motion perceptual learning in noise. Human Brain Mapping. 38(12), 6029-6042
  • Chen, L., Guo, L., Bao,M. (2017). "Sleep-dependent consolidation benefits fast transfer of time interval training". Experimental Brain Research, 235(3),661-672.
  • Guo,L., Bao, M., Guan, L., Chen, L.. (2017). Cognitive Styles Differentiate Crossmodal Correspondences Between Pitch Glide and Visual Apparent Motion, Multisensory Research.30,363-385.
  • He D., Mo C. and Fang F. (2017). Predictive feature remapping before saccadic eye movements. Journal of Vision 17(5):14, 1-12.

Publications project C7 - Cross-modal Learning for Improving Human Reading

Publications of the current funding period (2020-2024)

  • Borjigin B, Zhang G, Hou Y, Li X (2024). Perceptual span in Mongolian text reading., Current Psychology: A Journal for Diverse Perspectives on Diverse Psychological Issues, 43(29), 24287–24294.. https://doi.org/10.1007/s12144-024-06074-6
  • Huang L, Li X (2024). The effects of lexical-and sentence-level contextual cues on Chinese word segmentation., Psychonomic Bulletin \&Review, 31(1), 293-302. https://doi.org/10.3758/s13423-023-02336-9
  • Huang L, Zhang X, Li X (2024). Chinese readers utilize emotion information for word segmentation., Psychonomic Bulletin \& Review, 31, 1548–1557.. https://doi.org/10.3758/s13423-023-02436-6
  • Liu J, Gu J, Feng C, Shi W, Biemann C, Li X (2024). Cross-Modal Impact of Recent Word Encountering Experience., Scientific Studies of Reading, 28(2), 101-119.. https://doi.org/10.1080/10888438.2023.2234518
  • Wang X, Pan J, Ding L, Biemann C (2024). Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding., Findings of the Association for Computational Linguistics: ACL 2024, pages 15840–15853, Bangkok, Thailand. Association for Computational Linguistics.. https://doi.org/10.18653/v1/2024.findings-acl.937
  • Wang X, Pan J, Jiang L, Ding L, Li X, Biemann C (2024). CogSteer: Cognition-Inspired Selective Layer Intervention for Efficient Semantic Steering in Large Language Models., arXiv preprint arXiv:2410.17714.. https://doi.org/10.48550/arXiv.2410.17714
  • Huang L, Li X (2023). The effects of lexical and sentence level contextual cues on Chinese word segmentation, Psychonomic Bulletin & Review. https://doi.org/10.3758/s13423-023-02336-9
  • Wang X, Li X, Li X, Biemann C (2023). Probing Large Language Models from A Human Behavioral Prospective, Proceedings of the Workshop: Bridging Neurons and Symbols for Natural Language Processing and Knowledge Graphs Reasoning (NeusymBridge) at LREC-COLING-2024. https://aclanthology.org/2024.neusymbridge-1.1
  • Wang X, Li X, Ding L, Zhao S, Biemann C (2023). Using Self-Supervised Dual Constraint Contrastive Learning for Cross-modal Retrieval, European Conference on Artificial Intelligence ECAI 2023. https://doi.org/10.3233/FAIA230560
  • Wang J, Yang J, Biemann C, Li X (2023). Insight to mechanism of semantic processing of lexicalized and novel compound words an eye movement study., Journal of Experimental Psychology: Learning, Memory, and Cognition, Vol 49(11), Nov 2023, 1812-1822. https://doi.org/10.1037/xlm0001255
  • Gregg J, Inhoff AW, Li X (2022). Lexical competition influences correct and incorrect visual word recognition, Quarterly Journal of Experimental Psychology. Advance online publication. http://doi.org/10.1177/17470218221102878
  • Li X, Huang L, Yao P, Hyönä J (2022). Universal and specific reading mechanisms across different writing systems, Nature Reviews Psychology. https://doi.org/10.1038/s44159-022-00022-6
  • Wang X, Schneider S, Alaçam Ö, Chaudhury P, Biemann C (2022). MOTIF: Contextualized Images for Complex Words to Improve Human Reading, Proceedings of the 13th Edition of its Language Resources and Evaluation Conference (LREC 2022). Pages 2468-2477. https://aclanthology.org/2022.lrec-1.263
  • Wiehe A, Schneider S, Blank S, Wang X, Zorn H, Biemann C (2022). Language over Labels: Contrastive Language Supervision Exceeds Purely Label-Supervised Classification Performance on Chest X-Rays., AACL 2022. https://aclanthology.org/2022.aacl-srw.11
  • Yao P, Slattery T J, Li X (2022). Sentence context modulates the neighborhood frequency effect in Chinese reading: Evidence from eye movements., Journal of Experimental Psychology: Learning, Memory, and Cognition, 48(10), 1507–1517.. https://doi.org/10.1037/xlm0001030
  • Yao P, Slattery TJ, Li X (2022). Sentence context modulates the neighborhood frequency effect: Evidence from eye movements while reading Chinese, Journal of Experimental Psychology: Learning, Memory, and Cognition, 48(10):1507-1517. https://doi.org/10.1037/xlm0001030
  • Zhang G, Yao P, Ma G, et al. (2022). The database of eye-movement measures on words in Chinese reading, Scientific Data, 9(1), 411. https://doi.org/10.1038/s41597-022-01464-6
  • Alaçam Ö, Malhotra G, Ruppert E, Biemann C (2021). Gaze-based Multimodal Meaning Recovery for Noisy / Complex Environments, ICMI 2021, pp 673-681. https://doi.org/10.1145/3462244.3481002
  • Huang L, Staub A, Li X (2021). Prior context influences lexical competition when segmenting Chinese overlapping ambiguous strings, Journal of Memory and Language, 118, 104218. https://doi.org/10.1016/j.jml.2021.104218
  • Schneider F, Alaçam Ö, Wang X, Biemann C (2021). Towards Multi-Modal Text-Image Retrieval to improve Human Reading., NAACL SRW 2021. https://aclanthology.org/2021.naacl-srw.21
  • Yao P, Staub A, Li X (2021). Predictability Eliminates Neighborhood Effects During Chinese Sentence, Psychonomic Bulletin and Review. https://doi.org/10.3758/s13423-021-01966-1
  • Zhou J, Li X (2021). On the segmentation of Chinese incremental words., Journal of Experimental Psychology: Learning, Memory, and Cognition, 47(8), 1353.. http://dx.doi.org/10.1037/xlm0000984
  • Han H, Li X (2020). Degree of conceptual overlap affects eye movements in visual world paradigm, Language, Cognition and Neuroscience, 35(10), 1456-1464. https://doi.org/10.1080/23273798.2020.1797838
  • Huang L, Li X (2020). Early, but not overwhelming: The effect of prior context on segmenting overlapping ambiguous strings when reading Chinese, Quarterly Journal of Experimental Psychology, 73(9), 1382-1395. https://doi.org/10.1177/1747021820926012
  • Li X, Pollatsek A (2020). An integrated model of word processing and eye-movement control during Chinese reading, Psychological Review, 127(6), 1139-1162. https://doi.org/10.1037/rev0000248

Publications project C8 - Crossmodal bindings and plasticity during visual-haptic interactions for novel forms of therapy

Publications of the current funding period (2020-2024)

  • Cai Y, Yang H, Xiong Z, Kuhn S, Bi Y, Wei K (2023). Neural correlates of an illusive sense of agency caused by virtual reality, Cereb Cortex 34(2):bhad547. https://doi.org/10.1093/cercor/bhad547
  • Yue S, Chen L (2023). Graphemic and Semantic Pathways of Number-Color Synesthesia: A Dissociation of Conceptual Synesthesia Mechanisms, Brain Sciences, 12(10), 1400. https://doi.org/10.3390/brainsci12101400
  • Feng S, Wang Q, Hu Y, Lu H, Li T, Song C, Fang J, Chen L, Yi L (2022). Increasing Audiovisual Speech Integration in Autism Through Enhanced Attention to Mouth, Developmental Science, e13348.. https://doi.org/10.1111/desc.13348
  • Gong W, Gu L, Wang W, Chen L (2022). Interoception visualization relieves acute pain, Biological Psychology, 2022, 169:108276. https://doi.org/10.1016/j.biopsycho.2022.108276
  • Hung J, Chen L, Zhou X (2022). Self-reference modulates the perception of visual apparent motion, Attention, Perception, & Psychophysics volume 85, pages 188–195 (2023). https://doi.org/10.3758/s13414-022-02620-1
  • Jonetzko Y, Hartfill J, Fiedler N, Zhong F, Steinicke F, Zhang J (2022). Evaluating Visual and Auditory Substitution of Tactile Feedback during Mixed Reality Teleoperation, IEEE ICCCS. https://doi.org/10.1007/978-981-99-2789-0_28
  • Liang K, Wang W, Lei X, Zeng H, Gong W, Lou C, Chen L (2022). Odor-induced sound localization bias under unilateral intranasal trigeminal stimulation, Chemical Senses, Volume 47, bjac029. https://doi.org/10.1093/chemse/bjac029
  • Liu Y, Katzakis N, Steinicke F, Chen L (2022). Peripersonal space tele-operation in virtual reality: the role of tactile force feedback, Proceedings for AsiaHaptics 2022, pp. 162-175, Beijing, China. https://doi.org/10.1007/978-3-031-46839-1_13
  • Lou C, Zeng H, Chen L (2022). Asymmetric switch cost between subitizing and estimation in tactile modality, Current Psychology, 2022, https://doi.org/10.1007/s12144-022-02858-w. https://doi.org/10.1007/s12144-022-02858-w
  • Wang W, Lei X, Gong W, Liang K, Chen L (2022). Facilitation and inhibition effects of anodal and cathodal tDCS over areas MT+ on the flash-lag effect, Journal of Neurophysiology 2022, 128(1):239-48. https://doi.org/10.1152/jn.00091.2022
  • Wang H, Wei K (2022). Transcranial Direct-Current Stimulation Does Not Affect Implicit Sensorimotor Adaptation: A Randomized Sham-Controlled Trial, Brain Sciences. 29;12(10):1325. https://doi.org/10.3390/brainsci12101325
  • Xu S, Zhou X, Chen L (2022). Intermodulation from unisensory to multisensory perception: a review, Brain Sciences, 12, 1617. https://doi.org/10.3390/brainsci12121617
  • Chen L, Feng Y, Chen B, Wang Q, Wei K (2021). Improving postural stability among people with lower-limb amputations by tactile sensory substitution, Journal of NeuroEngineering and Rehabilitation 2021, 18(1):1-4. https://doi.org/10.1186/s12984-021-00952-x
  • Hartfill J, Gabel J, Kruse L, Schmidt S, Riebandt K, Kühn S, Steinicke F (2021). Analysis of Detection Thresholds for Hand Redirection during Mid-Air Interactions in Virtual Reality, Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST 2021), pp 1-10. https://doi.org/10.1145/3489849.3489866
  • Katzakis N, Chen L, Ariza O, Teather RJ, Steinicke F (2021). Evaluation of 3d pointing accuracy in the fovea and periphery in immersive head-mounted display environments, IEEE transactions on visualization and computer graphics, 2021, 27(3):1929-36. https://doi.org/10.1109/TVCG.2019.2947504
  • Liu Y, Jiang W, Bi Y, Wei K (2021). Sensorimotor knowledge from task-irrelevant feedback contributes to motor learning, Journal of Neurophysiology. 2021 Sep 1;126(3):723-35. https://doi.org/10.1152/jn.00174.2021
  • Katzakis N, Chen L, Steinicke F (2020). Visual-Haptic Size Estimation in Peripersonal Space, Frontiers in Neurorobotics, 14:18. https://doi.org/10.3389/fnbot.2020.00018
  • Forlim CG, Bittner L, Mostajeran F, Steinicke F, Gallinat J and Kühn S (2019). Stereoscopic Rendering via Goggles Elicits Higher Functional Connectivity During Virtual Reality Gaming, Front. Hum. Neurosci. 13:365. https://doi.org/10.3389/fnhum.2019.00365

Publications project C9 - The role of mental models and sense of agency in learning crossmodal communicative acts

Publications of the current funding period (2020-2024)

  • Buidze T, Sommer T, Zhao K, Fu X, Gläscher J (2024). Communication with surprise - Computational principles of goal signaling in novel human interactions, biorxiv Preprint (in revision at Nature Communications). https://doi.org/10.1101/2024.02.20.581193
  • Buidze T, Yang Y, Gläscher J (2024). Expectation Violations as an Effective Alternative to Complex Mentalizing in Novel Communication, biorxiv Preprint (under review at iScience). https://doi.org/10.1101/2024.11.19.624256
  • Gu J, Buidze T, Zhao K, Gläscher J, Fu X (2024). The neural network of sensory attenuation: A neuroimaging meta-analysis, Psychonomic Bulletin Revíew. https://doi.org/10.3758/s13423-024-02532-1
  • Li Y, Gu J, Zhao K, Fu X (2024). The Sense of Agency in Social Interactions, Journal of Psychological Science(03),664-670. https://doi.org/10.16719/j.cnki.1671-6981.20240319
  • Liu J, Chen L, Gu J, Buidze T, Zhao K, Liu CH, Zhang Y, Gläscher J, Fu X (2024). Common intentional binding effects across diverse sensory modalities in touch-free voluntary actions., Consciousness and Cognition, 123:103727. https://doi.org/10.1016/j.concog.2024.103727
  • Möhring L, Gläscher J (2024). Protocol for predicting mulitvariate change of brain pattenrs using model-inofrmed fMRI activations, STAR protocols, 5, 102978. https://doi.org/10.1016/j.xpro.2024.102978
  • Wang Y, Zhao K, Fu X (2024). Sense of agency in the context of COVID-19 pandemic, Current Psychology 43, 17801–17814. https://doi.org/10.1007/s12144-023-05143-6
  • Zhuang Y, Zhao K, Fu X (2024). The temporal effect of uncertain context on the perceptual processing of painful and non-painful stimulation, Biological Psychology, 185, 108729. https://doi.org/10.1016/j.biopsycho.2023.108729
  • Chu Y, Huang G, Li Y, Chen Q, Liu J, Zhao K, Fu X (2023). Acute psychosocial stress weakens the sense of agency in healthy adults, Stress, 26(1). https://doi.org/10.1080/10253890.2023.2195511
  • Liu M, Huang G, Zhao K, Fu X (2023). The Functional Brain Network of Subcortical and Cortical Regions Underlying Time Estimation: An Functional MRI Study., Neuroscience, 519, 23-30. https://doi.org/10.1016/j.neuroscience.2023.02.019
  • Möhring L, Gläscher J (2023). Prediction errors drive dynmical changes in neural patterns that guide behavior, Cell Reports, 42, 112931. https://doi.org/10.1016/j.celrep.2023.112931
  • Zhang Z, Chen T, Liu Y, Wang C, Zhao K, Liu CH, Fu X (2023). Decoding the temporal representation of facial expression in face-selective regions., NeuroImage, 283, 120442. https://doi.org/10.1016/j.neuroimage.2023.120442
  • Zhu L, Mo F，Zhang Z, Zhao K, Fu X (2023). Synchronized or not: Developmental characteristics of basic facial expression recognition in infants, Advances in Psychological Science, 31(9), 1688-1697. https://doi.org/10.3724/SP.J.1042.2023.01688
  • Li Y, Gu J, Zhao K, Fu X (2022). Developmental trajectory of time perception from childhood to adolescence., Current Psychology. https://doi.org/10.1007/s12144-022-03526-9
  • Möhring L, Gläscher J (2022). Common and distinct changes in brain activation patterns modulated by two different types of prediction errors, Conference on Cognitive Computational Neuroscience San Francisco, August 25 - 28, 2022, paper P-1.13. https://2022.ccneuro.org/view_paper8c71.html?PaperNum=1087
  • Steixner-Kumar S, Rusch T, Doshi P, Spezio M, Gläscher J (2022). Humans depart from optimal computational models of interactive decision‐making during competition under partial information, Scientific Reports, 12:289. https://doi.org/10.1038/s41598-021-04272-x
  • Zhang L, Khandil F, Zhao K, Fu X, Hilgetag H, Gläscher J (2022). A causal role of the human left temporo-parietal junction in computing simulated social influence during goal-directed learning, biorxiv Preprint. https://doi.org/10.1101/2022.06.13.495824
  • Zhang B, Huang G, Zheng S, Gu J, Zhao K, Fu X (2022). Reliability and Validity of the Chinese Version of Sense of Agency Scale, Chinese Journal of Clinical Psychology(06),1344-1347+1352. https://doi.org/10.16128/j.cnki.1005-3611.2022.06.016
  • Zhao K, Chen T, Chen L, Fu X, Meng H, Yap MH., ... & Davison AK (2022). Facial Expression Recognition and Computing: An Interdisciplinary Perspective., Frontiers in Psychology, 13, 940630. https://doi.org/10.3389/fpsyg.2022.940630
  • Cui Q, Liu M, Liu CH, Long Z, Zhao K, Fu X (2021). Unpredictable fearful stimuli disrupt timing activities: Evidence from event-related potentials, Neuropsychologia, 163, 108057. https://doi.org/10.1016/j.neuropsychologia.2021.108057
  • Gu JJ, Li YY, Zhao K, Fu X (2021). Disappearing and Appearing: Temporal Binding Effects are Consistent Across Situations, Consciousness and Cognition, 93, 103166. https://doi.org/10.1016/j.concog.2021.103166
  • Korn C, Redzepovic S, Gläscher J, Kerzel M, Barros P, Heinrich S, Wermter S (2021). Cross-modal emotion recognition: How similar are patterns between DNNs and human fMRI data?, ICLR2021 Workshop on How Can Findings About The Brain Improve AI Systems? (Brain2AI@ICLR2021), Number 18 - May 2021. pdf
  • Liu M, Liu CH, Zheng S, Zhao K, Fu X (2021). Reexamining the Neural Network Involved in Perception of Facial Expression: A Meta-analysis, Neuroscience and Biobehavioral Reviews, 131, 179–191. https://doi.org/10.1016/j.neubiorev.2021.09.024
  • Mo F, Gu J, Zhao K, & Fu X (2021). Confusion Effects of Facial Expression Recognition in Patients With Major Depressive Disorder and Healthy Controls, Frontiers in psychology, 12, 703888. https://doi.org/10.3389/fpsyg.2021.703888
  • Zhao K, Gu JJ, Huang G, Zheng S (2021). The spatiotemporal markers for the sense of agency in the human brain, Advances in Psychological Science, 29(11), 1901-1910. https://doi.org/10.3724/SP.J.1042.2021.01901
  • Rusch T, Steixner-Kumar S, Doshi P, Spezio M, Gläscher J (2020). Theory of mind and decision science: Towards a typology of tasks and computational models, Neuropsychologia, 146, 107488. https://doi.org/10.1016/j.neuropsychologia.2020.107488
  • Steixner-Kumar S, Gläscher J (2020). Strategies for navigating a dynamic world, Science, 369(6507), 1056-1057. https://doi.org/10.1126/science.abd7258
  • Zhang K, Gläscher J (2020). A brain network supporting social influence in human decision-making, Science Advances, 6:eabb4159. https://doi.org/10.1126/sciadv.abb4159
  • Zhang L, Lengersdorff, Mikus N, Gläscher J, Lamm C (2020). Using reinforcement learning models in social neuroscience: frameworks, pitfalls and suggestions of best practices, Social Cognitive and Affective Neuroscience, 15(6), 695-707. https://doi.org/10.1093/scan/nsaa089