Project B5 - Crossmodal transfer of dexterous manipulation skills

PIs: Prof. Dr. Jianwei Zhang, Prof. Dr. Fuchun Sun

Project B5 studies the crossmodal transfer of dexterous manipulation skills to new situations. The project will (1) describe crossmodal multi-level representations of dexterous manipulation skills, (2) develop crossmodal imitation learning methods to learn such abstractions from multimodal sensor data, (3) develop crossmodal transfer strategies that selectively reuse prior knowledge to adapt to new situations, and (4) improve dexterous manipulation skills online in dynamic environments. Overall, this project will explore novel ways to represent, learn and transfer crossmodal information for dexterous motor abilities.