The GRATA project is developing a modular education and training system for robot-assisted surgery. GenKI base models are being expanded into medical language models and combined with semantic knowledge models to generate instructions and dialogues. The system collects sensor and robot data, checks processes, provides adaptive feedback, and is being validated for ophthalmological procedures.
- Official Project Website: https://augenklinik.mri.tum.de/de/grata
- Founded by:German Federal Ministry of Research, Technology and Space (BMFTR)
- Volume: €2.33 Million
- Period: 2025-2028
-
Our Role: Project Coordinator, Co-Principal Investigator
This project investigates how humans process multisensory information during highly complex tasks and how multisensory feedback can improve performance and usability. While most AI systems rely heavily on visual interfaces, this can lead to cognitive overload in demanding environments such as surgery.
By combining artificial intelligence, machine learning, and multisensory feedback, particularly auditory cues, the project aims to enhance surgical navigation systems and better support human perception and decision-making. Human performance will be studied in both laboratory and real-world surgical settings through an interdisciplinary collaboration between experts in perception research, AI, and medicine.
- Official Project Website: tba
- Founded by: German Research Foundation (DFG)
- Volume: €787k
- Period: 2025-2028
- Our Role: Co-Principal Investigator
The introduction of robotic assistance systems into the clinical workflow leads to a significant increase in technical, social and organizational complexity in the operating theatre. With ForNeRo, we aim to improve the integration of the systems, taking into account the needs and capacities of the OR staff. This is to be realized with the support of machine learning, simulation, augmented reality and UI technologies. The focus of the investigations is on the optimal placement and use of the robotic systems.
- Official Project Website: https://fornero.ed.tum.de/
- Founded by: Bayerische Forschungsstiftung (BFS)
- Volume: €1.98 Million
- Period: 2023-2027
-
Our Role: Project Coordinator, Co-Principal Investigator
Industrial project in collaboration with NSK Ltd. Japan, focusing on the development of a clinical haptic input device (controller) and a high-precision micro-injection pump.
- Founded by: NSK Ltd Japan
- Volume: €830k
- Period: 2020-2027
- Our Role: Solo Principal Investigator
BiRoMicO
In BiRoMicO together with Munich Surgical Imaging, we are improving our image-guided robotic and intraoperative diagnosis platform for ophthalmology by integrating digital microscopy and a 3D heads-up display.
- Founded by: Bayerische Forschungsstiftung (BFS)
- Volume: €511k
- Period: 2021-2024
- Our Role: Co-Principal Investigator