In November 2025, the EndoPlan-3D research project, funded by the Federal Ministry of Research, Technology and Space (BMFTR), was officially launched. Under the coordination of Prof. Dr. Christoph Palm, head of the Regensburg Medical Image Computing (ReMIC) laboratory at OTH Regensburg, the project partners met for a joint kick-off meeting at OTH Regensburg to strategically prepare for the next four years of research and development.
The project aims to develop an AI-supported, interactive 3D environment that makes it easier and more precise for doctors to plan endoscopic procedures for early tumours of the gastrointestinal tract. Until now, these decisions have been based primarily on two-dimensional endoscopy images, which are difficult to interpret and can lead to varying assessments. This influences both the choice of procedure and its chances of success.
Realistic 3D models of the tumour
EndoPlan-3D addresses precisely this challenge: endoscopy and ultrasound data are combined to create realistic 3D models of the tumour and adjacent tissue. The models integrate information on tissue elasticity to better visualise critical areas (‘hotspots’) and possible tumour invasions. A VR-based interactive environment supports medical professionals in planning the optimal endoscopic procedure.
The combination of artificial intelligence, 3D reconstruction, and acoustic and haptic feedback is intended to improve the quality of treatment, reduce misjudgements, and lower the risk of recurrence. The technical implementation, in particular AI-based image processing and 3D modelling, is carried out at OTH Regensburg in the ReMIC laboratory, which specialises in medical image analysis and AI processes.
Improving precision surgery for cancer
OTH Regensburg is coordinating the project. Project partners are Erbe Elektromedizin GmbH from Tübingen, Augsburg University Hospital (Prof. Dr. Helmut Messmann) and the University of Augsburg (Prof. Dr. Elisabeth André). The project will run until October 2029.
EndoPlan-3D is part of the BMFTR's ‘AI-assisted precision surgery in oncology (KIOn)’ funding programme. This programme supports research projects that develop interactive AI technologies to improve precision surgery for cancer. KIOn's total funding amounts to approximately €17.2 million.
