Projects


With our Helmholtz Imaging Projects, Helmholtz Foundation Model Initiative (HFMI) and third-party funded projects, we aim to initiate cross-cutting research collaborations and identify innovative research topics in the field of imaging and data science.

Helmholtz Imaging offers a funding line of Helmholtz Imaging Projects, striving to seed collaborations between centers and across research fields. They are a strong incentive to enable interdisciplinary collaboration across the Helmholtz Association and an incubator and accelerator of the Helmholtz Imaging network. 

In addition to our Helmholtz Imaging Projects, the Helmholtz Imaging team has secured external funding for third-party projects contributing their knowledge and expertise on cutting-edge imaging methodology. 

Join us in unlocking the limitless potential of Helmholtz Imaging!

Find out more about Helmholtz Imaging Project call in this summary.

Helmholtz Imaging Projects


Visual, Helmholtz Imaging Project POINTR, topic: Mapping Boreal Forest Change Using 3D Radar and Point Cloud Data
Image: Stefan Kruse

POINTR

Mapping Boreal Forest Change Using 3D Radar and Point Cloud Data

Global warming is reshaping northern boreal forests. This project maps forest structure and ecosystem services using high-resolution radar satellite monitoring combined with 3D imaging data.
Image of HI Project "CLARITY"
 

CLARITY

CineMR-guided ML-driven Breathing Models for Adaptive Radiotherapy

Dose-escalated radiotherapy of lung cancers requires precise monitoring of lesions and nearby organs at risk. Current methods are able to track ultra-central lesions but neglect their deforming vicinity, risking unacceptable toxicity to aortico-pulmonary structures. AI-based anomaly detection and generative AI models can address both requirements in real-time.
Hyperspectral data cube
Image: Aaron Christian Banze

HYPER-AMPLIFAI

Advancing Visual Foundation Models for Multi-/Hyperspectral Image Analysis in Agriculture/Forestry

The project aims to make advanced AI models accessible for Hyperspectral Earth Observation, reducing computational demands, and improving environmental assessments through user-friendly interfaces.

Helmholtz Foundation Model Initiative (HFMI) Projects


Microcosmos of the Ocean by Klas Ove Möller, Hereon
Image: NicoElNino on Shutterstock

AqQua

AqQua aims to build the first foundational pelagic imaging model using billions of aquatic images worldwide. These images, spanning species from plankton, will help an AI classify species, extract traits, and estimate carbon content, offering key insights into biodiversity, ecosystem health, and the biological carbon pump's role in climate regulation.
Image: NicoElNino on Shutterstock

The Human Radiome Project (THRP)

The Human Radiome Project (THRP) aims to drive a paradigm shift in medical research, providing novel insights into human health and disease through the power of AI. By integrating diverse radiological data, it seeks to enable groundbreaking advancements in personalized medicine, enhancing diagnostic accuracy and improving patient care.
decorative image
Image: NicoElNino on Shutterstock

Synergy Unit

The Synergy Unit amplifies the Helmholtz Foundation Model Initiative's impact by developing AI principles for diverse fields. Collaborating with HFMI projects, it focuses on knowledge sharing, community building, and representation to ensure the initiative's lasting influence.

UNLOCK – Benchmarking Projects


Visusal for SCHEMA;Metastases represent a significant exacerbation of tumor severity. If one could predict the likelihood of tumors metastasizing, this could inform treatment decisions to avoid or delay this outcome. SCHEMA develops a benchmark dataset of primary tumor samples and metadata on whether the tumor has metastasized at different time points after sampling. With this dataset, a challenge for machine learning scientists will be defined to build prognostic models for likelihood of tumors metastasizing, promoting innovation in prognostic modeling for a clinically relevant task.
Image: Hellmut Augustin, DKFZ (BSIC 2021 contribution)

SCHEMA – profiling Spatial Cancer HEterogeneity across modalities to benchmark Metastasis risk prediction

SCHEMA creates a benchmark dataset linking tumor samples with metastasis outcomes to enable machine-learning models that predict metastasis risk and support clinical decision-making.
Visual for Pero; Addressing the lack of standardized, FAIR benchmark datasets in perovskite photovoltaics. Pero enables reproducible AI models for efficiency prediction, material classification, and defect detection, which are critical for industrial scaling of sustainable energy technologies.
Image: Photo: Markus Breig, KIT; illustration: Felix Laufer, KIT

Pero – Unlocking ML Potential: Benchmark Datasets on Perovskite Thin Film Processing

Addressing the lack of standardized, FAIR benchmark datasets in perovskite photovoltaics. Pero enables reproducible AI models for efficiency prediction, material classification, and defect detection, which are critical for industrial scaling of sustainable energy technologies.
Visual for GRIDMARK; Transforming energy systems toward climate neutrality: Distribution grids have the potential to be catalysts for the energy transition. Unfortunately, most Distribution System Operators lack the resources to fully monitor their systems. Therefore, there is an urgent need for more high-quality data, particularly to develop and test machine learning models.
 

GRIDMARK – Generating Reproducible Insights through Data Benchmarking for AI in Energy Systems

Transforming energy systems toward climate neutrality: Distribution grids have the potential to be catalysts for the energy transition. Unfortunately, most Distribution System Operators lack the resources to fully monitor their systems. Therefore, there is an urgent need for more high-quality data, particularly to develop and test machine learning models.

Third-Party Projects


visual for third-party funded project UMDISTO
 

UMDISTO: Unsupervised Model Discovery

The project aims to develop novel methods for unsupervised multi-matching to map cellular-level correspondences in organisms like C. elegans.
BSIC 2023 contribution by Sebastian Dupraz (AG Bradke), DZNE; title: Stranger in the mirror
Image: Sebastian Dupraz (AG Bradke), DZNE

Spatio-temporal inverse approaches for EEG/MEG reconstruction of neural networks in the human brain

This project aims to develop novel methods for reconstructing brain activity from dynamic EEG and MEG measurements. By using realistic, individualized finite element models and advanced regularization techniques, including machine learning, we seek to solve this inverse problem in real patient settings, ultimately improving the diagnosis and treatment of medication-resistant focal epilepsy.
Decorative image
 

Deep Learning based Regularization for Inverse Problems

This project aims to investigate the construction of regularization methods for ill-posed inverse problems based on deep learning and their theoretical foundations. Specific objectives include the development of robust and interpretable results, requiring the initial development of new concepts of robustness and interpretability in this context.