Dr. rer. nat. Fabian Isensee

Head of Applied Computer Vision Lab Support Unit DKFZ

During his PhD at the Division of Medical Image Computing of the German Cancer Research Center, Fabian Isensee has researched deep learning techniques for semantic segmentation of (three-dimensional) datasets in the biological and medical domain. He has been particularly active in the development of methods for automated segmentation pipeline design. His most prominent effort in that regard, nnU-Net, has become the de-facto standard for segmentation in the medical domain and was recently accepted for publication in Nature Methods. Throughout his PhD, Fabian Isensee has consistently enabled the translation of state-of-the-art algorithms into real-world applications. He is furthermore adamant about making his research publicly available. The methods he developed have won multiple international segmentation competitions.

Since 2020, Fabian Isensee is heading the HI Support Unit ‘Applied Computer Vision Lab’ at the DKFZ with the goal of translating state-of-the-art AI methods to the many diverse research applications found across the Helmholtz association. The support unit is working in close collaboration with Helmholtz researchers, provides consulting, develops domain agnostic state-of-the art software for AI-based image analysis and provides solutions for algorithm and competition evaluation.

Publications

Gutsche, R., Lowis, C., Ziemons, K., Kocher, M., Ceccon, G., Brambilla, C. R., Shah, N. J., Langen, K.-J., Galldiks, N., Isensee, F., & Lohmann, P. (2023). Automated Brain Tumor Detection and Segmentation for Treatment Response Assessment Using Amino Acid PET. Journal of Nuclear Medicine: Official Publication, Society of Nuclear Medicine, jnumed.123.265725. https://doi.org/10.2967/jnumed.123.265725

Wald, T., Ulrich, C., Isensee, F., Zimmerer, D., Koehler, G., Baumgartner, M., & Maier-Hein, K. H. (2023). Exploring new ways: Enforcing representational dissimilarity to learn new features and reduce error consistency (arXiv:2307.02516). arXiv. https://doi.org/10.48550/arXiv.2307.02516

Eisenmann, M., Reinke, A., Weru, V., Tizabi, M. D., Isensee, F., Adler, T. J., Ali, S., Andrearczyk, V., Aubreville, M., Baid, U., Bakas, S., Balu, N., Bano, S., Bernal, J., Bodenstedt, S., Casella, A., Cheplygina, V., Daum, M., de Bruijne, M., … Maier-Hein, L. (2023). Why is the winner the best? (arXiv:2303.17719). arXiv. https://doi.org/10.48550/arXiv.2303.17719

Roß, T., Bruno, P., Reinke, A., Wiesenfarth, M., Koeppel, L., Full, P. M., Pekdemir, B., Godau, P., Trofimova, D., Isensee, F., Adler, T. J., Tran, T. N., Moccia, S., Calimeri, F., Müller-Stich, B. P., Kopp-Schneider, A., & Maier-Hein, L. (2023). Beyond rankings: Learning (more) from algorithm validation. Medical Image Analysis, 102765. https://doi.org/10.1016/j.media.2023.102765

Reinke, A., Tizabi, M. D., Baumgartner, M., Eisenmann, M., Heckmann-Nötzel, D., Kavur, A. E., Rädsch, T., Sudre, C. H., Acion, L., Antonelli, M., Arbel, T., Bakas, S., Benis, A., Blaschko, M., Büttner, F., Cardoso, M. J., Cheplygina, V., Chen, J., Christodoulou, E., … Maier-Hein, L. (2023). Understanding metric-related pitfalls in image analysis validation (arXiv:2302.01790). arXiv. http://arxiv.org/abs/2302.01790

Maška, M., Ulman, V., Delgado-Rodriguez, P., Gómez-de-Mariscal, E., Nečasová, T., Guerrero Peña, F. A., Ren, T. I., Meyerowitz, E. M., Scherr, T., Löffler, K., Mikut, R., Guo, T., Wang, Y., Allebach, J. P., Bao, R., Al-Shakarji, N. M., Rahmon, G., Toubal, I. E., Palaniappan, K., … Ortiz-de-Solórzano, C. (2023). The Cell Tracking Challenge: 10 years of objective benchmarking. Nature Methods, 20(7), 1010–1020. https://doi.org/10.1038/s41592-023-01879-y

Roy, S., Koehler, G., Ulrich, C., Baumgartner, M., Petersen, J., Isensee, F., Jaeger, P. F., & Maier-Hein, K. (2023). MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentation. https://doi.org/10.48550/ARXIV.2303.09975

Eisenmann, M., Reinke, A., Weru, V., Tizabi, M. D., Isensee, F., Adler, T. J., Godau, P., Cheplygina, V., Kozubek, M., Ali, S., Gupta, A., Kybic, J., Noble, A., de Solórzano, C. O., Pachade, S., Petitjean, C., Sage, D., Wei, D., Wilden, E., … Maier-Hein, L. (2022). Biomedical image analysis competitions: The state of current participation practice (arXiv:2212.08568). arXiv. https://doi.org/10.48550/arXiv.2212.08568

Roth, H. R., Xu, Z., Tor-Díez, C., Sanchez Jacob, R., Zember, J., Molto, J., Li, W., Xu, S., Turkbey, B., Turkbey, E., Yang, D., Harouni, A., Rieke, N., Hu, S., Isensee, F., Tang, C., Yu, Q., Sölter, J., Zheng, T., … Linguraru, M. G. (2022). Rapid artificial intelligence solutions in a pandemic—The COVID-19-20 Lung CT Lesion Segmentation Challenge. Medical Image Analysis, 82, 102605. https://doi.org/10.1016/j.media.2022.102605

Ostmeier, S., Axelrod, B., Bertels, J., Isensee, F., Lansberg, M. G., Christensen, S., Albers, G. W., Li, L.-J., & Heit, J. J. (2022). USE-Evaluator: Performance Metrics for Medical Image Segmentation Models with Uncertain, Small or Empty Reference Annotations (arXiv:2209.13008). arXiv. https://doi.org/10.48550/arXiv.2209.13008

Zimmerer, D., Full, P. M., Isensee, F., Jäger, P., Adler, T., Petersen, J., Köhler, G., Ross, T., Reinke, A., Kascenas, A., Jensen, B. S., O’Neil, A. Q., Tan, J., Hou, B., Batten, J., Qiu, H., Kainz, B., Shvetsova, N., Fedulova, I., … Maier-Hein, K. (2022). MOOD 2020: A Public Benchmark for Out-of-Distribution Detection and Localization on Medical Images. IEEE Transactions on Medical Imaging, 41(10), 2728–2738. https://doi.org/10.1109/TMI.2022.3170077

Maier-Hein, L., Reinke, A., Godau, P., Tizabi, M. D., Christodoulou, E., Glocker, B., Isensee, F., Kleesiek, J., Kozubek, M., Reyes, M., Riegler, M. A., Wiesenfarth, M., Baumgartner, M., Eisenmann, M., Heckmann-Nötzel, D., Kavur, A. E., Rädsch, T., Acion, L., Antonelli, M., … Jäger, P. F. (2022). Metrics reloaded: Pitfalls and recommendations for image analysis validation (arXiv:2206.01653). arXiv. https://doi.org/10.48550/arXiv.2206.01653

Yang, L., Liu, Q., Kumar, P., Sengupta, A., Farnoud, A., Shen, R., Trofimova, D., Kutschke, D., Piraud, M., Isensee, F., Burgstaller, G., Rehberg, M., Stoeger, T., & Schmid, O. (2022). Multimodal 4D imaging and deep learning unveil acinar migration of tissue-resident, nanoparticle-laden macrophages in the lung. European Respiratory Journal, 60(suppl 66). https://doi.org/10.1183/13993003.congress-2022.407

Isensee, F., Ulrich, C., Wald, T., & Maier-Hein, K. H. (2022). Extending nnU-Net is all you need (arXiv:2208.10791). arXiv. https://doi.org/10.48550/arXiv.2208.10791

Vollmuth, P., Foltyn, M., Huang, R. Y., Galldiks, N., Petersen, J., Isensee, F., van den Bent, M. J., Barkhof, F., Park, J. E., Park, Y. W., Ahn, S. S., Brugnara, G., Meredig, H., Jain, R., Smits, M., Pope, W. B., Maier-Hein, K., Weller, M., Wen, P. Y., … Bendszus, M. (2022). AI-based decision support improves reproducibility of tumor response assessment in neuro-oncology: an international multi-reader study. Neuro-Oncology, noac189. https://doi.org/10.1093/neuonc/noac189

Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B. A., Litjens, G., Menze, B., Ronneberger, O., Summers, R. M., van Ginneken, B., Bilello, M., Bilic, P., Christ, P. F., Do, R. K. G., Gollub, M. J., Heckers, S. H., Huisman, H., Jarnagin, W. R., … Cardoso, M. J. (2022). The Medical Segmentation Decathlon. Nature Communications, 13(1), 4128. https://doi.org/10.1038/s41467-022-30695-9

Reinke, A., Tizabi, M. D., Sudre, C. H., Eisenmann, M., Rädsch, T., Baumgartner, M., Acion, L., Antonelli, M., Arbel, T., Bakas, S., Bankhead, P., Benis, A., Cardoso, M. J., Cheplygina, V., Christodoulou, E., Cimini, B., Collins, G. S., Farahani, K., van Ginneken, B., … Maier-Hein, L. (2022). Common Limitations of Image Processing Metrics: A Picture Story (arXiv:2104.05642). arXiv. https://doi.org/10.48550/arXiv.2104.05642

Assalauova, D., Ignatenko, A., Isensee, F., Trofimova, D., & Vartanyants, I. A. (2022). Classification of diffraction patterns using a convolutional neural network in single-particle-imaging experiments performed at X-ray free-electron lasers. Journal of Applied Crystallography, 55(3), 444–454. https://doi.org/10.1107/S1600576722002667

Schellenberg, M., Dreher, K. K., Holzwarth, N., Isensee, F., Reinke, A., Schreck, N., Seitel, A., Tizabi, M. D., Maier-Hein, L., & Gröhl, J. (2022). Semantic segmentation of multispectral photoacoustic images using deep learning. Photoacoustics, 26, 100341. https://doi.org/10.1016/j.pacs.2022.100341

Yang, L., Shen, R., Trofimova, D., Stöger, T., Piraud, M., Isensee, F., & Schmid, O. (2022). Deep learning in pulmonary drug delivery. ERJ Open Research, 8(suppl 8). https://doi.org/10.1183/23120541.LSC-2022.190

Pflüger, I., Wald, T., Isensee, F., Schell, M., Meredig, H., Schlamp, K., Bernhardt, D., Brugnara, G., Heußel, C. P., Debus, J., Wick, W., Bendszus, M., Maier-Hein, K. H., & Vollmuth, P. (2022). Automated detection and quantification of brain metastases on clinical MRI data using artificial neural networks. Neuro-Oncology Advances, 4(1), vdac138. https://doi.org/10.1093/noajnl/vdac138

Roß, T., Reinke, A., Full, P. M., Wagner, M., Kenngott, H., Apitz, M., Hempe, H., Mindroc-Filimon, D., Scholz, P., Tran, T. N., Bruno, P., Arbeláez, P., Bian, G.-B., Bodenstedt, S., Bolmgren, J. L., Bravo-Sánchez, L., Chen, H.-B., González, C., Guo, D., … Maier-Hein, L. (2021). Comparative validation of multi-instance instrument segmentation in endoscopy: Results of the ROBUST-MIS 2019 challenge. Medical Image Analysis, 70, 101920. https://doi.org/10.1016/j.media.2020.101920

Isensee, F., Jaeger, P. F., Kohl, S. A. A., Petersen, J., & Maier-Hein, K. H. (2021). nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nature Methods, 18(2), 203–211. https://doi.org/10.1038/s41592-020-01008-z

Baumgartner, M., Jäger, P. F., Isensee, F., & Maier-Hein, K. H. (2021). nnDetection: A Self-configuring Method for Medical Object Detection. In M. de Bruijne, P. C. Cattin, S. Cotin, N. Padoy, S. Speidel, Y. Zheng, & C. Essert (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 (pp. 530–539). Springer International Publishing. https://doi.org/10.1007/978-3-030-87240-3_51

Schell, M., Pflüger, I., Brugnara, G., Isensee, F., Neuberger, U., Foltyn, M., Kessler, T., Sahm, F., Wick, A., Nowosielski, M., Heiland, S., Weller, M., Platten, M., Maier-Hein, K. H., Von Deimling, A., Van Den Bent, M. J., Gorlia, T., Wick, W., Bendszus, M., & Kickingereder, P. (2020). Validation of diffusion MRI phenotypes for predicting response to bevacizumab in recurrent glioblastoma: post-hoc analysis of the EORTC-26101 trial. Neuro-Oncology, 22(11), 1667–1676. https://doi.org/10.1093/neuonc/noaa120

Full, P. M., Isensee, F., Jäger, P. F., & Maier-Hein, K. (2020). Studying Robustness of Semantic Segmentation under Domain Shift in cardiac MRI (arXiv:2011.07592). arXiv. https://doi.org/10.48550/arXiv.2011.07592

Isensee, F., Jaeger, P. F., Full, P. M., Vollmuth, P., & Maier-Hein, K. H. (2020). nnU-Net for Brain Tumor Segmentation (arXiv:2011.00848). arXiv. https://doi.org/10.48550/arXiv.2011.00848

Kickingereder, P., Brugnara, G., Hansen, M. B., Nowosielski, M., Pflüger, I., Schell, M., Isensee, F., Foltyn, M., Neuberger, U., Kessler, T., Sahm, F., Wick, A., Heiland, S., Weller, M., Platten, M., von Deimling, A., Maier-Hein, K. H., Østergaard, L., van den Bent, M. J., … Bendszus, M. (2020). Noninvasive Characterization of Tumor Angiogenesis and Oxygenation in Bevacizumab-treated Recurrent Glioblastoma by Using Dynamic Susceptibility MRI: Secondary Analysis of the European Organization for Research and Treatment of Cancer 26101 Trial. Radiology, 297(1), 164–175. https://doi.org/10.1148/radiol.2020200978

Zimmerer, D., Isensee, F., Petersen, J., Kohl, S., & Maier-Hein, K. (2020). Abstract: Unsupervised Anomaly Localization Using Variational Auto-Encoders. In T. Tolxdorff, T. M. Deserno, H. Handels, A. Maier, K. H. Maier-Hein, & C. Palm (Eds.), Bildverarbeitung für die Medizin 2020 (pp. 199–199). Springer Fachmedien. https://doi.org/10.1007/978-3-658-29267-6_43

Laufer, F., Ziegler, S., Schackmar, F., Moreno Viteri, E. A., Götz, M., Debus, C., Isensee, F., & Paetzold, U. W. (n.d.). Process Insights into Perovskite Thin-Film Photovoltaics from Machine Learning with In Situ Luminescence Data. Solar RRL, n/a(n/a), 2201114. https://doi.org/10.1002/solr.202201114