Deformation equivariant cross-modality image synthesis with paired non-aligned training data

Joel Honkamaa, Umair Khan, Sonja Koivukoski, Mira Valkonen, Leena Latonen, Pekka Ruusuvuori, Pekka Marttinen

    Research output: Contribution to journalArticleScientificpeer-review

    4 Downloads (Pure)


    Cross-modality image synthesis is an active research topic with multiple medical clinically relevant applications. Recently, methods allowing training with paired but misaligned data have started to emerge. However, no robust and well-performing methods applicable to a wide range of real world data sets exist. In this work, we propose a generic solution to the problem of cross-modality image synthesis with paired but non-aligned data by introducing new deformation equivariance encouraging loss functions. The method consists of joint training of an image synthesis network together with separate registration networks and allows adversarial training conditioned on the input even with misaligned data. The work lowers the bar for new clinical applications by allowing effortless training of cross-modality image synthesis networks for more difficult data sets.

    Original languageEnglish
    Article number102940
    Number of pages13
    JournalMedical Image Analysis
    Publication statusPublished - 2023
    Publication typeA1 Journal article-refereed


    • Cross-modality image synthesis
    • Image registration
    • Image-to-image translation

    Publication forum classification

    • Publication forum level 3

    ASJC Scopus subject areas

    • Radiological and Ultrasound Technology
    • Radiology Nuclear Medicine and imaging
    • Computer Vision and Pattern Recognition
    • Health Informatics
    • Computer Graphics and Computer-Aided Design


    Dive into the research topics of 'Deformation equivariant cross-modality image synthesis with paired non-aligned training data'. Together they form a unique fingerprint.

    Cite this