Publikation
Synthesizing Annotated Cell Microscopy Images with Generative Adversarial Networks
Duway Nicolas Lesmes Leon; Miro Miranda Lorenz; Maria Caroprese; Gillian Lovell; Andreas Dengel; Sheraz Ahmed
In: Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART. International Conference on Agents and Artificial Intelligence (ICAART-2025), 17th International Conference on Agents and Artificial Intelligence, located at ICAART-2025, February 23-25, Hotel Vila Gale Porto, Portugal, Pages 592-599, ISBN 978-989-758-737-5, SciTePress, 2025.
Zusammenfassung
Data scarcity and annotation limit the quantitation of cell microscopy images. Data acquisition, preparation, and annotation are costly and time-consuming. Additionally, cell annotation is an error-prone task that requires personnel with specialized knowledge. Generative artificial intelligence is an alternative to alleviate these limitations by generating realistic images from an unknown data probabilistic distribution. Still, extra effort is needed since data annotation remains an independent task of the generative process. In this work, we assess whether generative models learn meaningful instance segmentation-related features, and their potential to produce realistic annotated images. We present a single-channel grayscale segmentation mask pipeline that differentiates overlapping objects while minimizing the number of labels. Additionally, we propose a modified version of the established StyleGAN2 generator that synthesizes images and segmentation masks simultaneously without additional components. We tested our generative pipeline with LIVECell and TissueNet, two benchmark cell segmentation datasets. Furthermore, we augmented a segmentation deep learning network with synthetic samples and illustrated improved or on-par performance compared to its non-augmented version. Our results support that the features learned by generative models are relevant in the annotation context. With adequate data preparation and regularization, generative models are capable of producing realistic annotated samples cost-effectively.
Projekte
- MMISS - Multimedia - Instruktion in Sicheren Systemen
- SDSD - Smarte Daten, Smarte Dienste. Landwirtschaftliche Datendrehscheibe für effiziente ressourcenschonende Prozesse