Publication
ARCHIE2: An Augmented Reality Interface with Plant Detection for Future Planetary Surface Greenhouses
Conrad Zeidler; Matthias Klug; Gerrit Woeckner; Urte Clausen; Johannes Schöning
In: IEEE. IEEE International Symposium on Mixed and Augmented Reality (ISMAR-2023), 22nd IEEE International Symposium on Mixed and Augmented Reality (ISMAR), located at ISMAR, October 16-20, Sydney, New South Wales, Australia, N.A. 2023.
Abstract
More than 50 years after the last human set foot on the Moon duringthe Apollo 17 mission, humans aim to return to the Moon in thisdecade. This time, humanity plans to establish lunar habitats for asustainable longer presence. An integrated part of these lunarhabitats will be planetary surface greenhouses. These greenhouseswill produce food, process air, recycle water, and improve thepsychological well-being of humans. Past research has shown thata large amount of crew time, a scarce and valuable resource inspaceflight, is needed for maintenance and repairs in a planetarysurface greenhouse, leaving less time for crop cultivation andscience activities. In this paper, we present the concept of anaugmented reality interface named ARCHIE² to reduce crew timeand the workload of astronauts and remote support teams on Earthto operate a planetary surface greenhouse. ARCHIE² allows usersto visualize status information on plants, technical systems, andenvironmental parameters in the greenhouse or other featuressupporting the greenhouse operations using an augmented realityheadset. In particular, we report on the implementation andperformance of the ARCHIE² plant detection module that runslocally on the augmented reality headset. Using images with aresolution of 320x192 pixels, arugula selvatica plants were detectedusing an artificial neural network (based on a YOLOv5s model)from a horizontal distance up to 50 cm with an average inferencetime of 602 ms and an average of 48 FPS. Based on that, the plantswere augmented with labels to visualize relevant plant-specificinformation supporting astronauts in the maintenance of the plants
(PDF) ARCHIE2: An Augmented Reality Interface with Plant Detection for Future Planetary Surface Greenhouses. Available from: https://www.researchgate.net/publication/374004694_ARCHIE2_An_Augmented_Reality_Interface_with_Plant_Detection_for_Future_Planetary_Surface_Greenhouses#fullTextFileContent [accessed Sep 29 2023].