Speech-based Medical Decision Support in VR using a Deep Neural Network (Demonstration)

Alexander Prange, Michael Barz, Daniel Sonntag

In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17. International Joint Conference on Artificial Intelligence (IJCAI-17) Pages 5241-5242 IJCAI 2017.


We present a speech dialogue system that facilitates medical decision support for doctors in a virtual re- ality (VR) application. The therapy prediction is based on a recurrent neural network model that incorporates the examination history of patients. A central supervised patient database provides input to our predictive model and allows us, first, to add new examination reports by a pen-based mobile application on-the-fly, and second, to get therapy prediction results in real-time. This demo includes a visualisation of patient records, radiology image data, and the therapy prediction results in VR.


Weitere Links

2017_Speech-based_Medical_Decision_Support_in_VR_using_a_Deep_Neural_Network.pdf (pdf, 1 MB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz