Publication
InfoSalGAIL: Visual Attention-Empowered Imitation Learning of Pedestrians in Critical Traffic Scenarios
Igor Vozniak; Matthias Klusch; Andre Antakli; Christian Mueller
In: Proceedings of 12th IEEE International Conference on Neural Computation Theory and Application. IEEE International Conference on Neural Computation Theory and Application (NCTA-2020), located at 12th International Joint Conference on Computational Intelligence (IJCCI), IEEE, 2020.
Abstract
The imitation learning of complex pedestrian behaviour based on visual input is a challenge due to the underlying large state space and variations. In this paper, we present a novel visual attention-based imitation learning framework, named InfoSalGAIL, for end-to-end imitation learning of (safe, unsafe) pedestrian navigation policies through visual expert demonstrations empowered by eye fixation sequence and augmented reward function. This work shows the relation in latent space between the policy estimated trajectories and visual-attention map. Moreover, the conducted experiments revealed that InfoSalGAIL can significantly outperform the state-of-the-art baseline InfoGAIL. In fact, its visual attention-empowered imitation learning tends to much better generalize the overall policy of pedestrian behavior leveraging apprenticeship learning to generate more human-like pedestrian trajectories in virtual traffic scenes with the open source driving simulator OpenDS. InfoSalGAIL can be utilized in the process of generating and validating critical scenarios for adaptive driving assistance systems.