Publication
Designing an Adaptable Benchmark and Competition Simulation for Integrated Planning and Execution
Liudvikas Nemiro; Gerard Canal; Oscar Lima; Michael Cashmore; Mark Roberts
In: Workshop on the International Planning Competition (WIPC). International Conference on Automated Planning and Scheduling (ICAPS-2021), located at ICAPS 2021, August 2-13, Guangzhou, China, AAAI, Palo Alto, California USA, 8/2021.
Abstract
Effectively using a planning system as the executive of an agent acting in real time poses a variety of challenges in integrating planning and execution. Many integrated systems have been developed with a focus on particular challenges, and it has been typically difficult to test, benchmark, and compare these systems. To do so requires a benchmark that has transparent and well-defined rules, and can be adapted to exhibit the problem characteristics of interest. In this paper, we propose a new benchmark simulation for integrated planning and execution, designed to be accessible and adaptive. We describe the simple core scenario of the simulation and how it can be configured to present more challenging scenarios. We describe our plans for the development of the simulation as a competition, benchmarking, and teaching tool, and encourage the community to contribute to its design.