TUPLES’ members papers at the 2023 ICAPS Conference

Automatic Metamorphic Test Oracles for Action-Policy Testing AUTHORS: Jan Eisenhut, Álvaro Torralba, Maria Christakis and Joerg Hoffmann

Learned action policies π can be used to make real-time decisions in dynamic environments; one simply evaluates the policy on the current state in order to obtain the next action. Yet, this raises obvious concerns regarding potential policy “bugs”, that is, undesirable or even fatal policy behavior in particular situations. Testing – searching for bugs – is a natural paradigm to address these concerns.

A central component of action-policy testing are test oracles, which are responsible for recognizing states to be bugs. In the context of this paper, this means that, given a query state t, a test oracle attempts to establish that the behavior of π on t is sub-optimal. Recent work introduced metamorphic oracles realizing this by comparing the behavior of π on state pairs where one of the states is known to be easier to solve, i.e., if π performs better on a more difficult state s than on a simpler state t, then its behavior on t must be sub-optimal so that t must be a bug.

This paper shows how to automatically design such oracles based on simulation relations between states. It introduces two oracle families of this kind: first, morphing query states t to obtain suitable s; second, maintaining and comparing upper bounds on the cost of optimal plans for the states encountered during testing. Experiments show that these new oracles can find bugs much more quickly than the existing (search-based) alternatives and that the combination of the new oracles with search-based ones almost consistently dominates all other oracles.

You can view the paper here

 

The International Conference on Automated Planning and Scheduling (ICAPS) is the premier forum for exchanging news and research results on the theory and applications of intelligent and automated planning and scheduling technology. ICAPS 2023 is part of the ICAPS conference series. After three years of virtual events, ICAPS 2023 will be a physical conference again. ICAPS 2023 will be held July 8-13, 2023, in Prague, Czech Republic.

https://icaps23.icaps-conference.org/

Latest News

AI in the places where it's actually done, with little media hype and a lot of hard work.

Daniel Höller, Jörg Hoffmann, Marcel Steinmetz and our chief coordinator Sylvie Thiebaux are in the organizing committee of the upcoming third Workshop on Reliable Data-Driven Planning and Scheduling (RDDPS) that is being held within The International Conference on Automated Planning and Scheduling (ICAPS) the premier forum for researchers and practitioners in planning and scheduling.

The manufacturing use case is based on well-known scheduling and resource allocation and planning challenges and this use case has a number of special features that make the challenge much more complex. The use case has two applications: robust scheduling of resources and resource allocation for rack systems.

Online collaboration is working fine but sometimes meeting face to face is really a good thing. So we did it for the third time in KU Leuven.