Test and Artificial Intelligence -- Learning a Behavior Model of Hybrid Systems through Combining Model-Based Testing and Machine Learning -- Regular expression learning with evolutionary testing and repair -- Testing Chatbots using Metamorphic Relations -- Generating Biased Dataset for Metamorphic Testing of Machine Learning Programs -- Test Case Generation -- Combining Model Refinement and Test Generation for Conformance Testing of the IEEE PHD Protocol using Abstract State Machines -- Evaluating the complexity of deriving adaptive homing, synchronizing and distinguishing sequences for nondeterministic FSMs -- Multiple Mutation Testing for Timed Finite State Machine With Timed Guards and Timeouts -- Empirical Approaches -- An Empirical Evaluation of Search Algorithms for App Testing -- Performance comparison of two search-based testing strategies for ADAS System Validation -- Testing and Verification Techniques -- Bounded Exhaustive Testing with Certified and OptimizedData Enumeration Programs -- A Mechanised Proof of an Adaptive State Counting Algorithm -- A Model Checking based Approach for Detecting SDN Races -- Security and Performance Testing -- Towards an Efficient Performance Testing through Dynamic Workload Adaptation -- DYNAMOJM: A JMeter Tool for Performance Testing using Dynamic Workload Adaptation -- Attack tolerance for service-based applications in the Cloud -- Industrial Applications -- Automatic generation of test oracles from component based software architectures -- Industrial IoT Security Monitoring and Test on Fed4Fire+ Platforms -- TestDCat: Catalog of Test Debt Subtypes and Management Activities.

This book constitutes the refereed proceedings of the 31st IFIP WG 6.1 International Conference on Testing Software and Systems, ICTSS 2019, held in Paris, France, in October 2019. The 14 regular papers and 3 short papers presented were carefully reviewed and selected from 30 submissions. This year also included an additional industrial paper. ICTSS is a series of international conferences addressing the conceptual, theoretic, and practical problems of testing software systems, including communication protocols, services, distributed platforms, middleware, embedded and cyber-physical systems, and security infrastructures.