09:00 - 09:05 | Welcome & Introduction | |
09:05 - 10:00 | Towards Just-in-time Mitigation of Performance Regression Introducing Changes
Weiyi (Ian) Shang | |
10:00 - 10:30 | CC4CS: an Off-the-Shelf Unifying Statement-Level Performance Metric for HW/SW Technologies
Luigi Pomante, Giacomo Valente, Vittoriano Muttillo, Fabio Salice, Fausto D'Antonio and Vincenzo Stoico | |
Coffee Break | ||
11:00 - 11:30 | Better Early Than Never: Performance Test Acceleration by Regression Test Selection
David Georg Reichelt and Stefan Kühne | |
11:30 - 12:00 | A Workload-Dependent Performance Analysis of an In-Memory Database in a Multi-Tenant Configuration
Dominik Paluch, Harald Kienegger and Helmut Krcmar | |
12:00 - 12:30 | JMeter vs. Gatling
Marius Oehler and Mario Mann | |
Lunch Break | ||
(The afternoon program will be shared with the QUDOS workshop.) | ||
13:30 - 14:30 | Model-Driven Software Performance Engineering - Challenges and Ways ahead
Manoj Nambiar | |
14:30 - 15:00 | Towards Automating Representative Load Testing in Continuous Software Engineering
Henning Schulz, Tobias Angerstein and Andre van Hoorn | |
Coffee Break | ||
15:30 - 16:00 | A Cloud Benchmark Suite Combining Micro and Applications Benchmarks
Joel Scheuner and Philipp Leitner | |
16:00 - 17:00 | Joint panel discussion | |
Software systems (e.g., smartphone apps, desktop applications, e-commerce systems, IoT infrastructures, big data systems, and enterprise systems, etc.) have strict requirements on software performance. Failure to meet these requirements will cause customer dissatisfaction and negative news coverage. In addition to conventional functional testing, the performance of these systems must be verified through load testing or benchmarking to ensure quality service. Load testing examines the behavior of a system by simulating hundreds or thousands of users performing tasks at the same time. Benchmarking evaluates a system's performance and allows to optimize system configurations or compare the system with similar systems in the domain.
Load testing and benchmarking software systems are difficult tasks, which requires a great understanding of the system under test and customer behavior. Practitioners face many challenges such as tooling (choosing and implementing the testing tools), environments (software and hardware setup) and time (limited time to design, test, and analyze). This one-day workshop brings together software testing researchers, practitioners and tool developers to discuss the challenges and opportunities of conducting research on load testing and benchmarking software systems.
We solicit the following two tracks of submissions: research papers (maximum 4 pages) and presentation track for industry or experience talks (maximum 700 words extended abstract). Technical papers should follow the standard ACM SIG proceedings format and need to be submitted electronically via EasyChair. Short abstracts for the presentation track need to be submitted as "abstract only" submissions via EasyChair. Accepted technical papers will be published in the ICPE 2018 Proceedings. Materials from the presentation track will not be published in the ICPE 2018 proceedings, but will be made available on the workshop website. Submitted papers can be research papers, position papers, case studies or experience reports addressing issues including but not limited to the following:
Research papers: | |
Presentation track: | Mar. 2, 2018 |
Paper notification: | Feb. 8, 2018 |
Presentation notification: | Mar. 9, 2018 |
Workshop date: | Apr. 10, 2018 |
Johannes Kroß | fortiss GmbH, Germany |
Cor-Paul Bezemer | Queen's University, Canada |
Adams, Bram | Polytechnique Montreal, Canada |
Bergel, Alexandre | University of Chile, Chile |
Brunnert, Andreas | RETIT GmbH, Germany |
Csallner, Christoph | University of Texas at Arlington, USA |
Eichelberger, Holger | University of Hildesheim, Germany |
Franks, Greg | Carleton University, Canada |
Garousi, Vahid | University of Luxembourg, Luxembourg |
Ghaith, Shadi | IBM, Ireland |
Heinrich, Robert | Karlsruher Institute of Technology, Germany |
van Hoorn, André | University of Stuttgart, Germany |
Horrox, Robert | EMC Isilon, USA |
Jamshidi, Pooyan | Carnegie Mellon University, USA |
Jiang, Zhen Ming (Jack) | York University, Canada |
Podelko, Alexander | Oracle, USA |
Shang, Weiyi | Concordia University, Canada |
Sunyé, Gerson | University of Nantes, France |
Ahmed E. Hassan | Queen’s University, Canada |
Marin Litoiu | York University, Canada |
Jiang, Zhen Ming (Jack) | York University, Canada |