Software Evaluation Corner
Artifact Evaluation at ESEC/FSE 2013
Results presented in technical papers are often validated or supported by software artifacts. To reward the effort of creating artifacts, authors of accepted research paper may, if they wish, have their tools, data or model evaluated by the Artifact Evaluation Committee.
After the research paper notification of ESEC/FSE 2013, authors of accepted papers will be contacted to submit their artifact for evaluation. Evaluation of the artifact will be sent to the authors before the camera ready deadline.
Artifacts that are positively evaluated, will be formally recognized in the proceedings and at the conference.
Distinguished Artifacts
There are 2 artifacts that deserved to be distinguished:
Paul Marinescu and Cristian Cadar. KATCH: High-Coverage Testing of Software Patches
Aravind Machiry, Rohan Tahiliani and Mayur Naik. Dynodroid: An Input Generation System for Android Apps
Submission Summary
Due on: Sunday June 2nd 2013 (end of the week of the paper notification) – CLOSED
Notification from the AEC: Monday June 24, 2013 (one week before the camera ready version) – PASSED
-
-
Process
Artifacts will be evaluated in a similar fashion than papers are. They will be reviewed by a committee (the Artifact Evaluation Committee, AEC) and graded according to what your accepted paper describes.
Software artifacts who successfully passed our evaluation will be officially recognized (in the proceedings, during the conference, during the social event presentation). Fireworks will be for the distinguished software artifacts.
Artifacts Meeting Expectation
In total we have received 22 artifacts. 12 have been assessed as “met expectation” or “Exceeded expectations”. Below is the list of artifacts that have been positively evaluated.
Out of the 12 positively evaluated artifacts, 8 will be presented on Friday 23 August 2013, during a dedicated slot 17:00 - 17:40.
Each presentation will have 5 minutes:
Paul Marinescu and Cristian Cadar – KATCH: High-Coverage Testing of Software Patches
Dirk Beyer, Stefan Löwe, Evgeny Novikov, Andreas Stahlbauer and Philipp Wendler –
Linux Driver Revisions for Regression Verification - online Shahar Maoz, Jan Oliver Ringert and Bernhard Rumpe – Synthesis of Component and Connector Models from Crosscutting Structural Views
Marin Silic, Goran Delac and Sinisa Srbljic –
Prediction of Atomic Web Services Reliability Based on K-means Clustering online Nishant Sinha and Rezwana Karim –
Compiling Mockups to Flexible UIs online video Alex Gyori, Danny Dig, Lyle Franklin and Jan Lahoda –
Crossing the gap from imperative to functional programming through refactoring online Peng Liu – Finding Incorrect Compositions of Atomicity
Yunhui Zheng, Xiangyu Zhang and Vijay Ganesh – Z3-str: A String Theory Plugin on Z3 for Web Application Analysis
The remaining 4 artifacts will be presented during their paper presentation slot:
Meiyappan Nagappan, Thomas Zimmermann and Christian Bird –
Diversity in Software Engineering Research – online Chengnian Sun and Siau-Cheng Khoo – Mining Succinct Predicated Bug Signatures
Aravind Machiry, Rohan Tahiliani and Mayur Naik –
Dynodroid: An Input Generation System for Android Apps online Pietro Braione, Giovanni Denaro and Mauro Pezze' – Enhancing Symbolic Execution with Built-in Term Rewriting and Constrained Lazy Initialization
Artifact Evaluation Committee
The committee has been carefully selected by the chairs to reflect the relevant topics of ESEC/FSE.
-
-
-
-
-
Wei Jin, Georgia Institute of Technology, USA
-
-
-
-
-
-
Chairs:
Other Artifact Evaluation Committees