Finding failures from passed test cases: improving the pattern classification approach to the testing of mesh simplification programs

Abstract:Mesh simplification programs create three-dimensional polygonal models similar to an original polygonal model, and yet use fewer polygons. They produce different graphics even though they are based on the same original polygonal model. This results in a test oracle problem. To address the problem, our previous work has developed a technique that uses a reference model of the program under test to train a classifier. Using such an approach may mistakenly mark a failure-causing test case as passed. It lowers the testing effectiveness of revealing failures. This paper suggests piping the test cases marked as passed by a statistical pattern classification module to an analytical metamorphic testing module. We evaluate our approach empirically using three subject programs with over 2700 program mutants. The result shows that, using a resembling reference model to train a classifier, the integrated approach can significantly improve the failure detection effectiveness of the pattern classification approach. We also explain how metamorphic testing in our design trades specificity for sensitivity.
Grants:GRF 123207, GRF 716507, CityU 7002324, ARC DP0984760
Links:PDF, DOI
Citation:W.K. Chan, J.C.F. Ho, and T.H. Tse, "Finding failures from passed test cases: improving the pattern classification approach to the testing of mesh simplification programs", Software Testing, Verification and Reliability 






20 (2): 89-120 (2010).
Remarks:[18 Feb 2009][Impact factor 2007: 1.158]
Related Papers:-

Selected Tags

Tag Groups

Links

ACM SigSoft
IEEE Software Engineering Online