Assuring the model evolution of protocol software specifications by regression testing process improvement

Model-based testing helps test engineers automate their testing tasks so that they are more cost-effective. When the model is changed owing to the evolution of the specification, it is important to maintain the test suites up to date for regression testing. A complete regeneration of the whole test suite from the new model, although inefficient, is still frequently used in the industry, including Microsoft. To handle specification evolution effectively, we propose a test case reusability analysis technique to identify reusable test cases of the original test suite based on graph analysis. We also develop a test suite augmentation technique to generate new test cases to cover the change-related parts of the new model. The experiment on four large protocol docu­ment testing projects shows that our technique can successfully identify a high percentage of reusable test cases and generate low-redundancy new test cases. When compared with a completely regeneration of the whole test suite, our technique significantly reduces regression testing time while maintaining the stability of requirement coverage over the evolution of requirements specifications.

Grants:GRF 717308, CityU 7008039
Citation: B. Jiang, T.H. Tse, W. Grieskamp, N. Kicillof, Y. Cao, X. Li, and W.K. Chan. Assuring the model evolution of protocol software specification by regression testing process improvement. Software: Practice and Experience, 41 (10):1073-1103, 2011.
Related Papers:-

Selected Tags

Tag Groups


ACM SigSoft
IEEE Software Engineering Online