| 461 | Macario Polo and Mario Piattini and Ignacio Garcia-Rodriguez
Decreasing the Cost of Mutation Testing with Second-Order Mutants
Software Testing, Verification and Reliability, 19(2), June 2008. |
|
| | Abstract: Although powerful, mutation is a computationally very expensive testing technique. In fact, its three main stages (mutant generation, mutant execution and result analysis) require many resources to be successfully accomplished. Thus, researchers have made important efforts to reduce its costs. This paper represents an additional effort in this sense. It describes the results of two experiments in which, by means of combining the original set of mutants and therefore obtaining a new set of mutants - each one with two faults - the number of mutants used is reduced to half. Results lead to believe that mutant combination does not decrease the quality of the test suite, whereas it supposes important savings in mutant execution and result analysis. |
| | @ARTICLE{PoloPR08,
author = {Macario Polo and Mario Piattini and Ignacio Garcia-Rodriguez},
title = {Decreasing the Cost of Mutation Testing with Second-Order Mutants},
journal = {Software Testing, Verification and Reliability},
year = {2008},
month = {June},
volume = {19},
number = {2},
pages = {111 - 131}
} |
| 462 | Alexander Pretschner and Tejeddine Mouelhi and Yves Le Traon
Model-Based Tests for Access Control Policies
Proceedings of the 1st International Conference on Software Testing, Verification, and Validation (ICST '08)Lillehammer, Norway, 9-11 April 2008. |
|
| | Abstract: We present a model-based approach to testing access control requirements. By using combinatorial testing, we first automatically generate test cases from and without access control policies—i.e., the model—and assess the effectiveness of the test suites by means of mutation testing. We also compare them to purely random tests. For some of the investigated strategies, non-random tests kill considerably more mutants thanthe same number of random tests. Since we rely on policies only, no information on the application is required at this stage. As a consequence, our methodology applies to arbitrary implementations of the policy decision points. |
| | @INPROCEEDINGS{PretschnerMT08,
author = {Alexander Pretschner and Tejeddine Mouelhi and Yves Le Traon},
title = {Model-Based Tests for Access Control Policies},
booktitle = {Proceedings of the 1st International Conference on Software Testing, Verification, and Validation (ICST '08)},
year = {2008},
address = {Lillehammer, Norway},
month = {9-11 April},
pages = {338-347}
} |
| 463 | Chanchal K. Roy and James R. Cordy
Towards a Mutation-based Automatic Framework for Evaluating Code Clone Detection Tools
Proceedings of the Canadian Conference on Computer Science and Software Engineering (C3S2E'08)Montreal, Quebec, Canada, 12-13 May 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{RoyC08,
author = {Chanchal K. Roy and James R. Cordy},
title = {Towards a Mutation-based Automatic Framework for Evaluating Code Clone Detection Tools},
booktitle = {Proceedings of the Canadian Conference on Computer Science and Software Engineering (C3S2E'08)},
year = {2008},
address = {Montreal, Quebec, Canada},
month = {12-13 May},
pages = {137-140}
} |
| 464 | Fabiano Cutigi Ferrari and Jose Carlos Maldonado and Awais Rashid
Mutation Testing for Aspect-Oriented Programs
Proceedings of the 1st International Conference on Software Testing, Verification, and Validation (ICST '08)Lillehammer, Norway, 9-11 April 2008. |
|
| | Abstract: Mutation testing has been shown to be one of the strongest testing criteria for the evaluation of both programs and test suites. Comprehensive sets of mutants require strong test sets to achieve acceptable testing coverage. Moreover, mutation operators are valuable for the evaluation of other testing approaches. Although its importance has been highlighted for Aspect-Oriented (AO) programs, there is still a need for a suitable set of mutation operators for AO languages. The quality of the mutation testing itself relies on the quality of such operators. This paper presents the design of a set of mutation operators for AspectJ-based programs. These operators model instances of fault types identified in an extensive survey. The fault types and respective operators are grouped according to the related languages features. We also discuss the generalisation of the fault types to AO approaches other than AspectJ and the coverage that may be achieved with the application of the proposed operators. In addition, a cost analysis based on two case studies involving real-world applications has provided us feedback on the most expensive operators, which will support the definition of further testing strategies. |
| | @INPROCEEDINGS{FerrariMR08,
author = {Fabiano Cutigi Ferrari and Jose Carlos Maldonado and Awais Rashid},
title = {Mutation Testing for Aspect-Oriented Programs},
booktitle = {Proceedings of the 1st International Conference on Software Testing, Verification, and Validation (ICST '08)},
year = {2008},
address = {Lillehammer, Norway},
month = {9-11 April},
pages = {52-61}
} |
| 465 | Akbar Siami Namin and James H. Andrews and Duncan J. Murdoch
Sufficient Mutation Operators for Measuring Test Effectiveness
Proceedings of the 30th International Conference on Software Engineering (ICSE'08)Leipzig, Germany, 10-18 May 2008. |
|
| | Abstract: Mutants are automatically-generated, possibly faulty variants of programs. The mutation adequacy ratio of a test suite is the ratio of non-equivalent mutants it is able to identify to the total number of non-equivalent mutants. This ratio can be used as a measure of test effectiveness. However, it can be expensive to calculate, due to the large number of different mutation operators that have been proposed for generating the mutants.
In this paper, we address the problem of finding a small set of mutation operators which is still sufficient for measuring test effectiveness. We do this by defining a statistical analysis procedure that allows us to identify such a set, together with an associated linear model that predicts mutation adequacy with high accuracy. We confirm the validity of our procedure through cross-validation and the application of other, alternative statistical analyses. |
| | @INPROCEEDINGS{NaminAM08,
author = {Akbar Siami Namin and James H. Andrews and Duncan J. Murdoch},
title = {Sufficient Mutation Operators for Measuring Test Effectiveness},
booktitle = {Proceedings of the 30th International Conference on Software Engineering (ICSE'08)},
year = {2008},
address = {Leipzig, Germany},
month = {10-18 May},
pages = {351-360}
} |
| 466 | Weiglhofer, Martin and Wotawa, Franz
"On the Fly" Input Output Conformance Verification
Proceedings of the IASTED International Conference on Software EngineeringAnaheim, CA, USA, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{weiglhofer_other_08,
author = {Weiglhofer, Martin and Wotawa, Franz},
title = {"On the Fly" Input Output Conformance Verification},
booktitle = {Proceedings of the IASTED International Conference on Software Engineering},
year = {2008},
address = {Anaheim, CA, USA},
month = {},
pages = {286--291}
} |
| 467 | Fabiano Cutigi Ferrari and Jos{\'{e}} Carlos Maldonado and Awais Rashid
Mutation Testing for Aspect-Oriented Programs
First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{FerrariMR08,
author = {Fabiano Cutigi Ferrari and Jos{\'{e}} Carlos Maldonado and Awais Rashid},
title = {Mutation Testing for Aspect-Oriented Programs},
booktitle = {First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008},
year = {2008},
address = {},
month = {},
pages = {52--61}
} |
| 468 | Estero-Botaro, Antonia and Palomo-Lozano, Francisco and Medina-Bulo, Inmaculada
Mutation operators for WS-BPEL 2.0
21th International Conference on Software \& Systems Engineering and their Applications, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{estero2008mutation,
author = {Estero-Botaro, Antonia and Palomo-Lozano, Francisco and Medina-Bulo, Inmaculada},
title = {Mutation operators for WS-BPEL 2.0},
booktitle = {21th International Conference on Software \& Systems Engineering and their Applications},
year = {2008},
address = {},
month = {},
pages = {}
} |
| 469 | Khaled El{-}Fakih and Anton Kolomeez and Svetlana Prokopenko and Nina Yevtushenko
Extended Finite State Machine Based Test Derivation Driven by User Defined Faults
First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{el_fakih_ICST_08,
author = {Khaled El{-}Fakih and Anton Kolomeez and Svetlana Prokopenko and Nina Yevtushenko},
title = {Extended Finite State Machine Based Test Derivation Driven by User Defined Faults},
booktitle = {First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008},
year = {2008},
address = {},
month = {},
pages = {308--317}
} |
| 470 | Prasanth Anbalagan and Tao Xie
Automated Generation of Pointcut Mutants for Testing Pointcuts in AspectJ Programs
Proceedings of the 19th International Symposium on Software Reliability Engineering (ISSRE'08)Redmond, Washingto, 11-14 November 2008. |
|
| | Abstract: Aspect-Oriented Programming (AOP) provides new modularization of software systems by encapsulating cross-cutting concerns. AspectJ, an AOP language, uses abstractions such as pointcuts, advice, and aspects to achieve AOP’s primary functionality. Faults in pointcuts can cause aspects to fail to satisfy their requirements. Hence, testing pointcuts is necessary in order to ensure correctness of aspects. In mutation testing of pointcuts (a type of fault-based pointcut testing), the number of mutants (i.e., variations) for pointcuts is usually large due to the usage of wildcards. It is tedious to manually identify effective mutants that are of appropriate strength and resemble closely the original pointcut expression, reflecting the kind of mistakes that developers may make. To reduce developers’ effort in this process, we have developed a new framework that automatically identifies the strength of each pointcut and generates pointcut mutants with different strengths. Developers can inspect the pointcut mutants and their join points for pointcut correctness or choose the mutants for conducting mutation testing. We conducted an empirical study on applying our framework on pointcuts from existing AspectJ programs. The results show that our framework can provide valuable assistance in generating effective mutants that are close to the original pointcuts and are of appropriate strength. |
| | @INPROCEEDINGS{AnbalaganX08,
author = {Prasanth Anbalagan and Tao Xie},
title = {Automated Generation of Pointcut Mutants for Testing Pointcuts in AspectJ Programs},
booktitle = {Proceedings of the 19th International Symposium on Software Reliability Engineering (ISSRE'08)},
year = {2008},
address = {Redmond, Washingto},
month = {11-14 November},
pages = {239-248}
} |
| 471 | Matthew Kaplan and Tim Klinger and Amit M. Paradkar and Avik Sinha and Clay Williams and Cemal Yilmaz
Less is More: {A} Minimalistic Approach to {UML} Model-Based Conformance Test Generation
First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{kaplan_ICST_08,
author = {Matthew Kaplan and Tim Klinger and Amit M. Paradkar and Avik Sinha and Clay Williams and Cemal Yilmaz},
title = {Less is More: {A} Minimalistic Approach to {UML} Model-Based Conformance Test Generation},
booktitle = {First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008},
year = {2008},
address = {},
month = {},
pages = {82--91}
} |
| 472 | Yue Jia and Mark Harman
MILU: A Customizable, Runtime-Optimized Higher Order Mutation Testing Tool for the Full C Language
Proceedings of the 3rd Testing: Academic and Industrial Conference Practice and Research Techniques (TAIC PART'08)Windsor, UK, 29-31 August 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{JiaH08a,
author = {Yue Jia and Mark Harman},
title = {MILU: A Customizable, Runtime-Optimized Higher Order Mutation Testing Tool for the Full C Language},
booktitle = {Proceedings of the 3rd Testing: Academic and Industrial Conference Practice and Research Techniques (TAIC PART'08)},
year = {2008},
address = {Windsor, UK},
month = {29-31 August},
pages = {94-98}
} |
| 473 | Gordon Fraser and Franz Wotawa
Using model-checkers to generate and analyze property relevant test-cases
Software Quality Journal, 16(2), 2008. |
|
| | Abstract: Available soon... |
| | @ARTICLE{fraser_SQJ_08,
author = {Gordon Fraser and Franz Wotawa},
title = {Using model-checkers to generate and analyze property relevant test-cases},
journal = {Software Quality Journal},
year = {2008},
month = {},
volume = {16},
number = {2},
pages = {161--183}
} |
| 474 | Jaymie Strecker and Atif M. Memon
Relationships between Test Suites, Faults, and Fault Detection in {GUI} Testing
First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{StreckerM08,
author = {Jaymie Strecker and Atif M. Memon},
title = {Relationships between Test Suites, Faults, and Fault Detection in {GUI} Testing},
booktitle = {First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008},
year = {2008},
address = {},
month = {},
pages = {12--21}
} |
| 475 | Akbar Siami Namin and James H. Andrews and Duncan J. Murdoch
Sufficient mutation operators for measuring test effectiveness
30th International Conference on Software Engineering {(ICSE} 2008), Leipzig, Germany, May 10-18, 2008, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{NaminAM08,
author = {Akbar Siami Namin and James H. Andrews and Duncan J. Murdoch},
title = {Sufficient mutation operators for measuring test effectiveness},
booktitle = {30th International Conference on Software Engineering {(ICSE} 2008), Leipzig, Germany, May 10-18, 2008},
year = {2008},
address = {},
month = {},
pages = {351--360}
} |
| 476 | X. Feng and S. Marr and T. O'Callaghan
ESTP: An Experimental Software Testing Platform
Testing: Academic Industrial Conference - Practice and Research Techniques (taic part 2008), Aug 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{feng_taic_part_08,
author = {X. Feng and S. Marr and T. O'Callaghan},
title = {ESTP: An Experimental Software Testing Platform},
booktitle = {Testing: Academic Industrial Conference - Practice and Research Techniques (taic part 2008)},
year = {2008},
address = {},
month = {Aug},
pages = {59-63}
} |
| 477 | Yue Jia and Mark Harman
Constructing Subtle Faults Using Higher Order Mutation Testing
Eighth {IEEE} International Working Conference on Source Code Analysis and Manipulation {(SCAM} 2008), 28-29 September 2008, Beijing, China, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{JiaH08,
author = {Yue Jia and Mark Harman},
title = {Constructing Subtle Faults Using Higher Order Mutation Testing},
booktitle = {Eighth {IEEE} International Working Conference on Source Code Analysis and Manipulation {(SCAM} 2008), 28-29 September 2008, Beijing, China},
year = {2008},
address = {},
month = {},
pages = {249--258}
} |
| 478 | Roy Patrick Tan and Stephen Edwards
Evaluating Automated Unit Testing in Sulu
First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{tan_ICST_08,
author = {Roy Patrick Tan and Stephen Edwards},
title = {Evaluating Automated Unit Testing in Sulu},
booktitle = {First International Conference on Software Testing, Verification, and Validation, {ICST} 2008, Lillehammer, Norway, April 9-11, 2008},
year = {2008},
address = {},
month = {},
pages = {62--71}
} |
| 479 | Ajitha Rajan and Michael W. Whalen and Matt Staats and Mats Per Erik Heimdahl
Requirements Coverage as an Adequacy Measure for Conformance Testing
Formal Methods and Software Engineering, 10th International Conference on Formal Engineering Methods, {ICFEM} 2008, Kitakyushu-City, Japan, October 27-31, 2008. Proceedings, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{rajan_other_08,
author = {Ajitha Rajan and Michael W. Whalen and Matt Staats and Mats Per Erik Heimdahl},
title = {Requirements Coverage as an Adequacy Measure for Conformance Testing},
booktitle = {Formal Methods and Software Engineering, 10th International Conference on Formal Engineering Methods, {ICFEM} 2008, Kitakyushu-City, Japan, October 27-31, 2008. Proceedings},
year = {2008},
address = {},
month = {},
pages = {86--104}
} |
| 480 | Prasanth Anbalagan and Tao Xie
Automated Generation of Pointcut Mutants for Testing Pointcuts in AspectJ Programs
19th International Symposium on Software Reliability Engineering {(ISSRE} 2008), 11-14 November 2008, Seattle/Redmond, WA, {USA}, 2008. |
|
| | Abstract: Available soon... |
| | @INPROCEEDINGS{AnbalaganX08,
author = {Prasanth Anbalagan and Tao Xie},
title = {Automated Generation of Pointcut Mutants for Testing Pointcuts in AspectJ Programs},
booktitle = {19th International Symposium on Software Reliability Engineering {(ISSRE} 2008), 11-14 November 2008, Seattle/Redmond, WA, {USA}},
year = {2008},
address = {},
month = {},
pages = {239--248}
} |
