Paper on Technique

Paper on Technique - Simulating Families of Studies to...

Info iconThis preview shows pages 1–3. Sign up to view the full content.

View Full Document Right Arrow Icon
Simulating Families of Studies to Build Confidence in Defect Hypotheses 1 Forrest Shull 1 , Daniela Cruzes 2,3 , Victor Basili 2 , Manoel Mendonça 3 1 Fraunhofer Center - Maryland, 4321 Hartwick Road, Suite 500, College Park, MD, 20740, USA fshull@fc-md.umd.edu 2 Dept. of Computer Science, University of Maryland, College Park, MD, 20742, USA basili@cs.umd.edu 3 Computer Networks Research Group (NUPERC), Salvador University (UNIFACS), Rua Ponciano de Oliveira, 126 Salvador, BA 41950-275, Brazil {daniela, mgmn}@unifacs.br Abstract. While it is clear that there are many sources of variation from one development context to another, it is not clear a priori what specific variables will influence the effectiveness of a process in a given context. For this reason, we argue that knowledge about software process must be built from families of studies, in which related studies are run within similar contexts as well as very different ones. Previous papers have discussed how to design related studies so as to document as precisely as possible the values of likely context variables and be able to compare with those observed in new studies. While such a planned approach is important, we argue that an opportunistic approach is also practical. The approach would combine results from multiple individual studies after the fact, enabling recommendations to be made about process effective- ness in context. In this paper, we describe two processes with which we have been working to build empirical knowledge about software development processes: One is a manual and informal approach, which relies on identifying common beliefs or “folklore” to identify useful hypotheses and a manual analysis of the informa- tion in papers to investigate whether there is support for those hypotheses; the other is a formal approach based around encoding the information in papers into a Structured Hypothesis Base that can then be searched to organize hy- potheses and their associated support. We test these processes by applying them to build knowledge in the area of defect folklore (i.e., commonly accepted heu- ristics about software defects and their behavior). We show that the formal methodology can produce useful and feasible results, especially when it is com- pared to the results output from the more manual, expert-based approach. The formalized approach, by relying on a reusable Hypothesis Base, is repeatable 1 SHULL, Forrest ; CRUZES, Daniela Soares ; BASILI, Victor Robert ; MENDONÇA NETO, M. G. . Simulating Families of Studies to Build Confidence in Defect Hypotheses. Information and Software Technology, v. 47, n. 15, p. 1019-1032, 2005. 1
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
and also capable of producing a more thorough basis of support for hypotheses, including results from papers or articles that may have been overlooked or not considered by the experts. 1
Background image of page 2
Image of page 3
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 01/11/2012 for the course CMCS 735 taught by Professor Basili during the Fall '10 term at Maryland.

Page1 / 27

Paper on Technique - Simulating Families of Studies to...

This preview shows document pages 1 - 3. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online