To find out why interviewees chose certain metrics or KPIs The context codes

To find out why interviewees chose certain metrics or

This preview shows page 18 - 20 out of 220 pages.

To find out why interviewees chose certain metrics or KPIs. The context, codes and metrics collected through the literature review, survey and interviews, are used as input for the design. Evaluation is necessary to: “Observe and measure how well the artifact supports a solution to the problem” [30]. Therefore, an evaluation of the design is mainly done for the following reasons: To determine the extent to which certain practitioners agree with the design and feel that it could actually help them measure the e ectiveness of their EA. To find out whether the KPIs found are accepted. To find out whether something is still missing. In Table 3.1 , each subquestion for answering the main research question is linked to a research method. Table 3.1: Link between research questions and research methods Research Question Method RQ1: What methods can be used to measure enterprise architecture e ectiveness? Literature Review RQ2: What metrics can be used to measure en- terprise architecture e ectiveness? Literature Review, Input Survey & Interviews RQ3: What are key performance indicators for enterprise architecture e ectiveness? Literature Review, Input Survey & Interviews, Evaluation (Intermediate Evaluations, Evalua- tion Session, Evaluation Survey) RQ4: How are key performance indicators for enterprise architecture e ectiveness linked? Literature Review, Input Survey& Interviews, Evaluation (Intermediate Evaluations, Evalua- tion Session, Evaluation Survey) A Focus on KPIs 12
Image of page 18
CHAPTER 3. METHODS Measuring EA e ectiveness In the sections below, each method is discussed in more detail. 3.2 Literature Review Relevant context, existing EA e ectiveness measurement approaches, metrics, and key performance in- dicators are identified through a semi-structured literature review. An attempt is made to gain results from both academic, and “grey literature”. It is believed that, although grey literature is not always peer-reviewed, by including both, an attempt is made to overcome the gap that often exists between research and practice. This is also in line with the adopted design science research approach. Moreover, EA itself is deemed inherently practical. A more structured approach is adopted while searching for academic literature using the ACM Digital Library [34] and the IEEE Xplore Digital Library [35], two well-known computer science-related digital libraries that allow for entering detailed search queries. Although they require subscription to actually access the articles, free full text versions of titles can often be found through other channels. The search query used in these databases can be found in Appendix B , Section B.1 . The following steps are taken: 1. Search in ACM using the defined keywords. 2. Save the resulting list of titles in a spreadsheet.
Image of page 19
Image of page 20

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture