Chapter 12 - Chapter 1 2 Click to edit Master subtitle...

Info iconThis preview shows pages 1–12. Sign up to view the full content.

View Full Document Right Arrow Icon
Click to edit Master subtitle style 9/14/11 PSYCH3620_Ch_12 Chapter 12 How Do You Know When a Test Works? 11 PSYCH3620_Ch_12
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
9/14/11 PSYCH3620_Ch_12 Learning Objectives After completing your study of this chapter, you should be able to do the following: Explain the importance of conducting a pilot test Describe how a pilot test should be set up and specify the types of information that should be collected Describe the collection, analyses, and interpretation of data for an item analysis, including item difficulty, item discrimination, interitem correlations, item-criterion correlations, 22 PSYCH3620_Ch_12
Background image of page 2
9/14/11 PSYCH3620_Ch_12 Learning Objectives Identify and explain the criteria for retaining and dropping items to revise a test Describe the processes of validation and cross- validation Explain the concepts of differential validity, single-group validity, and unfair test discrimination Explain the purpose of a cut score and describe 33 PSYCH3620_Ch_12
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
9/14/11 PSYCH3620_Ch_12 The Pilot Test Pilot test - a scientific investigation of the new test’s reliability and validity for its specified purpose Three steps: 44 PSYCH3620_Ch_12
Background image of page 4
9/14/11 PSYCH3620_Ch_12 The Pilot Test Setting up the Pilot Test Choose sample that resembles target audience Choose setting that mirrors actual setting 55 PSYCH3620_Ch_12
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
9/14/11 PSYCH3620_Ch_12 The Pilot Test Conducting the Pilot Study Breadth and depth depends on size and complexity of target audience Gather additional data (e.g., criterion measure, length of time to complete test) 66 PSYCH3620_Ch_12
Background image of page 6
9/14/11 PSYCH3620_Ch_12 The Pilot Test Analyzing the Results Gather quantitative and qualitative data 77 PSYCH3620_Ch_12
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
9/14/11 PSYCH3620_Ch_12 Quantitative Item Analysis Statistical analyses of the responses test takers gave to individual item Item Difficulty Item Discrimination Interitem Correlations Item-Total Correlations Item-Criterion Correlations 88 PSYCH3620_Ch_12
Background image of page 8
9/14/11 PSYCH3620_Ch_12 Quantitative Item Analysis Item Difficulty – percentage of test takers who respond correctly p = number who responded correctly/total respondents 99 PSYCH3620_Ch_12
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
9/14/11 PSYCH3620_Ch_12 Quantitative Item Analysis Item Discrimination – extent to which items discriminate between high and low scorers D = U – L, where U = number in upper group who responded correctly 10 PSYCH3620_Ch_12
Background image of page 10
9/14/11 PSYCH3620_Ch_12 11 Item 1 a b c* d e High Scorers 5 6
Background image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 12
This is the end of the preview. Sign up to access the rest of the document.

Page1 / 39

Chapter 12 - Chapter 1 2 Click to edit Master subtitle...

This preview shows document pages 1 - 12. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online