CorrVsExp.pptx - Causal Claims from User Studies Introduction to Computational Thinking and Data Science Gale Lucas [email protected] Today\u2019s Topics 1

CorrVsExp.pptx - Causal Claims from User Studies...

This preview shows page 1 - 20 out of 62 pages.

Causal Claims from User Studies Introduction to Computational Thinking and Data Science Gale Lucas [email protected]
Image of page 1
Today’s Topics 1. Correlational research 2. Comparing correlational research to experiments 3. Consuming statistical results 4. Ensuring internal validity 2
Image of page 2
Correlational research 3
Image of page 3
Types of user studies User studies Experiment AB Testing Between-subjects Within-subjects AB+ (one-way) design Between-subjects Within-subjects Factorial design Between-subjects Within-subjects Mixed design 4 Correlational research
Image of page 4
Correlational vs. experimental Correlational Measure IV and measure DV Experimental Manipulate IV and measure DV
Image of page 5
IVs and DVs IV: Independent Variable Variable that you think causes the effect on another variable Variable is measured in correlational research DV: Dependent Variable The outcome variable (you think it has effect on) Variable is also measured in correlational research PREDICTOR OUTCOME
Image of page 6
Two ways of asking a research question “Is NTB associated with social sensitivity?” “Does NTB cause heightened sensitivity?” Correlational Experimental NTB Sensitivity NTB Sensitivity Social sensitivi ty
Image of page 7
Is NTB associated with sensitivity? Correlational research Picket, Gardner, and Knowles NTB scale DANVA: Number of facial expressions correctly identified r = .38 What does that mean?
Image of page 8
Continuous IV (e.g., how much) Categorical IV (e.g, exp vs control) Continuous DV (e.g., how much) correlation or regression t-test or ANOVA Categorical DV (e.g., yes/no) logistical regression chi-square test or loglinear What Test Do I Run? Yes but…
Image of page 9
Problems with correlational research Only shows there’s an association We can’t say NTB causes social sensitivity, why not …? It could be some other variable causing both Third variable problem Sensitivity could cause NTB Directionality problem NTB Sensitivity NTB Sensitivity Third Variable
Image of page 10
Problems with correlational research NTB Social sensitivity Motivation Please experimenter
Image of page 11
Problems with correlational research NTB Social sensitivity
Image of page 12
Comparing correlational research to experiments 13
Image of page 13
Problems with correlational research …and there will always another third variable that you didn’t think of! So, to make a causal claim, we conduct experimental research! What makes an experiment? What do you have to do? Random assignment to conditions that only differ on (thus manipulate) one variable Remove confounds Internal validity!
Image of page 14
Correlation vs. Causation
Image of page 15
Experimental research Picket, Gardner, and Knowles What did they have to do here? Manipulate belonging needs Measure social sensitivity
Image of page 16
Experimental research NTB causes an increase in social sensitivity! Experimental research is better!…?
Image of page 17
Benefits of correlational research Real world outcomes that really matter Age-adjusted mortality rate Belonging External validity!
Image of page 18
Problems with experimental research Hard to make manipulations powerful enough to impact these kinds of outcomes Would you really want to?
Image of page 19
Image of page 20

You've reached the end of your free preview.

Want to read all 62 pages?

  • Fall '17
  • Statistics, Null hypothesis, Statistical hypothesis testing, Type I and type II errors,  Variable,  Random assignment

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask You can ask (will expire )
Answers in as fast as 15 minutes