Validity and reliability

9/30/2015 Validity and Reliability info Vũ Hữu Thành Finance and Banking Faculty 0938.077.776 thanh.vuh@gmail.com 9/30/2015 • Refers to the approximate truth of an inference • Encompasses the entire experimental concept and establishes whether the results obtained meet all of the requirements of the scientific research method 9/30/2015 Validity typology • Statistical conclusion validity, • Internal validity, • Construct validity, and • External validity Cook and Campbell (1979) Validity typology Statistical Conclusion Validity: The validity of inferences about the correlation (covariation) between treatment and outcome Internal Validity: The validity of inferences about whether observed covariation between A (the presumed treatment) and B (the presumed outcome) reflects a causal relationship from A to B as those variables were manipulated or measured Construct Validity: The validity of inferences about the higher order constructs that represent sampling particulars External Validity: The validity of inferences about whether the causeeffect relationship holds over variation in persons, settings, treatment variables, and measurement variables 9/30/2015 Refers "repeatability" or "consistency" A measure is considered reliable if it would give us the same result over and over 9/30/2015 Types of Reliability Estimation • Inter-Rater or Inter-Observer Reliability: Used to assess the degree to which different raters/observers give consistent estimates of the same phenomenon • Test-Retest Reliability: Used to assess the consistency of a measure from one time to another • Parallel-Forms Reliability: Used to assess the consistency of the results of two tests constructed in the same way from the same content domain • Internal Consistency Reliability: Used to assess the consistency of results across items within a test Q A ... validity, • Internal validity, • Construct validity, and • External validity Cook and Campbell (1979) Validity typology Statistical Conclusion Validity: The validity of inferences about the correlation... concept and establishes whether the results obtained meet all of the requirements of the scientific research method 9/30/2015 Validity typology • Statistical conclusion validity, • Internal validity, ... (covariation) between treatment and outcome Internal Validity: The validity of inferences about whether observed covariation between A (the presumed treatment) and B (the presumed outcome) reflects