Chapter 9 – Validity, reliability, and credibility in research. In this chapter students will be able to: Explain what a scholarly article is, differentiate between CPR and LOAF elements of a scholarly articles, analyze the relative merits of various scholarly articles,...
Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research © 2014 John Wiley & Sons, Inc. All rights reserved Learning Objectives » Explain what a scholarly article is » Differentiate between CPR and LOAF elements of a scholarly articles » Analyze the relative merits of various scholarly articles » Use various search engines to find scholarly articles » Identify an area of research interest » Discriminate between scholarly articles and other publications © 2014 John Wiley & Sons, Inc. All rights reserved Key Terms » » » » » » » » » Concurrent validity Convergent validity Construct validity Content validity Criterion validity Credibility Dependent variable Discriminant validity Equivalent form reliability © 2014 John Wiley & Sons, Inc. All rights reserved » » » » » » » » External validity Face validity General validity Golem effect Independent variable Instrumentation Instrument validity Internal consistency reliability Key Terms(cont’d) ˃ ˃ ˃ ˃ ˃ ˃ ˃ ˃ ˃ ˃ Internal validity Intervening variable Interrater reliability Moderating variable Operational definition Predictive validity Pygmalion effect Reliability Testing Testretest reliability © 2014 John Wiley & Sons, Inc. All rights reserved Internal Credibility » Believability » Trustworthiness » Specificity © 2014 John Wiley & Sons, Inc. All rights reserved Validity » » » » » » Content validity Face validity Construct validity Criterion validity Predictive validity Discriminant validity © 2014 John Wiley & Sons, Inc. All rights reserved Variables » » » » » Independent variable Dependent variable Confounding (moderating) variable Intervening variable Operationalizing the variables © 2014 John Wiley & Sons, Inc. All rights reserved Validity Internal » General validity » Instrumental validity © 2014 John Wiley & Sons, Inc. All rights reserved External » To what extent can you apply the insights to other situations? Internal Validity ˃ To what extent is your research design really focused on the problem statement you have? ˃ Will you collect and analyze relevant and accurate information? ˃ How can you be sure that your design answers your research questions? ˃ What aspects of the design can you create to ensure validity? © 2014 John Wiley & Sons, Inc. All rights reserved Forms of Instrument Validity » » » » » » Content validity Construct validity Criterion validity Discriminant validity Face validity Predictive validity © 2014 John Wiley & Sons, Inc. All rights reserved External Validity » To what extent does the literature review place your expected findings within a broader context? » Will you be able to generalize from what you find? » What limitations or qualifications will you have to make about your results? » How can you extend your findings and suggest opportunities for further research so that you protect its validity? » How does previous research help you interpret your results? » Does previous research provide a rationale for your research design and suggestions about the applicability of your findings? © 2014 John Wiley & Sons, Inc. All rights reserved Threats to Validity » » » » » » Ambiguity History Instrumentation Mortality Maturation Testing © 2014 John Wiley & Sons, Inc. All rights reserved Reliability » Types ˃ Equivalent form reliability ˃ Internal consistency reliability ˃ Interrater reliability ˃ Testretest reliability © 2014 John Wiley & Sons, Inc. All rights reserved Review of Class Session » Anything unclear? » One thing that I was amazed by in sampling is … © 2014 John Wiley & Sons, Inc. All rights reserved ... To what extent is your research design really focused on the problem statement you have? ˃ Will you collect and analyze relevant and accurate information? ˃ How can you be sure that your design answers your research questions?... Use various search engines to find scholarly articles » Identify an area of research interest » Discriminate between scholarly articles and other publications © 2014 John Wiley & Sons, Inc. All rights reserved... » Independent variable Dependent variable Confounding (moderating) variable Intervening variable Operationalizing the variables © 2014 John Wiley & Sons, Inc. All rights reserved Validity Internal