Main psychometric evaluation methods of measuring instruments reliability

Authors

  • Cristiane Martins Cunha Universidade de São Paulo
  • Omar Pereira de Almeida Neto Universidade Federal de Uberlândia
  • Renata Stackfleth Stackfleth Universidade de São Paulo

DOI:

https://doi.org/10.13037/ras.vol14n49.3671

Keywords:

reproducibility of results, measurements, methods, and theories, questionnaires, psychometrics

Abstract

Introduction: Literature has focused on the importance of proper psychometric evaluation of measuring instruments as a criterion for the good quality of the instrument in relation to evidence of validity and reliability. To assess the reliability is the first step to know the accuracy of a measuring instrument. Objective: This article presents the basic principles of psychometric evaluation of the reliability of measuring instruments and the main statistical methods described in the literature. Method: The survey was conducted from publications in Medline, LILACS, and IBECS databases and also from the descriptions in books regarding the field of study. The analysis of the studies involved reading titles, abstracts, and articles published in the last 10 years and excluded articles that were duplicated or not corresponding to the purpose of this review. Results: The main evaluation of reliability methods are based on the correlation between the items and internal consistency. The main methods based on correlations are the test-retest reliability, reliability from equivalent (or parallel) forms, and the reliability between observers; on the other hand, the main evaluation methods for internal consistency are the split-half method, the alpha correlation coefficient (Cronbach’s alpha) and the Kuder-Richardson formula. Conclusions: In general, the authors agree with the basic criteria for evaluating the reliability of a good measurement instrument. Reliability is a psychometric attribute needed in a good measurement instrument and needs to be covered in these study categories.

 

Downloads

Download data is not yet available.

Author Biographies

Cristiane Martins Cunha, Universidade de São Paulo

Docente do curso de Graduação em Enfermagem da Universidade Federal de Uberlândia. Doutoranda em Enfermagem Fundamental da Universidade de São Paulo.

Omar Pereira de Almeida Neto, Universidade Federal de Uberlândia

Docente do curso de Graduação em Enfermagem da Universidade Federal de Uberlândia. Mestre em Atenção à saúde pela Universidade Federal do Triângulo Mineiro (UFTM).

Renata Stackfleth Stackfleth, Universidade de São Paulo

Mestranda em Enfermagem Fundamental. Escola de Enfermagem de Ribeirão Preto (EERP). Universidade de São Paulo - USP.

References

Silva JA, Ribeiro-Filho NP. Avaliação e mensuração da dor: pesquisa, teoria e prática. Ribeirão Preto: FUNPEC; 2006.

Pasquali, L. Psicometria. Rev Esc Enferm USP. 2009 dez;43:992-9.

Pasquali, L. Psicometria: teoria dos testes na psicologia e na educação. 3ª ed. Petrópolis: Vozes; 2009.

Sartes LMA, Souza-Formigoni MLO. Avanços na psicometria: da Teoria Clássica dos Testes à Teoria de Resposta ao Item. Psicol Reflex Crit. 2013;26(2):241-50.

Pasquali L, Primi R. Fundamentos da teoria de resposta ao item: TRI. Aval Psicol. 2003;2(2):99-110.

Couto G, Primi R. Teoria de resposta ao item (TRI): conceitos elementares dos modelos para itens dicotômicos. Bol Psicol. 2011;59(134):1-15.

Primi R. Psicometria: fundamentos matemáticos da teoria clássica dos testes. Aval Psicol. 2012;11(2):297-307.

Fayers PM, Machin D. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. 2ª ed. Chichester: John Wiley & Sons; 2007.

Polit, DF, Beck CT. Essentials of nursing research: appraising evidence for nursing practice. 7ª ed. Philadelphia: Wolters Kluwer/Lippincott Williams & Wilkins; 2010.

Pilatti LA, Pedroso B, Gutierrez GL. Propriedades psicométricas de instrumentos de avaliação: um debate necessário. Rev Bras Ensin Cienc Tecnol. 2010;3(1):81-91.

Martins GA. Sobre confiabilidade e validade. Rev Bras Gestão Negoc. 2006;8(20):1-12.

Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm. 2008;65(23):2276-84.

Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006 Feb;119(2):166.e7-16.

Campo-arias A, Oviedo HC. Propiedades psicométricas de una escala: la consistencia interna. Rev Salud Publica. 2008;10(5):831-9.

Collares CF, Grec WLP, Machado JLM. Psicometria na garantia de qualidade da educação médica: conceitos e aplicações. Sci Health. 2012;3(1):33-49.

Carmines EG, Zeller RA. Reliability and validity assessment. 3ª ed. Beverly Hills: Sage Publications; 1979.

Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003 Feb;80(1):99-103.

Urbina S. Fundamentos de testagem psicológica. Porto Alegre: Artmed; 2007.

Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de instrumentos de medida. Cienc Saude Colet. 2011;16(7):3061-8.

Downloads

Published

2016-06-14

Issue

Vol. 14 No. 49 (2016): Revista de Atenção à Saúde

Section

ARTIGOS DE REVISÃO

License

Policy Proposal for Journals offering Free Delayed Access

 

Authors who publish in this magazine agree to the following terms:

  1. Authors maintain the copyright and grant the journal the right to the first publication, with the work simultaneously licensed under a Creative Commons Attribution License after publication, allowing the sharing of the work with recognition of the authorship of the work and initial publication in this journal.
  2. Authors are authorized to assume additional contracts separately, for non-exclusive distribution of the version of the work published in this magazine (eg, publishing in institutional repository or as a book chapter), with the acknowledgment of the authorship and initial publication in this journal.
  3. Authors are allowed and encouraged to publish and distribute their work online (eg in institutional repositories or on their personal page) at any point before or during the editorial process, as this can generate productive changes, as well as increase impact and citation of the published work (See The Effect of Open Access).