Osteoporosis Risk Assessment Tool: Quantitative Methods for Determining Content Validity

2.50
Hdl Handle:
http://hdl.handle.net/10755/158600
Type:
Presentation
Title:
Osteoporosis Risk Assessment Tool: Quantitative Methods for Determining Content Validity
Abstract:
Osteoporosis Risk Assessment Tool: Quantitative Methods for Determining Content Validity
Conference Sponsor:Midwest Nursing Research Society
Conference Year:2002
Author:Wynd, Christine, PhD
P.I. Institution Name:University of Akron
Title:Professor
Contact Address:College of Nursing, 209 Carroll Street, MGH 202B, Akron, OH, 44325-3701, USA
Contact Telephone:330.972.5164
This methodological study proposed to evaluate content validity of the "Osteoporosis Risk Assessment Tool," or ORAT, which assessed factors such as age, race, gender, medical history, especially previous diagnosis of osteoporosis, past fractures of the hip, spine, or wrist, onset of menopause, diet, alcohol and tobacco consumption, prescription medication usage, estrogen replacement therapy, and calcium supplements. Seven national experts were provided with the ORAT, as well as a rating scale to quantitatively rate item relevance to the domain of content about osteoporosis risk factors. Two quantitative approaches were used to determine expert panelists' levels of agreement and included:(1) proportion agreement, established through use of the content validity index (CVI), and (2) a multirater kappa coefficient of agreement. Only one ORAT item, which asked about a past diagnosis of kidney stones, received a CVI below the level of relevance for interrater proportion agreement (CVI=0.57), and was eliminated. The other 22 items received CVIs ranging between 0.86 - 1.00, demonstrating that a proportion of experts endorsed the content validity. The overall instrument CVI equaled 0.96, indicative of a high degree of agreement. The multirater kappa, however, was equal to -.0443 (p=.5455), which meant that the raters actually agreed less frequently than expected by chance. Since the multirater kappa coefficient indicated a poor level of agreement, each instrument item was carefully examined using quantitative results as well as qualitative comments provided by expert panelists. Expert judgments indicated that 15 out of 23 items were adequate, seven items were questionable, and one item was unacceptable. Further work produced a final instrument containing 15 acceptable items.
Repository Posting Date:
26-Oct-2011
Date of Publication:
17-Oct-2011
Sponsors:
Midwest Nursing Research Society

Full metadata record

DC FieldValue Language
dc.typePresentationen_GB
dc.titleOsteoporosis Risk Assessment Tool: Quantitative Methods for Determining Content Validityen_GB
dc.identifier.urihttp://hdl.handle.net/10755/158600-
dc.description.abstract<table><tr><td colspan="2" class="item-title">Osteoporosis Risk Assessment Tool: Quantitative Methods for Determining Content Validity</td></tr><tr class="item-sponsor"><td class="label">Conference Sponsor:</td><td class="value">Midwest Nursing Research Society</td></tr><tr class="item-year"><td class="label">Conference Year:</td><td class="value">2002</td></tr><tr class="item-author"><td class="label">Author:</td><td class="value">Wynd, Christine, PhD</td></tr><tr class="item-institute"><td class="label">P.I. Institution Name:</td><td class="value">University of Akron</td></tr><tr class="item-author-title"><td class="label">Title:</td><td class="value">Professor</td></tr><tr class="item-address"><td class="label">Contact Address:</td><td class="value">College of Nursing, 209 Carroll Street, MGH 202B, Akron, OH, 44325-3701, USA</td></tr><tr class="item-phone"><td class="label">Contact Telephone:</td><td class="value">330.972.5164</td></tr><tr class="item-email"><td class="label">Email:</td><td class="value">cwynd@uakron.edu</td></tr><tr><td colspan="2" class="item-abstract">This methodological study proposed to evaluate content validity of the &quot;Osteoporosis Risk Assessment Tool,&quot; or ORAT, which assessed factors such as age, race, gender, medical history, especially previous diagnosis of osteoporosis, past fractures of the hip, spine, or wrist, onset of menopause, diet, alcohol and tobacco consumption, prescription medication usage, estrogen replacement therapy, and calcium supplements. Seven national experts were provided with the ORAT, as well as a rating scale to quantitatively rate item relevance to the domain of content about osteoporosis risk factors. Two quantitative approaches were used to determine expert panelists' levels of agreement and included:(1) proportion agreement, established through use of the content validity index (CVI), and (2) a multirater kappa coefficient of agreement. Only one ORAT item, which asked about a past diagnosis of kidney stones, received a CVI below the level of relevance for interrater proportion agreement (CVI=0.57), and was eliminated. The other 22 items received CVIs ranging between 0.86 - 1.00, demonstrating that a proportion of experts endorsed the content validity. The overall instrument CVI equaled 0.96, indicative of a high degree of agreement. The multirater kappa, however, was equal to -.0443 (p=.5455), which meant that the raters actually agreed less frequently than expected by chance. Since the multirater kappa coefficient indicated a poor level of agreement, each instrument item was carefully examined using quantitative results as well as qualitative comments provided by expert panelists. Expert judgments indicated that 15 out of 23 items were adequate, seven items were questionable, and one item was unacceptable. Further work produced a final instrument containing 15 acceptable items.</td></tr></table>en_GB
dc.date.available2011-10-26T21:12:54Z-
dc.date.issued2011-10-17en_GB
dc.date.accessioned2011-10-26T21:12:54Z-
dc.description.sponsorshipMidwest Nursing Research Societyen_GB
All Items in this repository are protected by copyright, with all rights reserved, unless otherwise indicated.