2.50
Hdl Handle:
http://hdl.handle.net/10755/161568
Type:
Presentation
Title:
Inter-Rater Reliability and Oasis
Abstract:
Inter-Rater Reliability and Oasis
Conference Sponsor:Midwest Nursing Research Society
Conference Year:2002
Author:Madigan, Elizabeth, PhD
P.I. Institution Name:Case Western Reserve University
Title:Associate Professor
Contact Address:Frances Payne Bolton School of Nursing, 10900 Euclid Avenue, Cleveland, OH, 44106-4904, USA
Contact Telephone:216.368.8532
The Outcomes and Assessment Information Set (OASIS) is mandated for use by Medicare home health care agencies. Clinically, many OASIS data items are used to classify home care patients into resource use groups and determine payment to agencies. In addition, agencies use selected OASIS data items to evaluate patient outcomes for quality of care monitoring purposes. Preliminary work indicates that there may be some OASIS items that are problematic from a reliability perspective (Madigan & Fortinsky, 2000). The purpose of this study was to evaluate the inter-rater reliability of selected OASIS items, primarily functional (activities of daily living and instrumental activities of daily living), clinical (dyspnea and pain interfering with activity) and psychosocial (behavioral and depression items). During December 1999 to June 2001, two home health care agency clinicians made home visits to 68 Medicare home health patients from 16 agencies. Kappa statistics were based on the clinicians' agreement on each OASIS item to determine inter-rater scores. The following items were problematic, achieving kappas <0.60: severity of the primary diagnosis, dyspnea, toileting, cognitive functioning, indecisiveness, diminished interest, and memory deficit. For ADL and IADL items, kappas ranged from 0.58 to 0.83 and 0.64 to 0.77, respectively. Conclusions: Inter-rater reliability was highest for functional status OASIS items, and lowest for cognitive and behavioral items. Most items studied that are crucial for determining agency payment based on patients' resource use groups were found to have adequate inter-rater reliability. Some items found to have lower reliability are included in quality of care protocols. Study findings suggest that agencies may be well served to perform their own inter-rater reliability testing on a routine basis to identify the items that are most problematic. Because cognitive and behavioral items were most problematic, they should be used cautiously in research endeavors.
Repository Posting Date:
26-Oct-2011
Date of Publication:
17-Oct-2011
Sponsors:
Midwest Nursing Research Society

Full metadata record

DC FieldValue Language
dc.typePresentationen_GB
dc.titleInter-Rater Reliability and Oasisen_GB
dc.identifier.urihttp://hdl.handle.net/10755/161568-
dc.description.abstract<table><tr><td colspan="2" class="item-title">Inter-Rater Reliability and Oasis</td></tr><tr class="item-sponsor"><td class="label">Conference Sponsor:</td><td class="value">Midwest Nursing Research Society</td></tr><tr class="item-year"><td class="label">Conference Year:</td><td class="value">2002</td></tr><tr class="item-author"><td class="label">Author:</td><td class="value">Madigan, Elizabeth, PhD</td></tr><tr class="item-institute"><td class="label">P.I. Institution Name:</td><td class="value">Case Western Reserve University</td></tr><tr class="item-author-title"><td class="label">Title:</td><td class="value">Associate Professor</td></tr><tr class="item-address"><td class="label">Contact Address:</td><td class="value">Frances Payne Bolton School of Nursing, 10900 Euclid Avenue, Cleveland, OH, 44106-4904, USA</td></tr><tr class="item-phone"><td class="label">Contact Telephone:</td><td class="value">216.368.8532</td></tr><tr class="item-email"><td class="label">Email:</td><td class="value">eam13@po.cwru.edu</td></tr><tr><td colspan="2" class="item-abstract">The Outcomes and Assessment Information Set (OASIS) is mandated for use by Medicare home health care agencies. Clinically, many OASIS data items are used to classify home care patients into resource use groups and determine payment to agencies. In addition, agencies use selected OASIS data items to evaluate patient outcomes for quality of care monitoring purposes. Preliminary work indicates that there may be some OASIS items that are problematic from a reliability perspective (Madigan &amp; Fortinsky, 2000). The purpose of this study was to evaluate the inter-rater reliability of selected OASIS items, primarily functional (activities of daily living and instrumental activities of daily living), clinical (dyspnea and pain interfering with activity) and psychosocial (behavioral and depression items). During December 1999 to June 2001, two home health care agency clinicians made home visits to 68 Medicare home health patients from 16 agencies. Kappa statistics were based on the clinicians' agreement on each OASIS item to determine inter-rater scores. The following items were problematic, achieving kappas &lt;0.60: severity of the primary diagnosis, dyspnea, toileting, cognitive functioning, indecisiveness, diminished interest, and memory deficit. For ADL and IADL items, kappas ranged from 0.58 to 0.83 and 0.64 to 0.77, respectively. Conclusions: Inter-rater reliability was highest for functional status OASIS items, and lowest for cognitive and behavioral items. Most items studied that are crucial for determining agency payment based on patients' resource use groups were found to have adequate inter-rater reliability. Some items found to have lower reliability are included in quality of care protocols. Study findings suggest that agencies may be well served to perform their own inter-rater reliability testing on a routine basis to identify the items that are most problematic. Because cognitive and behavioral items were most problematic, they should be used cautiously in research endeavors.</td></tr></table>en_GB
dc.date.available2011-10-26T23:23:30Z-
dc.date.issued2011-10-17en_GB
dc.date.accessioned2011-10-26T23:23:30Z-
dc.description.sponsorshipMidwest Nursing Research Societyen_GB
All Items in this repository are protected by copyright, with all rights reserved, unless otherwise indicated.