Development of a Criterion-Referenced Test for Unlicensed Assistive Personnel Knowledge

2.50
Hdl Handle:
http://hdl.handle.net/10755/156759
Type:
Presentation
Title:
Development of a Criterion-Referenced Test for Unlicensed Assistive Personnel Knowledge
Abstract:
Development of a Criterion-Referenced Test for Unlicensed Assistive Personnel Knowledge
Conference Sponsor:Sigma Theta Tau International
Conference Year:2004
Conference Date:July 22-24, 2004
Author:Newhouse, Robin Purdy, RN, PhD
P.I. Institution Name:The Johns Hopkins Hospital/University School of Nursing
Title:Nurse Researcher/Assistant Professor
Co-Authors:Michele Margie Steinhauser, RN, MS
Objective: To provide a criterion referenced test to screen for knowledge of basic safe practices for Unlicensed Assistive Personnel (UAP), the specific aims were to; 1) construct test with four essential knowledge based domains and; 2) achieve acceptable estimates of reliability and validity for the test so that it can be used for applicant screening. Design: Test development, psychometric estimates of reliability and validity. Population, Sample, Setting, and Years: One hundred fifty-seven UAPs from 2002 to 2003. Concept or Variables Studied Together or Intervention and Outcome Variable(s): Knowledge competency in identified areas with the potential to affect patient safety (math, patient data collection, medical terminology, and reporting abnormal data). Methods: Test construction, test- retest reliability, inter-rater reliability, content validity, construct validity (predictive models of skill competence for knowledge), and item analysis. Findings: Content Validity Index was 1.0 after five rounds with content experts. Inter-rater agreement was 72%, yet the level of agreement was significantly related to test scores (r= .458. p= .008). There was no significant difference in test one and test two scores. Test scores were significantly different in those that did and did not demonstrate vital sign competency (t=-2.411, df=30, p=. 022). Using a cut score of 17 or greater resulted in identification of 87% masters and 100% non-masters with a Phi Coefficient of .412 (p=. 020). These correct classifications were maintained in test-retest results. Conclusions: Acceptable estimates of reliability and validity were achieved. A cut score of 17 will result in acceptable classification of masters and non-masters. Implications: Methods to test UAP essential knowledge and skills are fundamental to support practicing nurses and promote patient safety. This research has resulted in a criterion-referenced test that can be used to screen UAPs prior to a clinical interview.
Repository Posting Date:
26-Oct-2011
Date of Publication:
22-Jul-2004
Sponsors:
Sigma Theta Tau International

Full metadata record

DC FieldValue Language
dc.typePresentationen_GB
dc.titleDevelopment of a Criterion-Referenced Test for Unlicensed Assistive Personnel Knowledgeen_GB
dc.identifier.urihttp://hdl.handle.net/10755/156759-
dc.description.abstract<table><tr><td colspan="2" class="item-title">Development of a Criterion-Referenced Test for Unlicensed Assistive Personnel Knowledge</td></tr><tr class="item-sponsor"><td class="label">Conference Sponsor:</td><td class="value">Sigma Theta Tau International</td></tr><tr class="item-year"><td class="label">Conference Year:</td><td class="value">2004</td></tr><tr class="item-conference-date"><td class="label">Conference Date:</td><td class="value">July 22-24, 2004</td></tr><tr class="item-author"><td class="label">Author:</td><td class="value">Newhouse, Robin Purdy, RN, PhD</td></tr><tr class="item-institute"><td class="label">P.I. Institution Name:</td><td class="value">The Johns Hopkins Hospital/University School of Nursing</td></tr><tr class="item-author-title"><td class="label">Title:</td><td class="value">Nurse Researcher/Assistant Professor</td></tr><tr class="item-email"><td class="label">Email:</td><td class="value">rnewhou1@jhmi.edu</td></tr><tr class="item-co-authors"><td class="label">Co-Authors:</td><td class="value">Michele Margie Steinhauser, RN, MS</td></tr><tr><td colspan="2" class="item-abstract">Objective: To provide a criterion referenced test to screen for knowledge of basic safe practices for Unlicensed Assistive Personnel (UAP), the specific aims were to; 1) construct test with four essential knowledge based domains and; 2) achieve acceptable estimates of reliability and validity for the test so that it can be used for applicant screening. Design: Test development, psychometric estimates of reliability and validity. Population, Sample, Setting, and Years: One hundred fifty-seven UAPs from 2002 to 2003. Concept or Variables Studied Together or Intervention and Outcome Variable(s): Knowledge competency in identified areas with the potential to affect patient safety (math, patient data collection, medical terminology, and reporting abnormal data). Methods: Test construction, test- retest reliability, inter-rater reliability, content validity, construct validity (predictive models of skill competence for knowledge), and item analysis. Findings: Content Validity Index was 1.0 after five rounds with content experts. Inter-rater agreement was 72%, yet the level of agreement was significantly related to test scores (r= .458. p= .008). There was no significant difference in test one and test two scores. Test scores were significantly different in those that did and did not demonstrate vital sign competency (t=-2.411, df=30, p=. 022). Using a cut score of 17 or greater resulted in identification of 87% masters and 100% non-masters with a Phi Coefficient of .412 (p=. 020). These correct classifications were maintained in test-retest results. Conclusions: Acceptable estimates of reliability and validity were achieved. A cut score of 17 will result in acceptable classification of masters and non-masters. Implications: Methods to test UAP essential knowledge and skills are fundamental to support practicing nurses and promote patient safety. This research has resulted in a criterion-referenced test that can be used to screen UAPs prior to a clinical interview.</td></tr></table>en_GB
dc.date.available2011-10-26T15:06:31Z-
dc.date.issued2004-07-22en_GB
dc.date.accessioned2011-10-26T15:06:31Z-
dc.description.sponsorshipSigma Theta Tau Internationalen_GB
All Items in this repository are protected by copyright, with all rights reserved, unless otherwise indicated.