A Pilot Study of a Metacognitive Skills Diagnostic Test for Nursing Students

2.50
Hdl Handle:
http://hdl.handle.net/10755/149707
Type:
Presentation
Title:
A Pilot Study of a Metacognitive Skills Diagnostic Test for Nursing Students
Abstract:
A Pilot Study of a Metacognitive Skills Diagnostic Test for Nursing Students
Conference Sponsor:Sigma Theta Tau International
Conference Year:2007
Author:Garrett, Judith E., PhD
P.I. Institution Name:University of Arkansas for Medical Sciences
Title:Associate Professor
Co-Authors:Sarah J. Rhoads, DNP, APN; Larronda Rainey, MSN, BS; Linda Calhoun, RN, MNSc
[Leadership session research presentation] Objective: To assess the feasibility of developing a valid and reliable diagnostic pretest of cognitive skills related to metacognition. Methods: Cognitive skills hypothesized to be related to metacognition in two entry-level baccalaureate nursing courses were identified and assessment items were constructed. Although the N was small(54), exploratory factor analysis was used to examine the structure of cognitive tasks involved in pretest items. Regression analysis, including multicollinearity assessment, was used to explore the contribution of each type of skill to achievement. Participants? scores on both the diagnostic test and the two criterion measures were divided into a high and low group. Crosstabs output was used in specificity and sensitivity analyses to assess the extent to which pretest scores accurately identified high and low scoring students on two criterion measures. Results: Cronbach's Alpha for the overall pretest was 0.89. Preliminary exploratory factor analysis suggested that some skills were indeed multi-dimensional depending on whether stimulus materials for test items involved a single concept (e.g., visualizing a sarcomere) or principle (e.g., visualizing how a sarcomere contracts and relaxes). The ability to condense information was a significant in both courses and multicollinearity diagnostics indicated that results were not affected by intercorrelations among variables. Of the students who scored below the group mean in Exam 1 in Health Assessment, 59% had a positive 'pretest' result; i.e., they scored below the group mean (sensitivity) while 81% who scored below the group mean on Exam 1 also had a negative pretest result; i.e., they scored above the group mean (specificity). The magnitude of similar analyses for Foundations was somewhat less (sensitivity = 52% and specificity = 77%). Conclusion: Preliminary results suggest that courses have different metacognitive skills demands. However large-scale tryouts are needed to validate these pilot results.
Repository Posting Date:
26-Oct-2011
Date of Publication:
17-Oct-2011
Sponsors:
Sigma Theta Tau International

Full metadata record

DC FieldValue Language
dc.typePresentationen_GB
dc.titleA Pilot Study of a Metacognitive Skills Diagnostic Test for Nursing Studentsen_GB
dc.identifier.urihttp://hdl.handle.net/10755/149707-
dc.description.abstract<table><tr><td colspan="2" class="item-title">A Pilot Study of a Metacognitive Skills Diagnostic Test for Nursing Students</td></tr><tr class="item-sponsor"><td class="label">Conference Sponsor:</td><td class="value">Sigma Theta Tau International</td></tr><tr class="item-year"><td class="label">Conference Year:</td><td class="value">2007</td></tr><tr class="item-author"><td class="label">Author:</td><td class="value">Garrett, Judith E., PhD</td></tr><tr class="item-institute"><td class="label">P.I. Institution Name:</td><td class="value">University of Arkansas for Medical Sciences</td></tr><tr class="item-author-title"><td class="label">Title:</td><td class="value">Associate Professor</td></tr><tr class="item-email"><td class="label">Email:</td><td class="value">GarrettJudithE@uams.edu</td></tr><tr class="item-co-authors"><td class="label">Co-Authors:</td><td class="value">Sarah J. Rhoads, DNP, APN; Larronda Rainey, MSN, BS; Linda Calhoun, RN, MNSc</td></tr><tr><td colspan="2" class="item-abstract">[Leadership session research presentation] Objective: To assess the feasibility of developing a valid and reliable diagnostic pretest of cognitive skills related to metacognition. Methods: Cognitive skills hypothesized to be related to metacognition in two entry-level baccalaureate nursing courses were identified and assessment items were constructed. Although the N was small(54), exploratory factor analysis was used to examine the structure of cognitive tasks involved in pretest items. Regression analysis, including multicollinearity assessment, was used to explore the contribution of each type of skill to achievement. Participants? scores on both the diagnostic test and the two criterion measures were divided into a high and low group. Crosstabs output was used in specificity and sensitivity analyses to assess the extent to which pretest scores accurately identified high and low scoring students on two criterion measures. Results: Cronbach's Alpha for the overall pretest was 0.89. Preliminary exploratory factor analysis suggested that some skills were indeed multi-dimensional depending on whether stimulus materials for test items involved a single concept (e.g., visualizing a sarcomere) or principle (e.g., visualizing how a sarcomere contracts and relaxes). The ability to condense information was a significant in both courses and multicollinearity diagnostics indicated that results were not affected by intercorrelations among variables. Of the students who scored below the group mean in Exam 1 in Health Assessment, 59% had a positive 'pretest' result; i.e., they scored below the group mean (sensitivity) while 81% who scored below the group mean on Exam 1 also had a negative pretest result; i.e., they scored above the group mean (specificity). The magnitude of similar analyses for Foundations was somewhat less (sensitivity = 52% and specificity = 77%). Conclusion: Preliminary results suggest that courses have different metacognitive skills demands. However large-scale tryouts are needed to validate these pilot results.</td></tr></table>en_GB
dc.date.available2011-10-26T10:07:52Z-
dc.date.issued2011-10-17en_GB
dc.date.accessioned2011-10-26T10:07:52Z-
dc.description.sponsorshipSigma Theta Tau Internationalen_GB
All Items in this repository are protected by copyright, with all rights reserved, unless otherwise indicated.