Practical Nursing Data Analysis, 2013-2014

<< Back to Practical Nursing

Outcome 1:  Effectively communicate by sharing accurate information through various technologies thus promoting multidisciplinary team and client collaboration to provide effective nursing care.
Project A:  ATI-PN Mental Health Exam
Success Standard: 70% of students will score a 66% or higher on the subscale of questions (Note- due to the difficulty of the questions, 66% is on par with the national mean proficiency.)  Item analysis is not available due to security established by the testing company ATI.

Data Indicating Strengths: Slight improvement for Vincennes campus students for Summer 2013. See Trends below.
Data Indicating Weaknesses: For Summer 2013, 42% of students scored greater than 66% (58% scored less than 66%).  The success standard was not met.  For the Vincennes campus, 46.87% met the criteria, 53.12% did not.  For the Jasper campus, only 33.33% met the standard, 66.66% did not. VUJ students went from 50% below standard to 66.66% (see Trend data below).
Data Indicating Trends: For 2012, Vincennes had 54% of students not meet the success standard, and Jasper had 50% of students not meet the standard. That compares with 2013 – Vincennes, 53.12 and Jasper, 66.66% did not meet the standard. Summer 2011 test results were from a different test plan – so non comparable.
Project B:  Therapeutic Communication Final Examination Questions
Success Standard: 70% of the students will score 75% or higher on this subscale of questions. Item analysis will be done to evaluate for specific areas of concerns and weaknesses.
Data Indicating Strengths: The success standard was met.  Jasper – 94.44% (17/18) scored above 75%; Vincennes – 91.66% (22/24) scored above 75%.  Combined, 92.88% (39/42) met the success standard.
Item 1, dealing with active listening and communication, and item 5, dealing with listening and observation, were 100% for both groups of students.
Item 2, dealing with nursing response, and item 3, dealing with empathy, were 83.33% for Vincennes and 94.44% correct responses for Jasper.
Item 4, keeping information confidential, scored at 83.33% correct for both campuses.
Data Indicating Weaknesses: No weaknesses noted.
Data Indicating Trends: , “N/A – items used differed from previous years, so trend data is not available.”
Analysis:  The results of assessment suggest students have an understanding of the therapeutic communication based on exam items. The results from standardized testing however do not support that students have a good understanding of communication information.  More detailed ATI information would be of a benefit for more detailed analysis. The program has switched to a different testing company, Kaplan.
Outcome 2: Provide health education for clients under the direction of a registered nurse to promote adaptation to health changes and achieve optimal levels of wellness.
Project A:  Health Education Final Exam Questions
Success Standard: 70% of the students will score a 75% or higher on this subscale of questions. Item analysis will be done to evaluate for specific areas of concerns and weaknesses.
Data Indicating Strengths: Overall, 87.5% of students met the success standard: Vincennes – 87.5% scored above 75%; Jasper – 87.5% scored above 75%.
Items 1 &2 were questions about identifying the correct domain of learning. Item 1: Vincennes - 87.5%, Jasper - 83.33%. Item 2: Vincennes - 87.5%
Item 4 dealt with teaching when the client is physically and psychologically ready: Vincennes – 95.83%, Jasper – 83.33%.
Data Indicating Weaknesses: Jasper students scored 55.55% on Item 2 dealing with the psychomotor domain of learning. Item 3 was a lower scoring item for both campuses – Jasper, 72.2%, and Vincennes, 66.66% - the item dealt with collecting pertinent data from the patient.
Data Indicating Trends: Overall, 97% of the students met the bench mark in 2012 compared to 87.5% in 2013/2014; however, 2012 utilized 3 items for assessment, but 4 items were utilized for 2013/2014 , so individual items are impossible to trend. 
Project B:  Medication Teaching Poster
Success Standard: 80% of students will score a 75% or higher on the grading rubric for their respective poster. Results will be broken down to see which categories of the rubric the students scored the strongest and the weakest.
Data Indicating Strengths: 100% of students from both campuses exceeded the success standard.
Data Indicating Weaknesses: Although no learning weaknesses were noted, a few Vincennes students lost points for submitting the assignment late – needs to be added to the rubric.
Data Indicating Trends: The students have scored at the 100% level for the 3rd year of assessment.
Analysis: Students met the success standards for both projects dealing with educating patients, which suggests students have mastered the content.  A narrow point range on the rubric for grading Project B does not give a very big range for scoring, which gives most students the maximum points.  The rubric could be further developed to give the user more choices, which might help with so many students getting 100%.  Also, because a few students lost points for submitting their assignment late, “submitting assignment on time” will be a dimension added to the rubric.
The Geriatric Education poster was presented to a group of older adults at a Senior Center for Vincennes campus for 2013/2014 to enhance the assignment by actually presenting the education poster. Students had to consider things like – is the print large enough for older adults to see, did they use examples that seniors could relate to, colors the older eye can see easier, etc. Faculty are considering enhancing the assignment to include aspects of teaching the older adult into the rubric.