Student Practice Evaluation Form-Revised Edition online comment bank: development and reliability analysis
- Resource Type
- Authors
- Chi-Wen Chien; Sylvia Rodger; Merrill Turpin; Ted Brown; Jodie Copley; Allison Coleman; Anne Maree Caine
- Source
- Australian occupational therapy journal. 61(4)
- Subject
- Occupational therapy
Male
Medical education
medicine.medical_specialty
Internet
Domain level
business.industry
Perspective (graphical)
Development team
Reproducibility of Results
Feedback
Occupational Therapy
Rating scale
Medicine
Humans
Female
Clinical Competence
Educational Measurement
business
Inclusion (education)
Quality assurance
Reliability (statistics)
- Language
- ISSN
- 1440-1630
BACKGROUND/AIM: The reliable evaluation of occupational therapy students completing practice education placements along with provision of appropriate feedback is critical for both students and for universities from a quality assurance perspective. This study describes the development of a comment bank for use with an online version of the Student Practice Evaluation Form-Revised Edition (SPEF-R Online) and investigates its reliability.METHODS: A preliminary bank of 109 individual comments (based on previous students' placement performance) was developed via five stages. These comments reflected all 11 SPEF-R domains. A purpose-designed online survey was used to examine the reliability of the comment bank. A total of 37 practice educators returned surveys, 31 of which were fully completed. Participants were asked to rate each individual comment using the five-point SPEF-R rating scale.RESULTS: One hundred and two of 109 comments demonstrated satisfactory agreement with their respective default ratings that were determined by the development team. At each domain level, the intra-class correlation coefficients (ranging between 0.86 and 0.96) also demonstrated good to excellent inter-rater reliability. There were only seven items that required rewording prior to inclusion in the final SPEF-R Online comment bank.CONCLUSION: The development of the SPEF-R Online comment bank offers a source of reliable comments (consistent with the SPEF-R rating scale across different domains) and aims to assist practice educators in providing reliable and timely feedback to students in a user-friendly manner.