The use of the objective structured clinical examination (OSCE) in a practice-based health discipline: Academic and student experience in paramedicine
DOI:
https://doi.org/10.33966/hepj.3.2.14225Abstract
Abstract:
Purpose:
Over the past two decades, the discipline of Paramedicine has seen expediential growth as it moved from a work-based training model to that of an autonomous profession grounded in academia. With limited evidence-based literature examining assessment in paramedicine, this paper aims to describe student and academic views on the preference for OSCE as an assessment modality, the sufficiency of pre-OSCE instruction, and whether or not OSCE performance is a perceived indicator of clinical performance.
Design/Methods:
A voluntary, anonymous survey was conducted to examine the perception of the reliability and validity of the Objective Structured Clinical Examination (OSCE) as an assessment tool by students sitting the examination and the academics that facilitate the assessment.
Findings:
The results of this study revealed that the more confident the students are in the reliability and validity of the assessment, the more likely they are to perceive the assessment as an effective measure of their clinical performance. The perception of reliability and validity differs when acted upon by additional variables, with the level of anxiety associated with the assessment and the adequacy of feedback of performance cited as major influencers.
Research Implications:
The findings from this study indicate the need for further paramedicine discipline specific research into assessment methodologies to determine best practice models for high quality assessment.
Practical Implications:
The development of evidence based best practice guidelines for the assessment of student paramedics should be of the upmost importance to a young, developing profession such as paramedicine.
Originality/Value:
There is very little research in the discipline specific area of assessment for paramedicine and discipline specific education research is essential for professional growth.
Limitations:
The principal researcher was a faculty member of one of the institutions surveyed. However, all data was non identifiable at time of data collection.
Key Words
Paramedic; paramedicine; objective structured clinical examinations; OSCE; education; assessment.
Downloads
References
Adamson, KA Kardong-Edgren, S & Willhaus, J 2013, ‘An updated review of published simulation evaluation instruments’, Clinical Simulation In Nursing, vol. 9, no. 9, pp. 393–e400.
Bartfay, WJ Rombough, R Howse, E & LeBlanc, R 2004, ‘The OSCE approach in nursing education: Objective structured clinical examinations can be effective vehicles for nursing education and practice by promoting the mastery of clinical skills and decision-making in controlled and safe learning environments’, The Canadian Nurse, vol. 100, no. 3, pp.18.
Brand, HS & Schoonheim‐Klein, M 2009, ‘Is the OSCE more stressful? Examination anxiety and its consequences in different assessment methods in dental education’, European Journal of Dental Education, vol. 13, no. 3, pp.147–153.
Carraccio, C & Englander, R 2000, ‘The objective structured clinical examination: A step in the direction of competency-based evaluation’, JAMA Pediatrics, vol. 154, no. 7, pp. 736–41.
Dahwood, E Ghadeer, HA, Mitsu, R Almutary, N & Alenez, B 2016, ‘Relationship between test anxiety and academic achievement among undergraduate nursing students’, Journal of Education and Practice, vol. 7, no. 2, pp. 57–65.
Donaghy, J 2008, ‘Higher education for paramedics—Why?’, Journal of Paramedic Practice, vol. 1, no. 1, pp. 31–5
Donaghy, J. (2018). Continuing Professional Development: Reflecting on our own professional values and behaviours as paramedics. Journal of Paramedic Practice, 10(4), 1-4.
DuToit, SH Steyn, AGW & Stumpf, RH 2012, Graphical exploratory data analysis. Springer Science & Business Media.
Farmer, R Oakman, P & Rice, P 2016, ‘A review of free online survey tools for undergraduate students’, MSOR Connections, vol. 15, no. 1, pp. 71–78.
Graham, R Zubiaurre Bitzer, LA & Anderson, OR 2013, ‘Reliability and predictive validity of a comprehensive preclinical OSCE in dental education’, Journal of Dental Education, vol. 77, no. 2, pp.161–167.
Grebennikov, L & Shah, M 2013, ‘Monitoring trends in student satisfaction’, Tertiary Education and Management, vol. 19, no. 4, pp. 301–322.
Harden, RM 2015, ‘Misconceptions and the OSCE’, Medical Teacher, vol. 37, no. 7, pp. 608–610.
Harden, RM 1988, ‘What is an OSCE?’, Medical Teacher, vol. 10, no. 1, pp. 19–22.
Hastie, MJ Spellman, JL Pagano, PP Hastie, J & Egan, BJ 2014, ‘Designing and implementing the objective structured clinical examination in anesthesiology’, Anesthesiology, vol. 120, no. 1, pp.196–203.
Jansson, M, Kääriäinen, M & Kyngäs, H 2013, ‘Effectiveness of simulation-based education in critical care nurses' continuing education: A systematic review’, Clinical Simulation in Nursing, vol. 9, no. 9, pp. e355–e60.
Jay, A. 2007, ‘Students' perceptions of the OSCE: a valid assessment tool?’, British Journal of Midwifery, vol. 15, no. 1, pp.32–37.
Joshi, A Kale, S Chandel, S & Pal, DK 2015, ‘Likert scale: Explored and explained’, Current Journal of Applied Science and Technology, pp.396–403.
Kelley, K Clark, B Brown, V & Sitzia, J 2003, ‘Good practice in the conduct and reporting of survey research’, International Journal for Quality in Health Care, vol. 15, no. 3, pp. 261–266.
Krishnan, A 2009, ‘What are academic disciplines? Some observations on the disciplinarity vs. interdisciplinarity debate’, in ESRC National Centre for Research Methods (ed.), National Centre for Research Methods, pp. 1–58.
Lefroy, J Watling, C Teunissen, PW & Brand, P 2015, ‘Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education’, Perspectives on Medical Education, vol. 4, no. 6, pp. 284–299.
McKinley, RK Strand, J Gray, T Schuwirth, L Alun-Jones, T & Miller, H 2008, ‘Development of a tool to support holistic generic assessment of clinical procedure skills’, Medical Education, vol. 42, no. 6, pp. 619–627.
Mitchell, ML Henderson, A Groves, M Dalton M & Nulty D 2009, ‘The objective structured clinical examination (OSCE): Optimising its value in the undergraduate nursing curriculum’, Nurse Education Today, vol. 29, no. 4, pp. 398–404.
Nasir, AA Yusuf, AS Abdur-Rahman, LO Babalola, OM Adeyeye, AA & Popoola, AA 2014, ‘Medical students’ perception of objective structured clinical examination: A feedback for process improvement’, Journal of Surgical Education, vol. 71, no. 5, pp. 701–6.
O’Brien, K Moore, A Hartley, P & Dawson, D 2013, ‘Lessons about work readiness from final year paramedic students in an Australian university’, Australasian Journal of Paramedicine, vol. 10 no. 4.
O’Brien, K. Moore, A. Dawson, D & Hartley, P 2014, ‘An Australian story: Paramedic education and practice in transition’ Australasian Journal of Paramedicine, vol. 11, no. 3, pp. 77.
O'Meara, PF Furness, S & Gleeson, R 2017, ‘Educating paramedics for the future: A holistic approach’, Journal of Health & Human Services Administration, vol. 40, no. 2, pp. 219–51.
Pell, G Fuller, R Homer, M & Roberts, T 2012, ‘Is short-term remediation after OSCE failure sustained? A retrospective analysis of the longitudinal attainment of underperforming students in OSCE assessments’, Medical Teacher, vol. 34, no. 2, pp. 146–50.
Rushforth, HE 2007, ‘Objective structured clinical examination (OSCE): Review of literature and implications for nursing education’, Nurse Education Today, vol. 27, no. 5, pp.481–90.
Sheen, L 2003, ‘Developing an objective structured clinical examination for ambulance paramedic education - Introducing an objective structured clinical examination (OSCE) into ambulance paramedic education’, 12th annual Teaching and Learning Forum, Edith Cowan University, Perth.
Swift, M Spake, E & Gajewski, BJ 2013, ‘Student performance and satisfaction for a musculoskeletal objective structured clinical examination’, Journal of Allied Health, vol. 42, no. 4, pp. 214–22.
Tavares, W Boet, S Theriault, R Mallette, T & Eva, KW 2013, ‘Global rating scale for the assessment of paramedic clinical competence’, Prehospital Emergency Care, vol. 17, no. 1, pp. 57–67.
Van De Ridder, JM Stokking, KM McGaghie, WC & Ten Cate, OTJ 2008, ‘What is feedback in clinical education?’, Medical Education, vol. 42, no. 2, pp.189–197.
Von Wyl, T Zuercher, M Amsler, F Walter, B & Ummenhofer, W 2009, ‘Technical and non‐technical skills can be reliably assessed during paramedic simulation training’, Acta Anaesthesiologica Scandinavica, vol. 53, no. 1, pp.121–127.
Williams, B Onsman, A & Brown, T 2009, ‘From stretcher-bearer to paramedic: The Australian paramedics’ move towards professionalisation’, Journal of Emergency Primary Health Care. vol. 7, no. 4.