Objective structured clinical examination

Last updated August 04, 2024

An objective structured clinical examination(OSCE) is an approach to the assessment of clinical competence in which the components are assessed in a planned or structured way with attention being paid to the objectivity of the examination which is basically an organization framework consisting of multiple stations around which students rotate and at which students perform and are assessed on specific tasks.^[1] OSCE is a modern^[2] type of examination often used for assessment in health care disciplines.

History and purpose

The development of OSCE is credited to Ronald Harden. Since the publication of the first paper in the British Medical Journal in 1975, OSCE has been widely adopted in many medical schools and professional bodies. The format of OSCE is continuously evolving and may include real or simulated patients, clinical specimens, and other clinical materials. OSCE is primarily used to assess focused clinical skills such as history taking, physical examination, diagnosis, communication, and counseling.^[3]^{[ page needed ]}

In the last three decades the OSCE has seen a steady exponential growth and usage in both undergraduate and postgraduate examinations around the globe. OSCEs are also used for licensure examinations and as a feedback tool in formative settings. Common uses of the OSCE include:^[1]

as a performance based assessment tool for testing the minimum accepted standards of students or trainees as barrier (exit) examinations during the undergraduate years in most of the medical schools
as a postgraduate high stakes assessment tool in Royal College examinations
as a formative assessment tool in undergraduate medical education
as a tool for the assessment of graduates seeking highstakes licensure and certification to practise medicine
as an educational tool to provide immediate feedback

Objective structured clinical examinations evaluate learners "showing how" to perform complex clinical tasks including those infrequently observed and those core to practice.^[4]

Design

An OSCE usually consists of a circuit of short stations, usually 5–10 minutes, though some use up to 15 minutes. In each station, the candidate is examined on a one-to-one basis with one or two examiner(s) and either real or simulated (actors or electronic patient simulators) patients. Each station has a different examiner, as opposed to the traditional method of clinical examinations where a candidate would be assigned to one examiner for the entire examination. Candidates rotate through the stations, completing all the stations on their circuit. In this way, all candidates take the same stations. It is considered to be an improvement over traditional examination methods^{[ citation needed ]} because the stations can be standardised, enabling fairer peer comparison and complex procedures can be assessed without endangering patients health.^{[ clarification needed ]}

OSCEs are designed to assess candidates' clinical skills more objectively. This is done by giving all candidates the same stations (though signs of real patients may vary slightly), where they are assessed with the same marking scheme and awarded marks for each step performed correctly. If theoretical knowledge is examined, such as with the examiner asking questions at the end of the station, the questions will also be standardised. The candidate will only be asked questions on the marking scheme, and will not be awarded marks for any other questions asked.

OSCEs are also designed to be structured, with instructions carefully written to ensure that the candidate has a very specific task to complete in each station. Where simulated patients are used, detailed scripts are provided to ensure that the information provided is the same for all candidates, even including the emotions displayed by the patient. The examination is carefully structured to include parts from all elements of the curriculum as well as a wide range of skills.

Variation

There are several variations of OSCE, those are:^[1]

Objective Structured Practical Examination (OSPE), which assess practical skills, knowledge and/or interpretation of data in non clinical settings.
Objective Structured Assessment of Technical Skills (OSATS), which designed for objective skills assessment, consisting of a global rating scale and a procedure specific checklist. It is primarily used for feedback or measuring progress of training in surgical specialities.
Objective Structured Video Examinations (OSVE). The variation consists of videotaped recordings of patient-doctor encounters are shown to students simultaneously and questions related to the video clip are asked. Written answers are marked in a standardised manner.
Team Objective Structured Clinical Examination (TOSCE). Formative assessment covering common consultations in general practice. A team of students visits each station in a group, performing one task each in a sequence. The candidates are marked for their performance and feedback is provided. The team approach improves efficiency and encourages learning from peers.

Advantages

The advantages of OSCE are:^[3]^{[ page needed ]}

Broader content coverage: Unlike the conventional short or long case examination format, multi-station OSCE allows broader content and domain coverage.
Decreased bias: Student performance in each station is marked by independent examiners on a predetermined marking template that is customized to each patient scenario, thus reduces the variability of examination.
Practicability: OSCE allows the use of simulated patients and clinical materials, thereby decreasing the need for real patients during the examination.

Disadvantages

The disadvantages of OSCE are:^[3]^{[ page needed ]}

Fragmentation of tasks: OSCE is often criticized for fragmenting a physician’s task as the candidates are asked to focus on a particular task, thus potentially undermines what a physician is expected to do in real life.
Construct invalidity: OSCE is based on a predefined list of activities that a candidate is required to perform during the examination. However, this may not be a true reflection of how a competent and experienced physician works in real life.
Preparation time and budget: The preparation time for simulated patient (SP)-based OSCE is longer, as it includes script writing, training, and pilot testing. It may take several sessions for an SP to become familiar with the case and realistically portray the findings in a consistent manner. The increased budget needed to run a successful SP program is also a valid concern.

Marking

Marking in OSCEs is done by the examiner. Occasionally written stations, for example, writing a prescription chart, are used and these are marked like written examinations, again usually using a standardized mark sheet. One of the ways an OSCE is made objective is by having a detailed mark scheme and standard set of questions. For example, a station concerning the demonstration to a simulated patient on how to use a metered dose inhaler (MDI) would award points for specific actions which are performed safely and accurately. The examiner can often vary the marks depending on how well the candidate performed the step. At the end of the mark sheet, the examiner often has a small number of marks that they can use to weight the station depending on performance and if a simulated patient is used, then they are often asked to add marks depending on the candidates approach. At the end, the examiner is often asked to give a "global score". This is usually used as a subjective score based on the candidates overall performance, not taking into account how many marks the candidate scored. The examiner is usually asked to rate the candidate as pass/borderline/fail or sometimes as excellent/good/pass/borderline/fail. This is then used to determine the individual pass mark for the station.

Many centres allocate each station an individual pass mark. The sum of the pass marks of all the stations determines the overall pass mark for the OSCE. Many centres also impose a minimum number of stations required to pass which ensures that a consistently poor performance is not compensated by a good performance on a small number of stations.

There are, however, criticisms that the OSCE stations can never be truly standardized and objective in the same way as a written exam. It has been known for different patients / actors to afford more assistance, and for different marking criteria to be applied. Finally, it is not uncommon at certain institutions for members of teaching staff be known to students (and vice versa) as the examiner. This familiarity does not necessarily affect the integrity of the examination process, although there is a deviation from anonymous marking. However, in OSCEs that use several circuits of the same stations the marking is repeatedly shown to be very consistent which supports the validity that the OSCE is a fair clinical examination. There are arguments for and against quarantining OSCE examinees to prevent sharing of exam information.^[5] Although the data tend to show no improvement in the overall scores in a later OSCE session, the research methodology is flawed and validity of the claim is questionable.^[6] A study suggested that marks do not give a sound inference of student collusion in an OSCE.^[7]

Preparation

Preparing for OSCEs is very different from preparing for an examination on theory. In an OSCE, clinical skills are tested rather than pure theoretical knowledge.^{[ importance? ]} It is essential to learn correct clinical methods, and then practice repeatedly until one perfects the methods whilst simultaneously developing an understanding of the underlying theory behind the methods used.^{[ importance? ]} Marks are awarded for each step in the method; hence, it is essential to dissect the method into its individual steps, learn the steps, and then learn to perform the steps in a sequence.

Most hospitals and universities have clinical skills labs where students have the opportunity to practice clinical skills such as taking blood or mobilizing patients in a safe and controlled environment. It is often very helpful to practise in small groups with colleagues, setting a typical OSCE scenario and timing it with one person role playing a patient, one person doing the task and if possible, one person either observing and commenting on technique or even role playing the examiner using a sample mark sheet. Many OSCE textbooks have sample OSCE stations and mark sheets that can be helpful when studying in the manner. In doing this the candidate is able to get a feel of running to time and working under pressure.

In many OSCEs the stations are extended using data interpretation. For example, the candidate may have to take a brief history of chest pain and then interpret an electrocardiogram. It is also common to be asked for a differential diagnosis, to suggest which medical investigations the candidate would like to do or to suggest a management plan for the patient.

The peer-assisted mock OSCE improved tutee confidence, reduced the anxieties associated with OSCEs, and improved candidate confidence for OSCE.^[8]^[9]

Related Research Articles

In a physical examination, medical examination, clinical examination, or medical checkup, a medical practitioner examines a patient for any possible medical signs or symptoms of a medical condition. It generally consists of a series of questions about the patient's medical history followed by an examination based on the reported symptoms. Together, the medical history and the physical examination help to determine a diagnosis and devise the treatment plan. These data then become part of the medical record.

Electronic assessment, also known as digital assessment, e-assessment, online assessment or computer-based assessment, is the use of information technology in assessment such as educational assessment, health assessment, psychiatric assessment, and psychological assessment. This covers a wide range of activities ranging from the use of a word processor for assignments to on-screen testing. Specific types of e-assessment include multiple choice, online/electronic submission, computerized adaptive testing such as the Frankfurt Adaptive Concentration Test, and computerized classification testing.

Membership of the Royal Colleges of Physicians of the United Kingdom (MRCP(UK)) is a postgraduate medical diploma in the United Kingdom (UK). The examinations are run by the Federation of the Medical Royal Colleges – the Royal College of Physicians of London, the Royal College of Physicians of Edinburgh, and the Royal College of Physicians and Surgeons of Glasgow. The three Royal Colleges of Physicians share this common three part assessment in general medicine which consists of two written parts and one clinical examination. Examinations are held throughout the UK and in overseas centres.

An eye examination is a series of tests performed to assess vision and ability to focus on and discern objects. It also includes other tests and examinations pertaining to the eyes. Eye examinations are primarily performed by an optometrist, ophthalmologist, or an orthoptist. Health care professionals often recommend that all people should have periodic and thorough eye examinations as part of routine primary care, especially since many eye diseases are asymptomatic.

The Australian Medical Council (AMC) is an independent national standards and assessment body for medical education and training. It was established in 1985.

Palpation is the process of using one's hands to check the body, especially while perceiving/diagnosing a disease or illness. Usually performed by a health care practitioner, it is the process of feeling an object in or on the body to determine its size, shape, firmness, or location.

Step 2 Clinical Skills of the United States Medical Licensing Examination (USMLE) was an exam administered to medical students/graduates who wish to become licensed physicians in the U.S. It is similar to the COMLEX-USA Level 2-PE exam, taken by osteopathic medical students/graduates who seek licensure as physicians in the U.S. For US medical students, the exam fee is $1,300. For medical students at non-US medical schools, the tests cost is higher—currently $1,535. These fees do not include costs associated with travel and lodging to take the test. Historically, US students have taken Step 2 CS late in their senior year, prior to graduation. However, now that more residency programs require students to record a passing score, many US medical schools recommend students take Step 2 CS in the fall of their senior year.

Medical education is education related to the practice of being a medical practitioner, including the initial training to become a physician and additional training thereafter.

Nursing assessment is the gathering of information about a patient's physiological, psychological, sociological, and spiritual status by a licensed Registered Nurse. Nursing assessment is the first step in the nursing process. A section of the nursing assessment may be delegated to certified nurses aides. Vitals and EKG's may be delegated to certified nurses aides or nursing techs. It differs from a medical diagnosis. In some instances, the nursing assessment is very broad in scope and in other cases it may focus on one body system or mental health. Nursing assessment is used to identify current and future patient care needs. It incorporates the recognition of normal versus abnormal body physiology. Prompt recognition of pertinent changes along with the skill of critical thinking allows the nurse to identify and prioritize appropriate interventions. An assessment format may already be in place to be used at specific facilities and in specific circumstances.

The term virtual patient is used to describe interactive computer simulations used in health care education to train students on clinical processes such as making diagnoses and therapeutic decisions. Virtual patients attempt to combine modern technologies and game-based learning to facilitate education, and complement real clinical training. The use of virtual patients is increasing in healthcare due to increased demand for healthcare professionals and education of healthcare trainees, and provides learners with a safe practice environment. There are many formats from which a virtual patient may be chosen, but the overarching principle is that of interactivity. Virtual patients typically have mechanisms where information is parsed out in response to the learners, simulating how patients respond to different treatments. Interactivity can be created with questions, specific decision-making tasks, text composition, etc., and is non-sequential. Most systems provide quantitative and qualitative feedback. In some cases, virtual patients are not full simulations themselves, but are mainly based on paper-based cases; as they do not allow for physical examination or an in-depth medical history of an actual patient. There are certain drawbacks as crucial clinical findings may be missed due to the lack of examining patients in person.

A Paramedic in Australia is a health care professional who holds a minimum of a Bachelor's Degree in Paramedicine and is registered with the Paramedicine Board of Australia via the Australian Health Practitioners Regulation Agency (AHPRA) As of December 2021, there are over 22,500 registered paramedics in Australia, of which approximately 70% (15,750) work for a jurisdictional service, and of which 47% of which are female. Paramedics in Australia may undergo further training and complete a Master's Degree to specialise in either Intensive Care or Primary Care medicine.

In health care, a simulated patient (SP), also known as a standardized patient, sample patient, or patient instructor, is an individual trained to act as a real patient in order to simulate a set of symptoms or problems. Simulated patients have been successfully utilized for education, evaluation of health care professionals, as well as basic, applied, and translational medical research.

A pelvic examination is the physical examination of the external and internal female pelvic organs. It is frequently used in gynecology for the evaluation of symptoms affecting the female reproductive and urinary tract, such as pain, bleeding, discharge, urinary incontinence, or trauma. It can also be used to assess a woman's anatomy in preparation for procedures. The exam can be done awake in the clinic and emergency department, or under anesthesia in the operating room. The most commonly performed components of the exam are 1) the external exam, to evaluate the vulva 2) the internal exam with palpation to examine the uterus, ovaries, and structures adjacent to the uterus (adnexae) and 3) the internal exam using a speculum to visualize the vaginal walls and cervix. During the pelvic exam, sample of cells and fluids may be collected to screen for sexually transmitted infections or cancer.

Psychological evaluation is a method to assess an individual's behavior, personality, cognitive abilities, and several other domains. A common reason for a psychological evaluation is to identify psychological factors that may be inhibiting a person's ability to think, behave, or regulate emotion functionally or constructively. It is the mental equivalent of physical examination. Other psychological evaluations seek to better understand the individual's unique characteristics or personality to predict things like workplace performance or customer relationship management.

Medical simulation, or more broadly, healthcare simulation, is a branch of simulation related to education and training in medical fields of various industries. Simulations can be held in the classroom, in situational environments, or in spaces built specifically for simulation practice. It can involve simulated human patients, educational documents with detailed simulated animations, casualty assessment in homeland security and military situations, emergency response, and support for virtual health functions with holographic simulation. In the past, its main purpose was to train medical professionals to reduce errors during surgery, prescription, crisis interventions, and general practice. Combined with methods in debriefing, it is now also used to train students in anatomy, physiology, and communication during their schooling.

Member of the Royal College of Psychiatrists (MRCPsych) is a prestigious postnominal qualification awarded to physicians who have completed the prescribed training requirements and membership examinations mandated by the Royal College of Psychiatrists. MRCPsych is awarded after the completion of the required amount of clinical practice and successful completion of rigorous examinations. A further three years within psychiatry and a certificate of completion of specialist training are required to register as a psychiatrist on the General Medical Council specialist register. The examination has undergone a radical change in the past few years, notably in terms of focus and structure.

The National Institutes of Health Stroke Scale, or NIH Stroke Scale (NIHSS), is a tool used by healthcare providers to objectively quantify the impairment caused by a stroke and aid planning post-acute care disposition, though was intended to assess differences in interventions in clinical trials. The NIHSS was designed for the National Institute of Neurological Disorders and Stroke (NINDS) Recombinant Tissue Plasminogen Activator (rt-PA) for Acute Stroke Trial and was first published by neurologist Dr. Patrick Lyden and colleagues in 2001. Prior to the NIHSS, during the late 1980s, several stroke-deficit rating scales were in use.

In recruitment, the multiple mini-interview (MMI) is an interview format that uses many short independent assessments, typically in a timed circuit, to obtain an aggregate score of each candidate's soft skills. In 2001, the McMaster University Medical School began developing the MMI system, to address two widely recognized problems. First, it has been shown that traditional interview formats or simulations of educational situations do not accurately predict performance in medical school. Secondly, when a licensing or regulatory body reviews the performance of a physician subsequent to patient complaints, the most frequent issues of concern are those of the non-cognitive skills, such as interpersonal skills, professionalism and ethical/moral judgment. Since its formal introduction at McMaster University Medical School in 2004, it has been adopted by medical, dental, pharmacy, and veterinary schools around the world.

Adaptive comparative judgement is a technique borrowed from psychophysics which is able to generate reliable results for educational assessment – as such it is an alternative to traditional exam script marking. In the approach, judges are presented with pairs of student work and are then asked to choose which is better, one or the other. By means of an iterative and adaptive algorithm, a scaled distribution of student work can then be obtained without reference to criteria.

Membership of the Royal College of General Practitioners (MRCGP) is a postgraduate medical qualification in the United Kingdom (UK) run by the Royal College of General Practitioners (RCGP). On successful completion of the assessment, general practitioners are eligible to use the post-nominal letters MRCGP that indicate Membership of the RCGP.

References

1 2 3 Khan, Kamran Z.; Ramachandran, Sankaranarayanan; Gaunt, Kathryn; Pushkar, Piyush (2013). "The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective". Medical Teacher. 35 (9): e1437–e1446. doi: 10.3109/0142159X.2013.818634 . ISSN 0142-159X. PMID 23968323. S2CID 28150274.
↑ Harden, R M; Stevenson, M; Downie, W W; Wilson, G M (1975). "Assessment of clinical competence using objective structured examination". BMJ. 1 (5955): 447–451. doi:10.1136/bmj.1.5955.447. PMC 1672423 . PMID 1115966.
1 2 3 Amin, Zubair; Eng, Khoo Hoon (2009). Basics in Medical Education (2 ed.). WORLD SCIENTIFIC. doi:10.1142/7044. ISBN 978-981-283-538-3.
↑ Criscione-Schreiber, Lisa (2020). "Turning Objective Structured Clinical Examinations into Reality". Rheumatic Disease Clinics of North America. 46 (1): 21–35. doi:10.1016/j.rdc.2019.09.010. PMID 31757285. S2CID 208234190.
↑ "Calls to ensure end-of-year exam fairness". BMA - Connecting doctors. Retrieved 2017-04-13.
↑ Yeung, E (April 2, 2017). "Sharing of information in objective structured clinical examinations -- does no evidence of difference mean evidence of no difference?". BMJ Open. 6 (10): e012541. doi:10.1136/bmjopen-2016-012541. PMC 5073653 . PMID 27729351.
↑ Parks, R; Warren, P M; Boyd, K M; Cameron, H; Cumming, A; Lloyd-Jones, G (2006). "The Objective Structured Clinical Examination and student collusion: Marks do not tell the whole truth". Journal of Medical Ethics. 32 (12): 734–738. doi:10.1136/jme.2005.015446. PMC 2563344 . PMID 17145916.
↑ Young, Ian; Montgomery, Kieran; Kearns, Patrick; Hayward, Samantha; Mellanby, Ed (7 May 2014). "The benefits of a peer-assisted mock OSCE". The Clinical Teacher. 11 (3): 214–218. doi:10.1111/tct.12112. PMID 24802924. S2CID 12122898.
↑ Braier-Lorimer, Darryl Alexander; Warren-Miell, Hannah (2021-11-25). "A peer-led mock OSCE improves student confidence for summative OSCE assessments in a traditional medical course". Medical Teacher. 44 (5): 535–540. doi: 10.1080/0142159X.2021.2004306 . ISSN 0142-159X. PMID 34822315. S2CID 244660969.

External links

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[:1-1] 1 2 3 Khan, Kamran Z.; Ramachandran, Sankaranarayanan; Gaunt, Kathryn; Pushkar, Piyush (2013). "The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective". Medical Teacher. 35 (9): e1437–e1446. doi: 10.3109/0142159X.2013.818634 . ISSN 0142-159X. PMID 23968323. S2CID 28150274.

[2] Harden, R M; Stevenson, M; Downie, W W; Wilson, G M (1975). "Assessment of clinical competence using objective structured examination". BMJ. 1 (5955): 447–451. doi:10.1136/bmj.1.5955.447. PMC 1672423 . PMID 1115966.

[:0-3] 1 2 3 Amin, Zubair; Eng, Khoo Hoon (2009). Basics in Medical Education (2 ed.). WORLD SCIENTIFIC. doi:10.1142/7044. ISBN 978-981-283-538-3.

[4] Criscione-Schreiber, Lisa (2020). "Turning Objective Structured Clinical Examinations into Reality". Rheumatic Disease Clinics of North America. 46 (1): 21–35. doi:10.1016/j.rdc.2019.09.010. PMID 31757285. S2CID 208234190.

[5] "Calls to ensure end-of-year exam fairness". BMA - Connecting doctors. Retrieved 2017-04-13.

[6] Yeung, E (April 2, 2017). "Sharing of information in objective structured clinical examinations -- does no evidence of difference mean evidence of no difference?". BMJ Open. 6 (10): e012541. doi:10.1136/bmjopen-2016-012541. PMC 5073653 . PMID 27729351.

[7] Parks, R; Warren, P M; Boyd, K M; Cameron, H; Cumming, A; Lloyd-Jones, G (2006). "The Objective Structured Clinical Examination and student collusion: Marks do not tell the whole truth". Journal of Medical Ethics. 32 (12): 734–738. doi:10.1136/jme.2005.015446. PMC 2563344 . PMID 17145916.

[8] Young, Ian; Montgomery, Kieran; Kearns, Patrick; Hayward, Samantha; Mellanby, Ed (7 May 2014). "The benefits of a peer-assisted mock OSCE". The Clinical Teacher. 11 (3): 214–218. doi:10.1111/tct.12112. PMID 24802924. S2CID 12122898.

[9] Braier-Lorimer, Darryl Alexander; Warren-Miell, Hannah (2021-11-25). "A peer-led mock OSCE improves student confidence for summative OSCE assessments in a traditional medical course". Medical Teacher. 44 (5): 535–540. doi: 10.1080/0142159X.2021.2004306 . ISSN 0142-159X. PMID 34822315. S2CID 244660969.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]