Code : 9345-352486      Created Date : Saturday, March 4, 2017   Visit : 1420

Ther report of AMEE (The Association for Medical Education in Europe) by Dr. Sara Mortaz Hejri

Ther report of AMEE (The Association for Medical Education in Europe) by Dr. Sara Mortaz Hejri
Application Code :
306-0216-0152
 
Created Date : Tuesday, September 27, 2016-13:07 13:07:27Update Date : Sunday, December 18, 2016-14:46 14:46:33
IP Address : 192.168.63.104Submit Date : Sunday, December 18, 2016-14:46 14:46:39Email :smortaz@sina.tums.ac.ir
Personal Information
Name : Sara
Surname : Mortaz Hejri
School/Research center : Educational Development Center
If you choose other, please name your Research center :  
Position : Assistant professor
Tel : +98-21-88955712
Information of Congress
Title of the Congress : AMEE (The Association for Medical Education in Europe)
Title of your Abstract : Developing an optimal model for sequential OSCE using CTT and IRT based psychometric properties
Destination Country : Spain
From : Saturday, August 27, 2016
To : Wednesday, August 31, 2016
Abstract(Please copy/paste the abstract send to the congress) : Developing an optimal model for sequential OSCE using CTT and IRT based psychometric properties
Introduction: In objective structured clinical examination (OSCE), an increase in the number of stations is associated with an increase in reliability, but is more resource-consuming. Hence, sequential testing has been proposed in which all students first participate in a short test. Students who fail this test will participate in the supplementary OSCE. The results
of the screening test should be able to predict the students’ performance in the main test with a reasonable accuracy. The purpose of this dissertation was to introduce an optimal screening test based on the following factors: number of screening test stations, method of selecting screening test stations, and the cut-scores of the screening test
Methods: We used two datasets from a 10-station OSCE. Psychometric properties of stations were determined according to classical test theory (CTT) and item response theory (IRT). Then, several hypothetical screening tests were designed with
different numb rs of stations (three modes), different psychometric properties (5 modes in CTT and 2 modesin IRT), and different cut-scores (two levels: normal and stringent). Each hypothetical screening was compared to the main test. A desirable composite outcome was defined for each screening test, comprising of: passing percentage of more than 50%,
positive predective value (PPV) equal to one, and
negative predective value (NPV) greater than 0.25
Results: The OSCEs failure rates were 5.7% (n=6) and
10.9% (n=29) in 2011 and 2013, respectively. According
to CTT-based screening tests, 20 out of 60 hypothetical OSCEs yielded the desirable outcome.
Fourteen out of these 20 tests had stringent pass levels. The number of stations were as follows: 9 tests had five stations, 5 tests had four stations and 6 tests had three stations. According to IRT-based screening tests, 2 out of 6 OSCEs had the desirable outcome.
Both these tests were composed of stations with high discrimination value and had stringent cut-score. One test had 5 stations, and the other had 4 stations. Discussion: We proposed and evaluated an optimal model for the sequential design of an OSCE. While several studies have investigated different aspects of sequential OSCE, we believe this disssertation adds to the existing literature in several ways: For designing the reening OSCEs, we simultaneously considered three factors: number of stations, criteria for selection, and the cut-off score. None of the previous
studies have taken all three parameters into account in
their model. We also defined a composite outcome for valuating the accuracy of the screening tests, while previous studies have considered various separate
Keywords of your Abstract : sequential, OSCE, psychometric.
Acceptance Letter : http://gsia.tums.ac.ir/images/UserFiles/33293/Forms/306/acceptance.pdf
The presentation : Oral
The Cover of Abstract book : http://gsia.tums.ac.ir/images/UserFiles/33293/Forms/306/cover.pdf
Published abstract in the abstract book with the related code : http://gsia.tums.ac.ir/images/UserFiles/33293/Forms/306/abstract.pdf
Where has your abstract been indexed? : none
The Congress Reporting Form
How many volunteers were present at the Congress? : 3500
Delegates from which countries presented in the congress? : USA, UK, Canada, German, Netherlands, Austria, Sweden, the Netherland, Japan, Tiwan, India, Singapore ...
Were the delegates of any other organizations present in the congress? : Yes
If yes, please write the names of the organizations in the box :  
What were the responses to your talking points? Were specific questions or concerns raised? : The presentation was well received and three participants requested clarifications, which was provided. 
In designing sequential OSCEs, is the validity and reliability of the main OSCE important?
If you met staff members, please list their full names & positions. : John Norcini: President of faimer
Madelena Particio: Chair of BEME Board
Morris Gordon: Chief of BRC
Please inform us if there are any follow up actions we need to talk with the members of the congress : Since I thought there was no need to any follow up action that you should take, I was going to say no to this particular question. But, then, I found out there should be at least 50 words with three hundred characters in the text, otherwise the software would not accept it. So my answer is simply NO.
Your experiences about the travel processes(Providing ticket, accommodation,...) : Since AMEE conferences are held in European countries annually, and a Schengen visa is required, I recommend the volunteers to apply for the visa as soon as possible. The first step, after getting the acceptance letter, should be sending an email to the conference and request an invitation letter.
Please give a briefing of your own observations and outcomes of the congress: : In AMEE conferences about 20 to 30 sessions, including plenaries, workshops, poster and research papars, short communications, etc. are held simultaneously. While it provides wide list of options for participants with different interests and expertise, selecting appropriate sessions can be challenging. It was interesting that a conference Application, containing the full program, was introduced, which could be used by laptops, tablets or smartphones. The App prepared a schedule and even reminded the events to the user.
The course I took this year was entitled "PASREV". It was on developing educational systematic reviews and presented useful information and provided opportunities and ideas for research and practice, which I am going to use and develop.

 

Your Comments :
captcha
Close