USING AUTOMATIC ITEM GENERATION FOR ASSESSMENT IN MEDICAL EDUCATION Paulo Marques José Miguel Gomes Moreira Pêgo USING AUTOMATIC ITEM GENERATION FOR ASSESSMENT IN MEDICAL EDUCATION
INTRODUCTION
INTRODUCTION Problem Multiple choice test items demand is growing in medical assessment The current approach on multiple choice items creation can’t meet this demand Development of a single multiple- choice item can from 500 to 1800€(1) Crescente número de cursos parecidos com o nosso, exames mais frequentes, mais avaliação com base em competências, maior necessidade de questões de escolha multipla (1) Pugh D, De Champlain A, Gierl M, Lai H, Touchie C. Using cognitive models to develop quality multiple‐choice questions. Med Teach. 2016;38(8):838‐843.
Solution Using automatic item generation INTRODUCTION Solution Using automatic item generation Use computer technology to generate new questions based in cognitive models, created by content specialists.(2) (2) Gierl MJ, Lai H, Turner SR. Using automatic item generation to create multiple‐choice test items. Med Educ. 2012;46(8):757‐765
Stem Lead–in question METHODS Specific Question a) Patient’s age and sex : b) Site of care : c) Presenting (Chief) complaint (including nature of onset) : d) Duration of symptoms (include changing nature of symptoms) : e) Pertinent history (HPI; personal; medication; family) : f) Physical Examination findings : g) Results of diagnostic studies : h) Response to initial treatment : Specific Question Stem Lead–in question
METHODS
Automatic Item Generation METHODS Automatic Item Generation Creation of cognitive model Creation of item model Creation of software to generate items based on the previous models
Cognitive model
Patient Information Informação do doente
Treatment Escolha do tratamento
Creation of item model
Software was created from the ground up Item Generation Software was created from the ground up
Foi desenvolvido um software de raiz Geração do item Foi desenvolvido um software de raiz
Foi desenvolvido um software de raiz Geração do item Foi desenvolvido um software de raiz
Foi desenvolvido um software de raiz Geração do item Foi desenvolvido um software de raiz