USING AUTOMATIC ITEM GENERATION FOR ASSESSMENT IN MEDICAL EDUCATION

Apresentação em tema: "USING AUTOMATIC ITEM GENERATION FOR ASSESSMENT IN MEDICAL EDUCATION"— Transcrição da apresentação:

1 USING AUTOMATIC ITEM GENERATION FOR ASSESSMENT IN MEDICAL EDUCATION
Paulo Marques José Miguel Gomes Moreira Pêgo USING AUTOMATIC ITEM GENERATION FOR ASSESSMENT IN MEDICAL EDUCATION

2 INTRODUCTION

3 INTRODUCTION Problem Multiple choice test items demand is growing in medical assessment The current approach on multiple choice items creation can’t meet this demand Development of a single multiple- choice item can from 500 to 1800€(1) Crescente número de cursos parecidos com o nosso, exames mais frequentes, mais avaliação com base em competências, maior necessidade de questões de escolha multipla (1) Pugh D, De Champlain A, Gierl M, Lai H, Touchie C. Using cognitive models to develop quality multiple‐choice questions. Med Teach. 2016;38(8):838‐843.

4 Solution Using automatic item generation
INTRODUCTION Solution Using automatic item generation Use computer technology to generate new questions based in cognitive models, created by content specialists.(2) (2) Gierl MJ, Lai H, Turner SR. Using automatic item generation to create multiple‐choice test items. Med Educ. 2012;46(8):757‐765

5 Stem Lead–in question METHODS Specific Question
a) Patient’s age and sex : b) Site of care : c) Presenting (Chief) complaint (including nature of onset) : d) Duration of symptoms (include changing nature of symptoms) : e) Pertinent history (HPI; personal; medication; family) : f) Physical Examination findings : g) Results of diagnostic studies : h) Response to initial treatment : Specific Question Stem Lead–in question

6 METHODS

7 Automatic Item Generation
METHODS Automatic Item Generation Creation of cognitive model Creation of item model Creation of software to generate items based on the previous models

8 Cognitive model

9 Patient Information Informação do doente

10 Treatment Escolha do tratamento

11 Creation of item model

12 Software was created from the ground up
Item Generation Software was created from the ground up

13

14 Foi desenvolvido um software de raiz
Geração do item Foi desenvolvido um software de raiz

15 Foi desenvolvido um software de raiz
Geração do item Foi desenvolvido um software de raiz

16 Foi desenvolvido um software de raiz
Geração do item Foi desenvolvido um software de raiz