9:30 a.m. - 4:30 p.m., Tuesday, June 22, 1999

Automating the Evaluation Process: Using Information Technology to Evaluate Your Students, Faculty and Curriculum.

Computer Lab Room 1311, Edison Bldg., 130 S. Ninth St.

Registrants $150; non-registrants is $200.

Pre-registration Required. Lunch included. Limit 20 participants.

Instructor: Richard Rathe, MD, Director, Medical Informatics, Professor of Family Medicine, University of Florida College of Medicine, Gainesville, FL

Hands-on: Pentium PCs with Windows.

Who Should Attend: Educators, administrators and developers know that they should be evaluating, but the masses of paper inhibit them. You want to know more about how to evaluate and you want to do it with a computer. This tutorial is intended for a non-technical audience. No programming experience is required. Computer familiarity with Windows and browsers is assumed.

Synopsis: In this session you will 1) learn to analyze and develop requirements for computerized evaluation systems (needs assessment), 2) learn the practical and technical aspects of implementing Internet-based evaluation systems, 3) learn the practical and technical aspects of implementing evaluation systems on hand held (PDA) computers, 4) be able to select and deploy new evaluation technologies at your home institution. During the workshop you will be presented with cases and solutions for peer evaluation, performance-based exams (OSCEs), and online CME programs. You will make your own online evaluations forms.

Abstract

Evaluation is an important part of any serious educational endeavor.

Unfortunately, the evaluation process is frequently hampered by a "paper

chase"- thousands of handwritten or scannable forms must be developed,

distributed, collected, collated, processed, and analyzed. A "paperless"

approach to evaluation has finally become practical thanks to the ubiquity of personal computers and the Internet. This tutorial will introduce the theory and practice of evaluation using advanced information technologies. Major concepts will be illustrated by case studies of common "real world" problems. Practical solutions will be presented for each case, including live demonstrations of functional systems.

Educational Goals and Benefits

Participants who complete this workshop will:

•Increase their understanding of the evaluation process, including both formative and summative aspects

•Learn to analyze and develop requirements for computerized evaluation

systems (needs assessment)

•Learn the practical and technical aspects of implementing

Internet-based evaluation systems

•Learn the practical and technical aspects of implementing evaluation

systems on handheld (palmtop) computers

•Be able to select and deploy new evaluation technologies at their home institution

Outline

Why Evaluate?

How Technology Can Help:

Case Study #1 - Peer Evaluation

Requirements Definition

Solution 1: Online Data Collection

Solution 2: Online Administration (Who Did What When?)

Case Study #2 - Performace-Based Exams (aka OSCEs)

Requirements Definition

Solution 1: Handheld Computers for Standardized

Patients

Solution 2: Online Testing (Interstation Examinations)

Case Study #3 - Online CME Programs

Requirements Definition

Solution 1: Post Testing

Solution 2: Online Certificates

Benefits of Using Information Technology for Evaluation

Time and Money

Higher Quality, More Complete Data

Making Information Technology Work for You (Hands On Exercise)

Create Your Own Online Evaluation Forms

(Demo Only If No Lab Available)

Conclusion

Who Should Attend

This tutorial is designed for educators, administrators, and developers who want to use information technology more effectively as an evaluation tool. Some familiarity with computers is assumed, but the overall course is intended for a non-technical audience. No programming experience is

required. The content covered will range from basic (70%) to intermediate (30%).