Automating the Evaluation Process: From Form Design to Results Reporting

Abstract:

This workshop will begin by reviewing the concepts that lead to effective evaluation: Why evaluate? Why evaluate online? Who will use/abuse the results? Do you need formative or summative evaluations? Should your evaluations be anonymous? How can you maintain anonymity while authenticating participants? How can you handle "high stakes" tests online?

With this as background, the presenter will introduce two Web-based programs in use at the University of Florida: EvalCGI and the Evaluator's Tool Kit (ETK). (Both programs will be given to participants free of charge for use at their home institutions.) Participants will learn to use these powerful tools through a series of hands-on exercises: form definition, form security, submission tracking, item analysis, data manipulation, and results reporting.

Demonstrations of these programs are available at:

http://www.medinfo.ufl.edu/omi/docs/neweval.html

Both EvalCGI and ETK have data export functions. The workshop will conclude by showing how to use exported data with programs such as spreadsheets, databases and presentation software.

This will be a "learn by doing" workshop. All participants will build a functional evaluation Web site during the AM and PM sessions. For this reason we strongly encourage participants to bring prepared materials with them. For example, if you have paper forms you would like to begin using

online, bring them with! Please contact rrathe@ufl.edu if you have anyquestions before the meeting.

At the conclusion of this workshop participants will be able to:

• Ask the right questions when planning evaluations
• Design online evaluation and test forms for the Web
• Collate and manipulate evaluation results online
• Report evaluation results (online and paper)
• Prepare evaluation results for use in presentations
• Manage lists of evaluators and subjects
• Manage security for evaluations/results

As part of the workshop, each participant will create a functional Web site they can use for real world evaluations. (Hosted courtesy of the University of Florida College of Medicine)

Prerequisites:

Participants should have a basic knowledge of Web browsers

and text editors. Familiarity with spreadsheet and presentation software is

helpful but not required. No computer programming or HTML authoring skills

are required!

Dr. Rathe is the Associate Dean for Information Technology and an Associate

Professor of Family Medicine at the University of Florida. He has worked

extensively with instructional technology for the past ten years. He is the

coauthor of four popular CD-ROM titles: Radiologic Anatomy, Human Anatomy,

Microscopic Anatomy (all published by Gold Standard Multimedia,

www.gsm.com) and Musculoskeletal Pathology

(http://www.medinfo.ufl.edu/cme/mspath/). His evalCGI program allowed the

UF College of Medicine to eliminate over 90% of the paper forms once used

for evaluation.