Topic outline

  • Course Information

    Course description: 

    The course deals with principles, techniques and trends in evaluation practices used in health professional schools with focus on student achievement and effectivity of health professions educational programs.

    Credits: 2 units (core course)

    Schedule: Tuesday: 10:00  - 12:00 nn

    Faculty in charge: Nemuel S. Fajutagana, MD, MHPEd (UniMaas)

    • Face to Face Schedule

      Feb 26-Mar 1
      Apr 8-12
      May 20-24

    • Additional Course Information

    • Course Description and Outcomes Page

      Evaluation is an integral part of any educational program, whether looking at it through its individual components or in its entirety. It is a powerful tool that helps in making decisions about current and future actions and though reflective of individual and institutional values, can still be validly assessed
      if done systematically.
      This course will introduce you to the principles of planning and implementing an evaluation plan for different types of evaluation objects. It takes into consideration the focus and central purpose of the evaluation so that an appropriate evaluation design may be made. This course will provide you with hands-on experience in the systematic planning and implementation of evaluation in health professions education.

    • TOPICS, REFERENCES and Final Paper Components

      Second Semester | SY 23 - 24

      (Use this matrix as a simple guide in preparing your final paper components.)

    • Digital Attendance Book

      Screenshots of Zoom sessions

    • Zoom Recordings Book

      Please click the link to review video recordings of our zoom / hybrid sessions.

  • Unit 1: Overview of Evaluation

    • Schedule:

      First Zoom Session

      Date: Week 1 - 2

      Date: February 6, 2024

      Meeting ID: TBA
      Passcode: TBA

    • Session Outcomes:

      At the end of this session, participants will be able to:

      1. Discuss the role of evaluation in health professions education
      2. Use evaluation terms appropriately
      3. Explain major concepts in educational evaluation
      4. Explain Logic Model in the context of evaluation.
      5. Discuss principles in planning educational evaluation
      6. Discuss the different educational evaluation models and approaches.

    • In preparation for this session, please read available reading materials.

    • Handbook of Practical Evaluation File

      Complete pdf version of the book. Read Chapter 1 Using Logic Models

    • Educational Approaches 4th Edition File

      Jody L. Fitzpatrick, James R. Sanders, Blaine R. Worthen - Program Evaluation_ Alternative Approaches and Practical Guidelines-Pearson (2010). 

      This a newer edition than what we have in the Library.

    • Program evaluation models and related theories AMEE Guide No 67 File

      Abstract:

      This Guide reviews theories of science that have influenced the development of common educational evaluation models. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model’s theoretical basis against their program’s complexity and their own evaluation needs. Reductionism, system theory, and (most recently) complexity theory have inspired the development of models commonly applied in evaluation studies today. This Guide describes experimental and quasi-experimental models, Kirkpatrick’s four-level model, the Logic Model, and the CIPP (Context/Input/ Process/Product) model in the context of the theories that influenced their development and that limit or support their ability to do what educators need. The goal of this Guide is for educators to become more competent and confident in being able to design educational program evaluations that support intentional program improvement while adequately documenting or describing the changes and outcomes—intended and unintended—associated with their programs.

    • Overview of Evaluation SCORM package

      Interactive Presentation

  • Topic 1.1: Introduction to Evaluation Process

    Date: Week 3-5

    Date: February 13 - 27, 2024

    • Session Outcomes:

      At the end of this session, participants will be able to:

      1. Discuss the role of evaluation in health professions education
      2. Use evaluation terms appropriately
      3. Explain major concepts in educational evaluation
      4. Explain Logic Model in the context of evaluation.
      5. Discuss principles in planning educational evaluation
      6. Discuss the different educational evaluation models and approaches.
      7. Formulate Evaluation Questions

    • Student Reporting on Evaluation Approaches

      Dates: 

      February 20: Zoom Session
      February 27: Face to Face Session

      ApproachesRepresentative ApproachesReporterDate

      Consumer and Expertise Oriented

      Chapter 5 (Worthen)
      • Consumer Oriented
      • Expertise Oriented

      FEU Group (Michelle,  Trina, Jojo)

      		 February 20

      Program Oriented

      Chapter 6 (Worthen)
      • Objective Oriented (Tyler, Provus)
      • Logic Model and Theory Based
      • Goal Free

       Dianna, Sherry, Melai

      		 February 20

      Decision Oriented

      Chapter 7 (Worthen)
      • CIPP Model
      • UCLA Evaluation Model
      • Utilization Focused Evaluation

       Rona, Christine, Mark, Kaye

      		 FEb 27 (F2F)

      Participant Oriented

      Chapter 8 (Worthen)
      • Robert Stake and his Responsive Approach
      • Practical Participatory Evaluation
      • Developmental Evaluation
      • Transformative Participatory Evaluation
      • Stakeholder-Based Evaluation
      • Empowerment Evaluation
      • Deliberative Democratic Evaluation

       KC, Tricia, Gayle, Cherrie, Girelle, TJ, Carlo, Henry

      		 Feb 27 (F2F)

    • ✍ ┤DO├ ✍

    • ASYNCHRONOUS SESSION: (Whole Month of March)

      To be able actively participate in our asynchronous sessions for this theme, read Chapters 4 to 8 of Worthen and Sanders.

      After your classmates assigned report on the different approaches, I want you to apply those approaches in making evaluation decisions. For the month of March, prepare your evaluative decisions and please focus on the following:  your evaluation object (what will you evaluate), purpose, evaluation questions, and evaluation objectives.

      Specifically, you are to do the following:

      1. Identify  proposed object for educational evaluation (e.g. training program, educational innovation, educational tools, faculty development program, etc.)
      2. For the identified evaluation 'object' please formulate the following:
        1. A short description of the evaluation object (Name, current status, program goals and objectives):
        2. Do the matrix below: For each evaluation approach/model" formulate the appropriate:
          • purpose of evaluation 
          • evaluation questions
        3. Be ready to present your matrix when requested during our F2F (synchronous) session.

      Matrix: Approach, Rationale, Purpose, and Evaluation Questions 

      Evaluation Approach Rationale for use of this approach Purpose of Evaluation Evaluation Questions
      Expertise and Consumer Oriented Approaches
      Program Oriented Evaluation Approaches
      Decision Oriented Evaluation Approaches
      Participant Oriented Approaches

      You will be presenting this matrix during our remote learning sessions for the month of March.

    • 🎦 ┤WATCH├ 🎦

    • Video Instruction for Individual Assignment

    • In preparation for this session, please read available reading materials.

  • This topic

    Unit 2: The Evaluation Question

  • Online Lectures: The Kirkpatrick's Evaluation Model

  • Unit 3: The Evaluation Proposal

    In this unit, we will focus our attention to the development of your Health Education Program Evaluation proposal. So far, you have, I hope:

    1. Identified you evaluation 'object.'
    2. Decided on  the purpose(s) of evaluation.
    3. Formulated your evaluation question (and decided on the possible approach or approaches to use).

  • Topic 3.1: The Evaluation Matrix

    Completing an evaluation matrix is an important initial step in the development of your evaluation proposal. To learn more about the Evaluation Matrix, view the provided interactive presentation that I prepared. You can also see a sample matrix in Worthen and Sander's book. 

    • ✍Your individual assignment is to fill up the first four (4) columns of your 'Evaluation Matrix.' Please be ready to present your EM during our F2F (TBA).✍

      📖To know more about the different data collection procedures, please read Chapter 16: Collecting Evaluation Information of Program Evaluation by Fitzpatrick, Sanders, and Worthen and Part 2: Practical Data Collection Procedures of HANDBOOK OF PRACTICAL PROGRAM EVALUATION by Wholey et.al, pages 205-411.📖

    • 💻👨Face to Face Session 👧💻

      Agenda: Presentation of the first four (4) columns of your matrix.

      Date: TBA

      Please run the interactive below 👇for guidance in your preparation.

    • 💻 ┤INTERACT├ 💻

    • Evaluation Matrix Interactive SCORM package
      I prepared an example of how  elements of Evaluation Matrix are generated. I used an actual evaluation project to illustrate.

    • Digital Book of Video Annotations

      📝Video Annotations 📝

      Watch and Learn from each other's output.

  • Topic 3.2 Study Design and Evaluation Information Collection Plan

    To further clarify your evaluation questions, you can use as guide the study design that you intend to use for your evaluation. You will also need your study design to finalize your evaluation information collection plan.

  • Synchronous Session:

    • 💻👨Face to Face Session 👧💻

      Agenda: Presentation of Data Collection Plan and Sample Data Collection Tools

      Session Focus: Column 4 and 5 of the Evaluation Matrix

      Meeting ID: TBA

      Passcode: TBA

      Date: TBA

    • 📖 ┤READ├ 📖

    • Readings: Chapter 15 and 16 of Evaluation Approaches by Worthen, et. al. Part II and Part III of Handbook of Practical Program Evaluation by Wholey, et. al.

    • 📝┤DO├ 📝

    • Data Collection Tools

      • Checklist
      • Rating scale
      • FGD / Interview Guide
      • Questionnaire
      • Record Review Guide

  • Topic 3.3: Data Analysis Component of the Matrix

    In this topic you will learn how to fill-up the remaining parts of the Evaluation Matrix. Several interactive presentations have been prepared for you and you will also find our two main textbooks useful as you work on these components.

    • 💻 ┤INTERACT├ 💻

    • Interactive Presentations

    • Selecting Statistical Test SCORM package

      Are you having problems deciding on what statistical test to use for your research or evaluation projects?
      Well, I have a simple solution for you. This simple interactive object can help you decide on the most appropriate statistical test based on a) the statistical question you want answered, and b) the type of data or variable that you will process.  I also included simple glossary of terms just in case you need more basic information. Happy interacting.

    • Describing and Presenting Variables File

      A simple eBook on how to describe and present variables or research data.

    • 📖 ┤READ├ 📖

    • Downloadable and Mobile-Friendly Versions of your interactive files.

      (Just in case you need to access them offline).

    • PDF Version

  • Portal for Final Paper

    Please use this portal to submit your final paper.

  • Course Evaluation