Evaluation Multimedia Presentation

Evaluation Model

Terra D. McCrae-GreeneTECH 8533, Dr. Cornelious Mississippi State University

START

Kirkactrick's 4 Levels of Training Eval

ADDIE Model

Bloom's Taxonomy

Index

Exploring several different ISD and evaluation models with reflections.

Dick & Carey's Systematic Approach

Merrill's First Principles of Instruction

Gange's Nine Events of Instruction

Kemp's ISD

Revised Bloom's Taxonomy

Bloom's Taxonomy was originally coined in 1956 as a framework for categorizing educational goals: originally they were: Knowledge, Comprehension, Application, Analysis, Synthesis, & Evaluation. In 2001, it was revised using action words (gerunds) to describe the "cognitive processes by which thinkers encounter and work with knowledge, (Armstrong, 2010).

Etienne du Plessis (2021) used the above image to show how this framework could be used by young professionals in any industry. Du Plessis (2021) suggests that skills-based occupations could benefit from the framework's steps as a troubleshooting guide to identify where improvements are needed. The framework also lends itself to a more thorough evaluation while using a higher level of thinking.

Kirkpatrick's 4 Levels of Training Evaluation

Level 1

Level 2

Level 3

Level 4

Behavior

Learning

Results

Reaction

+ info

+ info

+ info

+ info

ADDIE Model

Analysis, Design, Development, Implementation, & Evaluation

ADDIE represents five phases of instructional design and has been used in developing training and instruction since the 1970s. Designed for the U.S. Army and then adapted by the U.S. Armed Forces, the original ADDIE Model was considered linear, starting with analysis and ending with an evaluation, (Bouchrika, 2024).The image selected demonstrates the five phases, but also identifies corresponding action words with a Bloom's Taxonomy feel. What I like about the model is that it serves as the basis for many other design model variations, (Culatta, 2024). What I do not like is that it seems to exclude space for creativity.

Kemp's ISD Model

Nine elements of the Kemp Model

1. Identify instructional problems and specify goals.2. Examine learner characteristics.3. Analyze task components for the stated goals and purposes.4. Specify the instructional objectives.5. Sequence content for logical learning.6. Design instructional strategies for mastery.7. Plan the instructional message and develop the instructions8. Develop evaluation instruments to assess objectives9. Select resources to support instruction and learning activities.

The image selected is an integration of Kemp's model with ADDIE. that was discovered in my search for images. What I like about this model is that it is learner-centered and provides flexibility to be used on an ongoing basis to provide formative and summative results, (Escobedo, et al., 2014). There is nothing about this model that I dislike. Student-centered or participant-centered training drives relevant instruction.

+ info

Dick & Carey Model

The Ten Components

Based on ADDIE principles

• Assess needs to identify goals
• Conduct instructional analysis
• Analyze the learners and contexts
• Write performance objectives
• Develop assessment instruments
• Develop instructional strategy
• Develop and select instructional materials
• Design & conduct the formative evaluation of instruction
• Revise instruction
• Conduct summative evaluation,

(Lozada Rivera, 2022).

+ info

Gagne's Nine Events of Instruction

An Adaptive Model

• Gain learner's attention
• Inform learners of the objective
• Stimulate recall of prior learning
• Present the [new] content
• Provide learning guidance
• Elicit performance/practice
• Provide feedback
• Assess performance/practice
• Enhance retention and transfer

Merrill's Principles of Instruction

According to Merrill, 'learning is most effective when learners are actively engaged in the learning process, and when the learning experience is designed to facilitate their understanding and retention of new information'," (Saha, 2024).

Merrill's Principles of Instruction features five principles of instruction. 1. Beginning with a relevant real-world task or problem-centered learning; 2. Activation: involves capturing the learner’s attention, establishing relevance, and building their confidence. 3. Demonstration: involves providing a preview of the skills or knowledge learners will be experiencing. 4. Application: involves providing learners with opportunities to apply their new knowledge and skills to real-world problems. 5. Integration: involves helping learners connect the new knowledge and skills to their existing knowledge base, (Saha, 2024),

Thank you for Visiting

Please continue to explore the resources.

I hope that you consider one of these evaluation models in your teaching practice. The overall goal is for students to have the opportunity to put 21st Century Skills to work through their learning processes and to retain and be able to transfer their learning to real-world problems and find real-world solutions.

Terra D. McCrae-Greene

Instructional Systems and Workforce Development Mississippi State University

This interactive presentation was designed using Genial.ly

REFERENCES

Armstrong, P. (2010). Bloom’s Taxonomy. Vanderbilt University Center for Teaching. Retrieved from https://cft.vanderbilt.edu/guides-sub-pages/blooms-taxonomy/.

Culatta, R. (2024). ADDIE Model. Instructional Design. InstructionalDesign.org. Retrieved from: https://www.instructionaldesign.org/models/addie/

du Plessis, E. (2021). Bloom's taxonomy - 6 levels of effective thinking. [Blog]. Spencer Tom. Retrieved from: https://www.spencertom.com/2021/02/07/blooms-taxonomy-6-levels-of-effective-thinking/.

Escobedo, J., Herrera, R., Ing, M., Kosina, K.,San Miguel, J., & Tucker, M. (2014). Instructional Design Models: Comparing ADDIE, Kemp, and IPISD. [Workspace]. PBWorks. Retrieved from: http://edtc6321group3fall14.pbworks.com/w/page/85214398/Kemp.

Kirkpatrick, J. & Kayser Kirkpatrick, W. (2024). The Kirkpatrick Model. [Website]. Kirkpatrick Partners, LLC. Retrieved from: https://www.kirkpatrickpartners.com/the-kirkpatrick-model/

Kosina, K. (2014). The Morrison, Ross, and Kemp Model. [Image]. PBWorks. Retrieved from: http://edtc6321group3fall14.pbworks.com/ w/page/85214398/Kemp. (2024).

Kurt, S. (2021). Teaching & Learning: Gagne's Nine Events of Instruction. [Article] Educational Technology. Retrieved from: https://educationaltechnology.net/gagnes-nine-events-of-instruction/

Legault, N. (2011). Infographic: Kirkpatrick's 4 Levels of Evaluation. [Infographic]. Retrieved from: https://nlegault.ca/2011/09/01/ infographic-understanding-kirkpatricks-4-levels-of-evaluation/

Lozada Rivera, V. (2022). Morrison-Ross-Kemp vs. Dick & Carey Model. Writings [Blog]. Retrieved from: https://victorlozadarivera.com/morrison-ross-kemp-vs-dick-and-carey-model/.

Mind Tools Content Team. (2024). Kirkpatrick's Model: Four Levels of Training Evaluation. [Article]. Mind Tools. Retrieved from: https://www.mindtools.com/ak1yhhs/kirkpatricks-four-level-training-evaluation-model.

Northern Illinois University Center for Innovative Teaching and Learning. (2020). Gagné’s nine events of instruction. In Instructional guide for university faculty and teaching assistants. Retrieved from https://www.niu.edu/citl/resources/guides/instructional-guide

Saha, S. (2024). Merrill's Principles of Instruction: A Guide to Effective Teaching. [Blog]. MBA Simplified. Simpli MBA. Retrieved from: https://www.simplimba.com/merrills-principles-of-instruction/.

When to use Bloom's

The framework is versatile and can guide the evaluation of any program. I would not revise it. What I like about the model is its usefulness in creating goals. Teachers in my building have used this framework to write lesson objectives and to clarify the goals of units of learning along with their pacing guides. EX: SWBAT select (understanding) evidence from the text to support (evaluating) their reason for agreeing with or disagreeing with the author's perspective.

Gagne's 9 Events of Instruction

A student-centered approach:

What I love about this model is its student-centered approach to teaching and learning. I would not modify it, but can see how beneficial it is to learning and retention of that learning through guidance, assessment, and feedback. Akin to the Universal Design for Learning (UDL), Gagne suggests that nine events of instruction lead to learning for all students.

The above image was selected, as it shows the interconnectivity of the 9 events and although placed in numerical order, are all important components of this instructional model, which can also be found using the Educational Technology link above.

Center for Innovative Teaching and Learning

Merrill's 5 Principles

Advantages and Disadvantages

The most obvious advantage is the student- and task-centered basis of this model. It is flexible enough to facilitate in-person and virtual teaching and learning situations. It also considers learners individually and in a group setting.

• May be too rigid for learners needing more flexibility
• Learners with special needs may not be reached
• May not be suitable for all contexts and with all learners

Merrill's 5 Principles - SimpliMBA

Kirkpatrick's 4 Levels of Evaluation

From what I have read, this model, although only containing four levels of evaluation, not only has the potential to be time-consuming but is an expensive route to go. I have read where newer trainers take the model in reverse, beginning with the results level (MTCT, 2024).

The infographic was designed by Nicole Legault (2011) and appeared to provide a visual representation of this model. I neither like, nor dislike Kirkpatrick's model, but believe I understand why it may have been designed at the time. Several revisions have already been made to this model. you can find out more at the link below, (MTCT, 2024).

Mind Tools - Kirkpatrick's Model