EDIT Matrix

Using the EDIT Matrix

Gen AI and media literacy

How to edit and evaluate outputs from ChatGPT & other Gen AI models.

start

What is the EDIT Matrix?

The EDIT Matrix is a tool developed by Daniel Fitzpatrick, Amanda Fox, and Brad Weinstein that provides a systematic approach for evaluating the outputs of Gen AI. This model encourages users to consider the quality and accuracy of information from Gen AI to identify bias and false information that may influence the generated output. Specifically, the EDIT Matrix includes steps to consider when editing and evaluating Gen AI-generated content for corrections and improvements to be made. In this lesson, we will dive into each part of the EDIT Matrix.

Home

Introduction

Quiz

Evaluate

Evaluating and identifying facts in any text is an essential skill, including text generated by Gen AI. The first step in the EDIT Matrix is to evaluate your Gen AI output for language, facts, & structure.

Home

Introduction

Questions to consider

Strategies for evaluating text

Think

Ask

Read

(Fitzpatrick et al., 2023)

Determine Accuracy

& corroborate with source

It is important to determine the accuracy of information generated by Gen AI and cite sources accordingly. After fact-checking the Gen AI output from the Evaluate step, it is important to identify sources to support them.

Home

Introduction

Conduct Research

Evaluate quality

Verify the accuracy of the information presented using reliable sources. Reliable sources can be academic journals, government reports, news articles, etc.

Evaluate quality & reliability of sources. Consider potential conflicts of interests or limitations

Fact-checking

Compare the accuracy of text with multipe sources, check the source credentials & verify any data presented.

Questions to consider

(Fitzpatrick et al., 2023)

Identify

It is important to identify any bias or misinformation in the Gen AI text output. These biases can include logical fallacies, cognitive biases, or political biases.

bias & misinformation

Home

Introduction

Analyze

Evaluate Structual features

Bias Evaluation

(Fitzpatrick et al., 2023)

Transform

Transform content to reflect adjustments & new findings

Home

Introduction

Adjust Content

Use clear & concise language

Get & use feedback

Sentiment Analysis

(Fitzpatrick et al., 2023)

Time to put your knowledge of EDIT to the test!

EDIT Matrix Quiz

start

1/6

2/6

3/6

4/6

5/6

6/6

End of the quiz!

Congratulations! You have made it to the end of this lesson, go forth and EDIT!

START OVER?

Adjust the Content

Adjust the content from the Gen AI output to reflect any necessary changes, such as improvements and corrections. Consider elements such as:

• Adding relevant information and perspectives.
• Supporting the content with sources and/or data.
• Sentiment analysis.
• Modifying text to provide a more human tone/message.

Analyze

Analyze the language and tone to identify bias & assumptions. Consider how these might influence the meaning of the text.

• Cultural bias
• Ideological bias
• Political bias

Sentiment Analysis

Consider the following:

• Does the Gen AI text sound like something a human would say? Why or why not?
• How does the Gen AI text make you feel? Others?
• Does it have an emotional impact? Why or why not?
• Can I provide a personal story or experience to relate to the audience?

Use clear and concise language

Clear and concise language can help you to communicate revisions to the content successfully.

• Provide citations or references to support factual claims or arguments.
• Consider figurative language.
• Consider adding personal anecdotes to humanize the text.

Evaluate Structural features

Evaluate the structural and stylistic features of the Gen AI text output. Consider how they may affect the accessibility of the text.

• Headings
• Subheadings
• Images
• Formatting

Feedback helps!

Get feedback from peers, teachers, or experts to revise and improve the content.

• Consider how the revised text may be interpreted by different audiences.
• Incorporate feedback as necessary.

Bias evaluation

Consider the following:

• Does the text provide a limited or biased view of the topic?
• Can I provide additional perspectives to balance the writing?
• Are there any specific words or phrases in the Gen AI text that suggest bias or a particular perspective?
• Are there any logical fallacies?
• Circular reasoning?
• Appeals to emotion?

Accuracy Analysis

Consider the following

• Does the Gen AI output provide evidence to support its statements?
• What kind of evidence is given? Is it reliable & credible?
• Are there any statements that need to be supported with evidence?
• Is the information presented by the Gen AI model up to date? Does it reflect the most current research on the topic?

(Fitzpatrick et al., 2023)

Strategies for Evaluating Gen AI output

• Highlight specific phrases that provide evidence or support information.
• Check sources of credibility if any are used in the text.
• Look for inconsistencies and contradictions.
• Consider the tone and language used.
• Use fact-checking websites to verify the accuracy of the information presented.

Content Evaluation

Questions to consider

• How can you determine whether a statement in the Gen AI output is a fact or an opinion? Bias?
• Are there any specific indicators or cues to look for?
• Are there any statements in the Gen AI output that seem unlikely or impossible?

(Fitzpatrick et al., 2023)

(Fitzpatrick et al., 2023)