Want to create interactive content? It’s easy in Genially!
EDIT Matrix
Kinti Conroy
Created on October 17, 2023
Start designing with a free template
Discover more than 1500 professional designs like these:
Transcript
Using the EDIT Matrix
Gen AI and media literacy
How to edit and evaluate outputs from ChatGPT & other Gen AI models.
start
What is the EDIT Matrix?
The EDIT Matrix is a tool developed by Daniel Fitzpatrick, Amanda Fox, and Brad Weinstein that provides a systematic approach for evaluating the outputs of Gen AI. This model encourages users to consider the quality and accuracy of information from Gen AI to identify bias and false information that may influence the generated output. Specifically, the EDIT Matrix includes steps to consider when editing and evaluating Gen AI-generated content for corrections and improvements to be made. In this lesson, we will dive into each part of the EDIT Matrix.
Home
Introduction
Quiz
Evaluate
Evaluating and identifying facts in any text is an essential skill, including text generated by Gen AI. The first step in the EDIT Matrix is to evaluate your Gen AI output for language, facts, & structure.
Home
Introduction
Questions to consider
Strategies for evaluating text
Think
Ask
Read
(Fitzpatrick et al., 2023)
Determine Accuracy
& corroborate with source
It is important to determine the accuracy of information generated by Gen AI and cite sources accordingly. After fact-checking the Gen AI output from the Evaluate step, it is important to identify sources to support them.
Home
Introduction
Conduct Research
Evaluate quality
Verify the accuracy of the information presented using reliable sources. Reliable sources can be academic journals, government reports, news articles, etc.
Evaluate quality & reliability of sources. Consider potential conflicts of interests or limitations
Fact-checking
Compare the accuracy of text with multipe sources, check the source credentials & verify any data presented.
Questions to consider
(Fitzpatrick et al., 2023)
Identify
It is important to identify any bias or misinformation in the Gen AI text output. These biases can include logical fallacies, cognitive biases, or political biases.
bias & misinformation
Home
Introduction
Analyze
Evaluate Structual features
Bias Evaluation
(Fitzpatrick et al., 2023)
Transform
Transform content to reflect adjustments & new findings
Home
Introduction
Adjust Content
Use clear & concise language
Get & use feedback
Sentiment Analysis
(Fitzpatrick et al., 2023)
Time to put your knowledge of EDIT to the test!
EDIT Matrix Quiz
start
1/6
2/6
3/6
4/6
5/6
6/6
End of the quiz!
Congratulations! You have made it to the end of this lesson, go forth and EDIT!
START OVER?
Adjust the Content
Adjust the content from the Gen AI output to reflect any necessary changes, such as improvements and corrections. Consider elements such as:
- Adding relevant information and perspectives.
- Supporting the content with sources and/or data.
- Sentiment analysis.
- Modifying text to provide a more human tone/message.
Analyze
Analyze the language and tone to identify bias & assumptions. Consider how these might influence the meaning of the text.
- Cultural bias
- Ideological bias
- Political bias
Sentiment Analysis
Consider the following:
- Does the Gen AI text sound like something a human would say? Why or why not?
- How does the Gen AI text make you feel? Others?
- Does it have an emotional impact? Why or why not?
- Can I provide a personal story or experience to relate to the audience?
Use clear and concise language
Clear and concise language can help you to communicate revisions to the content successfully.
- Provide citations or references to support factual claims or arguments.
- Consider figurative language.
- Consider adding personal anecdotes to humanize the text.
Evaluate Structural features
Evaluate the structural and stylistic features of the Gen AI text output. Consider how they may affect the accessibility of the text.
- Headings
- Subheadings
- Images
- Formatting
Feedback helps!
Get feedback from peers, teachers, or experts to revise and improve the content.
- Consider how the revised text may be interpreted by different audiences.
- Incorporate feedback as necessary.
Bias evaluation
Consider the following:
- Does the text provide a limited or biased view of the topic?
- Can I provide additional perspectives to balance the writing?
- Are there any specific words or phrases in the Gen AI text that suggest bias or a particular perspective?
- Are there any logical fallacies?
- Circular reasoning?
- Appeals to emotion?
Accuracy Analysis
Consider the following
- Does the Gen AI output provide evidence to support its statements?
- What kind of evidence is given? Is it reliable & credible?
- Are there any statements that need to be supported with evidence?
- Is the information presented by the Gen AI model up to date? Does it reflect the most current research on the topic?
(Fitzpatrick et al., 2023)
Strategies for Evaluating Gen AI output
- Highlight specific phrases that provide evidence or support information.
- Check sources of credibility if any are used in the text.
- Look for inconsistencies and contradictions.
- Consider the tone and language used.
- Use fact-checking websites to verify the accuracy of the information presented.
Content Evaluation
Questions to consider
- How can you determine whether a statement in the Gen AI output is a fact or an opinion? Bias?
- Are there any specific indicators or cues to look for?
- Are there any statements in the Gen AI output that seem unlikely or impossible?
(Fitzpatrick et al., 2023)
(Fitzpatrick et al., 2023)