AI, Technology, and the Future of Language Assessment

By Anderson Marcell Cárdenas Academic Consultant NATGEO Learning

Anderson Marcell Cárdenas Academic Consultant LATAM

AI, Technology, and the future of Language Assessment

Anderson Marcell Cárdenas Academic Consultant LATAM

Anderson Marcell Cárdenas Academic Consultant LATAM

Anderson Marcell Cárdenas Academic Consultant LATAM

Anderson Marcell Cárdenas Academic Consultant LATAM

Anderson Marcell Cárdenas Academic Consultant LATAM

Anderson Marcell Cárdenas Academic Consultant LATAM

Has cheating increased because of the impact of Generative AI on Education?

Before ChatGPT we didn't know where students were getting their help from...

Desirable Difficulties

Many educators equate GenAl with cheating because it removes the "hard work" of learning.

• Psychologist Robert Bjork defines"desirable difficulties" as challenges that require significant effort to overcome, but ultimately enhance learning. • GenAl can offload desirable difficulties, preventing productive struggle.

Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe and A. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 185-205). Cambridge, MA: MIT Press.

Undesirable difficulties

• GenAl also has the potential to facilitate learning by allowing students to offload "undesirable" difficulties: challenges outside students' zone of proximal development and those that limit students' sense of agency

Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe and A. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 185-205). Cambridge, MA: MIT Press.

How can we make assessment more AI resistant?

GenAI is a powerful tool, it's meant to supplement, not replace, your expertise and personal connection with students.

A guide for students

This redefinition examines conceptual understanding through the lens of durable skills, acknowledging the evolving demands of the modern workforce. 21rst Century skills connected to multiple literacies.

1. Grab your phone and identify 2 apps that use AI.

2. use this prompt with Google Gemini, another LLM, and check your work by writing the following prompt: Please generate a list of 10-20 common apps on smartphones that use AI, ML, or NLP and briefly explain (in a sentence or two) how they use them. Please do not include SIRI, Amazon Alexa, Netflix, or Google Maps.

"When students do cheat, it's typically for reasons that have very little to do with their access to technology." Pope, Denise. 2023. Standford Graduate School of Education.

60 to 70 % of students have reported engaging in at least one "cheating" behavior during the previous month. This was before ChatGPT.

That percentage has remained or even decreased slightly affter ChatGPT, which indicates AI may not be increasing the frequency of cheating.