Canvas User Research Case Study

Canvas Case Study Presentation

📄

By Nicole Boadu

Start

Presentation Outline

04

01

Stakeholders

About me

Context

05

02

Introduction

Participants

Overview research project, research goals, general timeline

Recruitment criteria, targetaudience, how they were recruited and the tools used

06

03

Participants

Timeline

Part 2

Presentation Outline

10

07

Analyisis of Data

Research Methodology

Methodology, Duration, Issues with sampling

11

08

Questions to Avoid

Data Visualisation Examples

More on metholdology and rationale

12-14

09

Next Steps,

Before & After Research

Impact, Next steps, recommendations, reflections, conclusions, End

Contextualize your topicwith a subtitle

Nicole

Boadu

Year 2 Psychology student

Applying for the User Research intern role at Wise

• Education
• Previous Experience
• Hobbies

• This Internship

Linkedin URL

Research Introduction

Chosen Platform for Case Study: Canvas

Why I chose Canvas:

• As a frequent platform user alongside many other - there were noticable pain points (e.g. lack of consistency between app and website)

About Canvas:

• Web-based learning management system

• Used by learning institutions, educators, and students to access and manage online course learning materials and communicate about skill development and learning achievement.

Research Aims:

1. Improve student experience which leads to more satisfied and engaged. This goal was communicated to all stakeholders

Examples

Timeline Diagram.

Project Timeline Brief

Start: Plan & Prep

Define research objectives and identify target audience

Identify recruitment strategy, Develop research protocol.

Develop materials, secure approvals and recruit particpants

Data Collection (8- 12 weeks)

Collect and organize survey responses and test data

Record and transcribe interviews

Conduct interviews, surveys, and/or usability tests with participants

Data Analysis (4-6 weeks)

Synthesise findings and develop recommendations

Analyse test data and identify patterns and themes

Review and code interview transcripts and survey responses

Reporting and Dissemination (2-3 weeks)

Share findings with the Canvas support and development team

Share findings to stakeholders, including IT team, Student Information Officer, Unitu, faculties and module lecturer leaders

Develop a research report that includes key findings and recommendations

Stakeholders

IT department: ISS Team

University administration: They have an interest in the success of the Canvas platform as it is an integral part of the university's e-learning ecosystem.

Student Information Officers

Students

External stakeholders: may include educational institutions, industry experts, and professional bodies that may have an interest in the success of the Canvas platform.

Participants

Types of Participants:

• Approximately 300-600 students for full representation
• Ensuring those with a visual and/or auditory impairment are also recruited
• A mix of undergrad and postgrad students from varying subjects, schools and faculties
• Lecturers but preferably module leaders

How to Recruit:

• Participant Pool
• Student Reps/society committee members to encourage students in groupchats
• Unitu
• Student email newsletter

Incentives:

• Additional points on Participant Pool
• £5 amazon gift card
• Discounted food on campus (e.g. JC and canteen)
• Chance to win a raffle
• Reduced travel
• Refreshments

Important to not ignore:

• Students that do not speak English as their first language
• Students with disabilities (including learning disabilities such as ADHD and dyslexia

Participants

General Participant Criteria:

• Student at Swansea University
• Aged 18 +
• Module leaders
• Student Information leader
• Has used canvas within the last month

Sampling Methods:

• Stratified sampling technique randomly assign students and lecturers into focus groups

Potential Issues with the sampling method:

• Potential difficulty recruiting students due to disinterest
• Delayed recruitment may prolong research project
• Researcher might be unable to classify every member into subgroup
• Difficulties with scheduling

Research Methodology

Methodology and Duration....

Methodology options: Triangulation

• Focus groups: groups categorised by subject, faculty and school
• Interviews: 25 min survey with more follow-up questions
• User testing: screen share with participants and request a task for them
• short online surveys: 10 min survey

Interview example questions:

1. Can you tell us about your experience using Canvas?
2. How do you typically navigate through the platform to find what you need?
3. What do you find most useful about Canvas?
4. Are there any features or tools in Canvas that you find difficult to use?
5. How do you prefer to receive feedback on your coursework through Canvas?
6. Can you describe a time when you encountered an issue or problem using Canvas? How did you go about resolving it?
7. How often do you access Canvas?
8. What improvements or new features would you like to see on Canvas?
9. How do you feel about the overall design and layout of Canvas?
10. How do you typically communicate with your lecturers or classmates through Canvas?

Questions to Avoid

Closed Questions

Jargon/Technical Terminology

Farfetched Hypothetical Questions

Loaded Questions

Yes/no questions. These questions do not provide much insight into the user experience e.g. "Do you like using Canvas?"

These type of questions often leads to confusion and unhelpful responses. For example, "What do you think of the LMS's UI?

These types of questions often lead to biases due to hinted questions and preconceptions. Biases may include; researcher bias and social desirability.

These type of questions may lead unhelpful responses. Create scenarios that are frequent and more realistic for the participant.

Before & After Research

Debrief Participants

Create Necessary Data Collection Platforms

Create data collection tools. Platforms such as participant pool should be utilised.

Remind them of the aims, ojectives any mentions of the research being approved by the ethics committee and whether participants will ensure confidentiality is maintained.

Discussion on Data

1st Reminder

Remind the participants of the aims, objectives, right to withdraw and other protection of participant procedures.

Dicuss how data is stored, safety etc

Analysis of Data

Qualitative data

‘Your content is good, but it’ll engage much more if it’s interactive.’

01

This data can be analised through coding, where researchers identify patterns and themes in the responses and assign codes to them.

Synthesising the Data

02

Involves combining qualitative and quantitative insights to gain a more comprehensive understanding of the users' behaviours, motivations, and needs.

This can involve creating personas, journey maps, and other design artefacts to help visualize and communicate the insights. This generally might include; personas, user journey maps, and design recommendations. These can be shared with stakeholders to help inform the design and development of the e-learning platform.

Reports

04

The data can be visualised into a few graphs

Data Visualisation Examples

represents X

represents x

70%

12,480

Graphic

Next Steps

Step 4

Summarise the key takeaways from the research project and conclude the presentation → make stakeholders aware of any changes they should consider implementing. Follow up with the stakeholders to ensure that they understand the implications of the research and to answer any questions they may have. .

04

Conclusion + Follow-Up

Step 3

Including who used the insights, how they were used, and any changes that were made as a result of the research.

03

Impact

Step 2

Based on the findings, develop recommendations for how the e-learning and classroom platform can be improved to enhance the student experience.

02

Implication and recommendation

Step 1

We can present the findings to the relevant stakeholders. This could involve creating a presentation or video that summarises the key insights and recommendations.

01

Present the Findings

Summary

Task

Results

Action

Situation

• Findings were useful in informing the design and development of the platform
• Findings were presented in a slide deck
• Positive impact as the work contributed to improving engagement and learning outcomes

• Qualitative and quantitative research methods
• Representative and stratified sample
• Developed into multiple stages including; planning, recruitment, data collection, analysis, and synthesis.

• Swansea university
• Student experience
• Task wast to conduct a research project to gain insights into student behaviors, motivations, and needs related to the platform.

• Identify research aims and objectives
• Triangulation method - suits our sample
• Recruitment from different faculties, schools and degrees
• Analysis of data

Thank you

Nicole boadu