MyUT
Usability Testing & Heuristic Evaluation
Timeline
Sep 2023 - Dec 2023
Ritprabha Suryavanshi
Peggy Wang
Bindi Shah
Kevin Thakkar
Figma
FigJam
Zoom
User Research
Note Taking
User Observation
Team
Tools
My Role
Overview
MyUT is an application that provides students at UT with access to a variety of resources and services. It acts as a one-stop destination for all things UT Austin! We collaborated with the team to understand and analyze the website on the basis of multiple tasks and present a usability report with listed issues and recommendations.
Research Design
Introduction
Roadmap
Identifying issues & pain points within the website
Identifying areas of improvement
Finding several medium-high severity issues and
narrowing them to 8 tasks
Performing usability testings with participants remotely & in-person
Recruiting participants from our key demographics
Mode of Conduct
Testing Plan
Metrics
Success Rate
8/8 Passed
MyUT helps students at UT Austin access all kinds of resources and services. The main features include:
Understanding the process of testing
Task analysis
Although a total of 8 tasks were given to participants, here are 3 shortlisted tasks in detail:
Centralized access for students to access resources and information for academic and campus life.
Personalized dashboards according to student needs
Offers a responsive website and application design, allowing access to critical
information on the go.
Remote and In-person
Primary device, user’s laptop/ macbook
8 Participants, 6 female and 2 male
Zoom to record screens of both, remote and
in-person testers
5 monthly users, 2 weekly users and 1 novice
Google Forms to take a post-test analysis
1 interviewer, 1 observer and 2 note-takers
Outcome
A total of 8 tasks were given to 8 participants reflecting a SUS score of 42.2%
Heuristic Evaluation
Task 1
Updating information
Task 3
Class registration
4/8 Passed
Task 4
Customizing notifications
3/8 Passed
Task 5
Finding resources
7/8 Passed
6/8 Passed
Task 6
Contacting support
Task 2
Filling hours in Workday
Competitive Analysis
Task Identification
Testing
Participant Recruitment
The usability testing was conducted both,
and during each session there was,
Result analysis
System usability scale
SUS questionnaire
Findings across tasks
I think that I would like to use this system frequently.
I found the system unnecessarily complex.
I thought the system was easy to use.
I think I need the support of a technical person.
I found the functions in this system to be well integrated.
I thought there was a lot of inconsistency in the system.
I imagine that people would learn to use this quickly.
I found the system very cumbersome to use.
I felt very confident using the system.
P1
P2
P3
P4
P5
P6
P7
P8
1
4
3
3
1
4
3
4
1
3
1
4
1
4
1
1
5
2
5
2
5
3
4
5
5
1
4
3
5
3
4
5
2
4
2
4
1
2
4
4
4
4
2
5
1
2
5
4
5
1
3
1
3
4
2
1
4
4
4
1
5
2
4
3
2
1
2
4
1
2
2
4
worst imaginable
poor
ok
good
best Imaginable
00
10
20
30
40
50
60
70
80
90
100
Not Acceptable
Marginal
Acceptable
42.2
Suggestions
Users recommended placing the button in a more visible location, emphasizing class registration, widening the navigation bar column, and creating a separate section for notifications.
Feelings
Users recommended placing the button in a more visible location, emphasizing class registration, widening the navigation bar column, and creating a separate section for notifications.
Terminology Issues
Users identified vague and misleading terms like 'manage,' and expressed confusion with terms like 'earning stats' and 'time-sheet,' and wished for a clearer language.
Positive Feedback
Some Users appreciated the ease of navigation, accurate iconography for how-to videos, and accessibility of important links.
Visual Issues
Various users pointed out the cluttered menu on homepage, cramped content, unorganized how-to videos, visual alignment issues, and problems with button visibility and positioning.
Frustrations
Some Users reported difficulty accessing the edit button on the profile page, challenges in comprehending information, frustrating navigation, and issues with button visibility, search-ability, and menu structure. Additionally, frustration over outdated pages like holidays and events
What we measured
Qualitative
Quantitative
Time on task
Success rate
Usability rating
System usability scale
Experience with MyUT
User path
Think-aloud method
Positive & negative feedback
Positive & negative feedback
Overall review
Task 7
Finding resources
Task 8
Finding tutorials
Interested in seeing more?
Hebby Voice Assistant
FXCM Onboarding
Overview
MyUT is an application that provides students at UT with access to a variety of resources and services. It acts as a one-stop destination for all things UT Austin! We collaborated with the team to understand and analyze the website on the basis of multiple tasks and present a usability report with listed issues and recommendations.
Timeline
Sep 2023 - Dec 2023
Ritprabha Suryavanshi
Peggy Wang
Bindi Shah
Kevin Thakkar
Team
Figma
FigJam
Zoom
Tools
User Research
Note Taking
User Observation
My Role
Outcome
A total of 8 tasks were given to 8 participants reflecting a SUS score of 42.2%
Introduction
MyUT helps students at UT Austin access all kinds of resources and services. The main features include:
Personalized dashboards according to student needs
Offers a responsive website and application design, allowing access to critical
information on the go.
Centralized access for students to access resources and information for academic and campus life.
Roadmap
Understanding the process of testing
Identifying issues & pain points within the website
Identifying areas of improvement
Finding several medium-high severity issues and
narrowing them to 8 tasks
Performing usability testings with participants remotely & in-person
Recruiting participants from our key demographics
Heuristic Evaluation
Competitive Analysis
Task Identification
Testing
Participant Recruitment
Research Design
Mode of Conduct
Remote and In-person
1 interviewer, 1 observer and 2 note-takers
The usability testing was conducted both,
and during each session there was,
Testing Plan
Primary device, user’s laptop/ macbook
Zoom to record screens of both, remote and
in-person testers
Google Forms to take a post-test analysis
Metrics
8 Participants, 6 female and 2 male
5 monthly users, 2 weekly users and 1 novice
Success Rate
8/8 Passed
Task 1
Updating information
Task 3
Class registration
Task 7
Finding resources
Task 8
Finding tutorials
4/8 Passed
Task 4
Customizing notifications
3/8 Passed
Task 5
Finding resources
7/8 Passed
6/8 Passed
Task 6
Contacting support
Task 2
Filling hours in Workday
What we measured
Qualitative
Quantitative
Time on task
Success rate
Usability rating
System usability scale
Experience with MyUT
User path
Think-aloud method
Positive & negative feedback
Positive & negative feedback
Overall review
Task Analysis
Although total of 8 tasks were given to participants, here are 3 shortlisted tasks in detail:
Calender and Event Finding
07
Scenario
You want to start planning for a vacation with your family at the end of the Spring Semester and want to know when your final exams end.
100%
Success Rate
4.5
/5
Usability Rating
Time on Task
Average Time
1.00 mins
Lowest Time
0.59 mins
Highest Time
1.02 mins
Assistance Requirement
Taskflow
Task 7
1. Home Page
Taskflow
Task 7
2. Select Calendar and Events
Taskflow
Task 7
3. Select Academics
Taskflow
Task 7
4. Scroll to Spring Term
Taskflow
Task 7
5. Spring Term Holidays found
Task Completion
Findings and Recommendations summary
Task 7
Misleading Term
Issue: Users thought they would find the holiday list under ‘UT Holidays’, but it only showed holidays till July 2023. Then as the next step they decided to click on ‘Academics’
Impact: This negatively affected the user experience, since they had to take an extra step to find the holiday list
Recommendation: All the breaks and holidays can be combined into a single list for or into a single section for users to easily skim through according to the months.
"It's easy to spot the calendar icon, but since everything else is hidden, it ends up feeling really confusing."
Finding Resources
05
Scenario
You're facing a technical issue while using the University Wi-Fi and you believe there has been an outage. You need to find the resources to locate any alerts that were sent out for the same. Please locate this link and access the resources.
37.5%
Success Rate
2.5
/5
Usability Rating
Time on Task
Average Time
1.03 mins
Lowest Time
0.58 mins
Highest Time
1.45 mins
Assistance Requirement
Taskflow
Task 5
1. Home Page
Taskflow
Task 5
2. Scroll down
Taskflow
Task 5
3. Select ‘ITS Alerts & Outages’
Taskflow
Task 5
4. Redirect to ITS Page
Task Completion
Findings and Recommendations summary
Task 5
Observations
We noticed that a majority of participants tried navigating to the resource page by scrolling and exploring the left-side navigation bar. Additionally, a few participants opted to type in the search bar, exclusive to the navigation menu, while others utilized the inbuilt browser search function to locate the resources.
Recommendations
Adding a site wide search bar could be really helpful for users to search for resources in a site that is so heavy with resources. We also recommend introducing toasts like indicating error states about any happening event like a wifi outages.
The homepage feels too cluttered and needs better structure. Without help, I would've been stuck searching endlessly. The search bar had no results.
Contacting Customer Support
06
Scenario
You realized there is a broken link in the MyUT app, and you need to report it to concerned members of the technical team. Please find and click on the link or option that allows you to contact customer support.
87.5%
Success Rate
4.2
/5
Usability Rating
Time on Task
Average Time
1.46 mins
Lowest Time
1.20 mins
Highest Time
1.80 mins
Assistance Requirement
Taskflow
Task 6
1. Home Page
Taskflow
Task 6
2. Select Contact Customer Support
Taskflow
Task 6
3. Select “ITS Alerts & Outages”
Task Completion
Findings and Recommendations summary
Task 6
Observations
We noticed that a majority of participants tried navigating to the resource page by scrolling and exploring the left-side navigation bar. Additionally, a few participants opted to type in the search bar, exclusive to the navigation menu, while others utilized the inbuilt browser search function to locate the resources.
Recommendations
Adding a site wide search bar could be really helpful for users to search for resources in a site that is so heavy with resources. We also recommend introducing toasts like indicating error states about any happening event like a wifi outages.
"Quite easy but 'Contact MyUT Support' doesn't look like a button."
Result Analysis
System Usability Scale
worst imaginable
poor
ok
good
best Imaginable
00
10
20
30
40
50
60
70
80
90
100
Not Acceptable
Marginal
Acceptable
42.2
SUS questionnaire
I think that I would like to use this system frequently.
I found the system unnecessarily complex.
I thought the system was easy to use.
I think I need the support of a technical person.
I found the functions in this system to be well integrated.
I thought there was a lot of inconsistency in the system.
I imagine that people would learn to use this quickly.
I found the system very cumbersome to use.
I felt very confident using the system.
P1
P2
P3
P4
P5
P6
P7
P8
1
4
3
3
1
4
3
4
1
3
1
4
1
4
1
1
5
2
5
2
5
3
4
5
5
1
4
3
5
3
4
5
2
4
2
4
1
2
4
4
4
4
2
5
1
2
5
4
5
1
3
1
3
4
2
1
4
4
4
1
5
2
4
3
2
1
2
4
1
2
2
4
Findings across Tasks
Suggestions
Users recommended placing the button in a more visible location, emphasizing class registration, widening the navigation bar column, and creating a separate section for notifications.
Feelings
Users recommended placing the button in a more visible location, emphasizing class registration, widening the navigation bar column, and creating a separate section for notifications.
Terminology Issues
Users identified vague and misleading terms like 'manage,' and expressed confusion with terms like 'earning stats' and 'time-sheet,' and wished for a clearer language.
Positive Feedback
Some Users appreciated the ease of navigation, accurate iconography for how-to videos, and accessibility of important links.
Visual Issues
Various users pointed out the cluttered menu on homepage, cramped content, unorganized how-to videos, visual alignment issues, and problems with button visibility and positioning.
Frustrations
Some Users reported difficulty accessing the edit button on the profile page, challenges in comprehending information, frustrating navigation, and issues with button visibility, search-ability, and menu structure. Additionally, frustration over outdated pages like holidays and events
Interested in seeing more?
always down to talk all things f1, accessibility and fun. drop me a line
You have reached the