LevelUp Build Week 5 - User Testing

Written on Wed 23 Sep 00:30 2015

This weeks agenda:

1800Arrival & Food
1815Team Standups (by colour)
BA's / Dev'sXD
1830Team workUser Testing
1930Team Work
2045RETROs (in teams)
2100Close and clean

User Testing

We covered one type of user testing whose purpose is to get a sense of what users are feeling when they are using your application. XD’s typically delegate user selection to a recruiter and give them a list of criteria each user must satisfy. If it’s an smartphone app for school students, the XD might specify ‘I want kids between 12-18 who own a smartphone’.

The best way to gauge how well your users respond to your application is through user testing interviews. To get the most out of the user, there are a few things they should know before the interview begins.

  1. We are testing the application and not the user. They should feel relaxed and not feel there is a right/wrong answer.
  2. Make sure the user thinks aloud. We can’t read minds so the user’s need to express what they are doing and more importantly, why they are doing it.
  3. Don’t be worried about hurting our feelings. We do this to get honest feedback. More often than not, users will tell you something is easy to use out of politeness and not wanting to offend but when you analyse how they’re using your system (mouse clicks, movements) you can tell they are lost.
  4. The user can ask questions while using the app, but we might not answer right away. This one’s tricky because you don’t want to give away too much information that you’re telling the user how to use your app. You want to see if they can figure it out for themselves.
  5. We are going to record this session but it is really only for internal use only. Recording the user’s actions allows us to pick up anything we missed the first time. Some user testing apps like silverback let you record the user’s face as a way to identify their enjoyment or frustration.

Lastly, it may be helpful to ask a few lead in questions to get the user talking and relaxed. E.g. what do you do for a living? You might follow up with something to help you identify if they are a core demographic for your test. If you are testing a mobile phone e-commerce site, you might ask them if they’ve purchased large electronics online before and if they say they only go to brick and mortar stores, then you know not to spend too much time.

With the prerequisites out of the way, you can get to the real meat of the testing - giving the user a scenario in which they are to act out. This is like role playing and an example is:

You are a parent of a year 9 student who’s been bullied at school and online through snapchat and instagram. You have searched online to see if you can do anything about it. You come across this site…

You would then show them the site and ask them what they would do if they wanted to find methods to stop their child from being bullied.

We were given five minutes to draw paper and pen mockups for one of our project’s features that we wanted to test. We then went around the room where one guy pretended to be the interviewer and the other guy, the user. The scenario I told Gary was that my app contained an emergency button to send a message to a contact and that his task was to update the contact’s phone number. Listening to Gary as he explained his thought process was invaluable as it revealed several flaws in my design.

Team Work

I conducted the same user testing interview with QA tester Cherry but this time, I used the marvelapp prototype I created from last week and I found that my design is difficult to use without explaining it. Rujia told me to redesign it and re-test with a member from another team. I updated the BAs about it and we moved the story back to analysis.

Meanwhile, Andrew was ready to do a shoulder/desk check after implementing the screen for showing the closest 3 services available to Allen. We went through the acceptance criteria (AC) one by one and found that one was difficult to implement. If the GPS is not working, a hotline number should be displayed. Since we don’t have a way to enable/disable the GPS, we decided to make the app alternate between GPS on and off states to simulate the AC.

Version 2. Settings navigation and button mapping mock up.


Version 3. Navigation + Look-and-Feel mock up. Input elements are black text on a white background with a black border. When an input element has focus, a purple border appears inside it. Since the background for all screens will be one of the colours of the home screen, the colour for the focus border needs to contrast well. Currently, it doesn't stand out as I had planned so maybe the border needs to be bigger than 2 pixels or the entire background of the button needs to be purple. Purple was chosen using the Adobe Color wheel. On the Emergency Contact screen, the words "Emergency Contact" have a white outline to contrast with the background colour. The mobile phone icon lets the user know to enter a mobile number.

RETROs

To improve:

  • Not enough devs/staff. We had 3 devs, 2 BAs and 1 XD. Gabe said she’ll play bad cop and make people more accountable if they can’t make it. Make sure to push code before leaving so others can use it if you’re away next week.
  • Need to move faster. Devs need to read AC more closely.

WoooOOOOooo out