Iteration 3

With the digital prototype we took a step back in our testing process. We want to be sure that just like the paper prototype the functionalities of the digital one are all clear. This will be investigated in iteration 3. This iteration isn’t completely finished yet, so we will wait with publishing the results and the conclusion, but here is already the set-up of it.

Iteration 3

Goal

  • We want to test whether by digitalising the prototype no new issues are discovered that weren’t there in the paper prototype.
  • We will test if the reactions of the users remain the same.
  • Temporarly the  buttons with logo’s are replaced by keywords to test just the basic operations. Later on, the logo’s on the buttons will be tested on ‘clearness’.

Method

Digital Prototype in HTML5 together with the Think Aloud protocol.

Rationale

  • Digital Prototype is used because the application is developed to work as a plug-in with accompanying site and this closely resembles how the application will look like in the future.
  • The reasons to use the think aloud protocol are the same as in Iteration 1.

Who, What, Where, Time?

  • Who? 5 testpersons, 2 were family-related to a group-member, 3 of them were searched in the wild
  • What? All the test-persons will be asked to execute some basic assignments: register (T3.1) and log-in (T3.2) , give a tip via the plug-in (T3.3), remove a friend (T3.4), look at a tip and like it (T3.5), add a friend  (T3.6), give a tip via the site (new-tip tab and friends tab) (T3.7), log out (T3.8).
  • Where? 200A Foyer and Kapucijnenvoer 113, 3000 Leuven
  • Time? The duration of each test took at most 5 to 10 minutes.

Results

  • n = 3: Didn’t find at all the functionality to add a friend. They used the search-functionality to look for a new friend and not the add-friend-button (R3.1).
  • n = 2: Found the adding-functionality, but it took at least ten seconds longer than the other assignments to complete (R3.2).
  • n = 2: Mentioned that the concept of liking a tip is clear, but re-liking1 a tip wasn’t easy to find (R3.3).
  • n = 1: After registration asked and we quote: “Did it work?” (R3.4).

Conclusion

  • T3.1 It was not clear to all test persons if registering was successful or failed so we will add a notification of this (R3.4).
  • T3.2 There were no noticable problems with the login, so this is good.
  • T3.3 Everything went fine.
  • T3.4 By executing this assignment we noticed we forgot the ‘Are you sure? – pop-up’2 !
  • T3.5 Liking a tip was no issue. To make sure people do find the re-liking1 functionality we will display a short message when hoovering over the (dis)liked button (R3.3).
  • T3.6 All the testpersons encountered problems while adding a friend. The button to fullfill this functionality is not obvious enough. They all searched for this at the left side of the page and didn’t look at the right top. We will adjust this button and move it to the left top (R3.1 & R3.2).
  • T3.7 Giving a tip via the site didn’t reveal any problems.
  • T3.8 Also logging out gave us no noticable problems.

1: Re-liking: When you have (dis)liked a tip, you can change your mind and undo your opinion.

Areyousure 2: Are you sure? – pop-up: Extra confirmation screen when removing a friend, because comments on our blog suggested that this decision was too heavy without any confirmation.

Areyousure

5 Responses to Iteration 3

  1. Do you think the user tests you will be doing with your family (and friends) are 100% representative to get some real information? Because I think family is not always that honest with giving comments and suggestions on created work of their nephew/niece/son/…/family member.

    • api4kul says:

      You’ve got a fair point there but using family and friends is just the beginning. We are doing this to get a fast first result. We will also be testing ‘in the wild’. Next we would also like to put the site online so we can use google analytics to collect results.

  2. Could you add some screenshots next post? I’d like to see the interface that is causing the issues, for example, I’d like to see what is causing the find/add friend issue (which was mentioned in your previous iteration as well).

    Make sure you keep screenshots of your iterations, will make for a more interesting end report/presentation.

    • I agree with this, it’s rather hard to understand the problems due to the lack of screenshots. Aside from the end presentation, it’s also important to have a fast way to compare all iterations to each other and be able to see the overall evolution.

  3. I see no problem in asking family to test it out, for example I am sure that brothers and sisters are more honest than random people which you encounter on the street. So although family cannot be the only test group, it sure should be one of them.
    It’s good that you make a specific test for the paper to digital switch, because this is indeed not so trivial as it sounds!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: