Testing abroad almost always involves working with a testing agency. Think expensive contracts. Translation services are likely to be an additional cost. Test objectives and scenarios were wriRen internally before shared with testing consultants. Number of test objectives in the usability test plan were too numerous for the test. Do all that you can to assess the skills and abilities of any agency or contractor you intend to hire. Get multiple bids if you can. Over communicate all testing objectives until they are capable of being your proxy. Some translated words were too literal and were not reviewed for context within the prototype. as it was executed.
!"#$%#&'()*+, ") A Case study BY JOE DYER Overseas usability testing '!"#/,*0#1 234*$314#3&#)*&5*6,#3#7/#&+#0.#3"83)*0*(+0(314#3 9:*6+,+1%31#:;0(3"83*3/&"1"1%/#3+03<9&"/#3*.&"::3 14&##3)*&5#1:- A long time ago in a country far, far away ★ =>3$*%: ★ =?@A>B3)+,#: ★ B31#:;0(3,".*;"0: ★ =3/&"1"1%/# ★ B3,*0(9*(#: ★ >C31#:13/*&;.+/*01: by the numbers ★ =>3$*%: ★ =?@A>B3)+,#: ★ B31#:;0(3,".*;"0: ★ =3/&"1"1%/# ★ B3,*0(9*(#: ★ >C31#:13/*&;.+/*01: by the numbers DEFGEF HIJ2K L2DIF Who is this for? usability experts Business or product managers Who is this for? the morbidly curious Who is this for? wait, what are we talking about? the morbidly curious Who is this for? is testing Different overseas? How testing is different overseas INTERACTIVE AGENCY M#:;0(3*6&"*$3*,)":13*,N*%:3+0O",O#:3N"&5+0(3 N+143*31#:;0(3*(#0.%-3M4+053expensive3."01&*.1:- [...]... different overseas Less than favorable exchange rates in the last several years How testing is different overseas London milan Have you seen the cost of interna;onal travel these days? How testing is different overseas He says, your breath He says, your breath smells like garlic! smells like garlic! votr e ha lein sen e t l 'a il! Transla;on services are likely to be an addi;onal cost... cost 4 what worked well and what did not? preparation facilitation execution Plan early & Share early Test objec;ves and scenarios were wriRen internally before shared with tes;ng consultants appropriate # of tasks Number of test objec;ves in the usability test plan were too numerous for the test as it was executed appropriate # of tasks Facilitators wasted too... on unrequested benchmark tes;ng ques;ons Engage early & often agency client Maybe two conference calls and a dozen or so emails were not quite enough Engage early & often ZZZZ agency client Maybe two conference calls and a dozen or so emails were not quite enough Test preparation Do all that you can to assess the skills and abili;es of any agency or contractor you intend to... We take your b ags and send them in all directions er has manag The onally pers all the assed p d here serve water Come alive with the Pepsi Generation Pepsi will bring your ancestors back from the dead Salem - Feeling Free When smoking Salem, you feel so refreshed that your mind seems to be free and empty selecting test participants The English call screener was easy to review and approve... 1 am daily of 9 and 1 the hours Some translated words were too literal and were not reviewed for context within the prototype Please leave your values at the front desk The genuine antics in your room come from our family castle Long life to it special today: no ice cream special today: no ice cream eave es l win ou r g to thin u no yo for ope h We take your b ags and send them in all... can Over communicate all tes;ng objec;ves un;l they are capable of being your proxy the prototype We created a single prototype, in three languages go high-fidelity Limited sta;c HTML model made it nearly impossible for test par;cipants to explore the possibili;es of the prototype lost in translation ected to rs are exp Visito between the office omplain at... seems to be free and empty selecting test participants The English call screener was easy to review and approve The French screener? The Italian screener? printed test scenarios Scenarios were given to par;cipants wriRen on a card for consistency