- •1. Objectives: the questions we are trying to answer
- •2. Hypotheses: what we believe we already know
- •3. Methods: how we plan to fill the gaps in our knowledge
- •4. Conduct: gather data through the methods we’ve selected
- •5. Synthesis: answer our research questions, and prove or disprove our hypotheses
- •1. Identify your users
- •2. Decide what to ask
- •4. Gain an understanding of users
- •5. Analyze the data
- •6. Synthesize a model of users
- •7. Produce a document for others
- •8. Socialize the personas
- •Additional resources
- •What is a customer journey map?
- •Why you should create customer journey maps
- •How to research a customer journey map
- •Analytical research
- •Anecdotal research
- •Presenting your customer journey map
- •The difficulty of “face to face”
- •“I’m afraid I’ll be bothering people.”
- •Increase the value of participation
- •Find the right time
- •Be aware of body language
- •Fostering interest
- •Fostering goodwill
- •Offer incentives
- •“I’m afraid of rejection.”
- •Turn it into a game
- •Variation: football rules
- •“Only extroverts are good at this.”
- •Practice playfully
- •Make it meaningful
- •Pair up personalities
- •Go face to face
- •Resources
- •Start the planning and visa application process early
- •Partner with a great local firm
- •Hire a real-time translator
- •Limit the number of observers and make sure your client observes a few sessions
- •Plan more time than you think you need between interviews
- •Over-recruit in anticipation of no-shows
- •Incentives
- •Class structure
- •Geography
- •Holidays
- •Keep an open mind during your research for unexpected lessons
- •Learn about brazilian customs and culture
- •Greetings
- •Building trust
- •Portuguese
- •Working late
- •Technology
- •Conclusion
- •References
- •What is user testing?
- •User testing is…
- •User testing is not…
- •What is a user study?
- •A good user study has clear and measurable outcomes
- •A good user study is easy to facilitate
- •A good user study must be sufficiently detailed and interactive
- •Self-evaluation
- •User testing in an agile world
- •User testing at conferences
- •Attempt #1: puppetconf 2012
- •Attempt #2: puppetconf 2013
- •What did we learn?
- •Conferences let you cut the fat out of recruiting
- •Conferences let you validate your entire roadmap
- •Conferences are chaotic, but process can help
- •Conferences allow your competitors to snoop
- •Conferences are a great way to build user empathy
- •Conferences are a black hole for data
- •Process is king, but organization is queen
- •Use retrospectives to learn and improve
- •Should you add conferences to your toolbox?
- •Tips to make this work for you
- •Resources
- •Articles and examples
- •About The Authors carolyn chandler
- •About Smashing Magazine
Hire a real-time translator
I cannot stress highly enough the value of a high-quality translator. Neither my colleague nor I spoke Portuguese. We knew we needed someone to moderate the interviews, and we knew it would be important for us to be able to ask follow-up questions. We requested that when each of the three firms sent us a quote they included the cost of a real-time translator for ten 90-minute sessions. The quotes for translation ranged from $5,600 to $8,500 USD and it was worth every penny. The translator has a unique role not to be confused with someone who is simply fluent in two languages. Experienced translators are able to comprehend and verbalize meaning very quickly. If the subject matter of your study is very specific, like healthcare for example, you need to find a translator with experience translating on those topics.
The real-time translation worked just about as you think it would if you were at the United Nations. The participant, moderator, translator, and myself would all sit around the participant’s kitchen table or in their living room. The translator wore a headset with a microphone and would speak very softly in English, which would come through on my headphones. The speech was very nearly real-time and incredibly effective – most importantly, it didn’t disrupt the conversation between the participant and the moderator.
It was imperative for us to understand exactly what was said. There were many colloquial phrases that did not have direct translations into English. For example, one participant used a common Brazilian phrase that goes something like, “If a cat gets burned once he will never get burned again.” The participant followed up by saying “Good luck translating that one!” Our translator did a great job helping us understand these colloquial phrases, which in turn helped me better understand the participant’s reactions. Make sure you use a translator who comes recommended – and remember that Brazilian Portuguese is different from European Portuguese.
Real-time
translation.
Limit the number of observers and make sure your client observes a few sessions
It’s always a good idea for clients to observe user interviews because watching in real time usually means they are more focused and catch more detail – it’s easy to get distracted by other tasks when watching a recording on a laptop after the fact. However, there is such a thing as too many observers. Aim to bring only two to four people to each interview, otherwise the participant can feel overwhelmed and uncomfortable. If you’re not fluent in Portuguese then two of those people will likely be the moderator and translator; beyond that, plan to either bring a client observer or colleague, but not both.
This goes for research in other countries as well. My colleague recently conducted in-home user interviews in Hyderabad, India where participant homes were very small. In addition, it’s typical for extended families to live under one roof in India (parents, kids, aunts, uncles, grandparents). In her case she could only bring one observer to each session because there simply wasn’t enough space for a third person to sit.
