- •1. Objectives: the questions we are trying to answer
- •2. Hypotheses: what we believe we already know
- •3. Methods: how we plan to fill the gaps in our knowledge
- •4. Conduct: gather data through the methods we’ve selected
- •5. Synthesis: answer our research questions, and prove or disprove our hypotheses
- •1. Identify your users
- •2. Decide what to ask
- •4. Gain an understanding of users
- •5. Analyze the data
- •6. Synthesize a model of users
- •7. Produce a document for others
- •8. Socialize the personas
- •Additional resources
- •What is a customer journey map?
- •Why you should create customer journey maps
- •How to research a customer journey map
- •Analytical research
- •Anecdotal research
- •Presenting your customer journey map
- •The difficulty of “face to face”
- •“I’m afraid I’ll be bothering people.”
- •Increase the value of participation
- •Find the right time
- •Be aware of body language
- •Fostering interest
- •Fostering goodwill
- •Offer incentives
- •“I’m afraid of rejection.”
- •Turn it into a game
- •Variation: football rules
- •“Only extroverts are good at this.”
- •Practice playfully
- •Make it meaningful
- •Pair up personalities
- •Go face to face
- •Resources
- •Start the planning and visa application process early
- •Partner with a great local firm
- •Hire a real-time translator
- •Limit the number of observers and make sure your client observes a few sessions
- •Plan more time than you think you need between interviews
- •Over-recruit in anticipation of no-shows
- •Incentives
- •Class structure
- •Geography
- •Holidays
- •Keep an open mind during your research for unexpected lessons
- •Learn about brazilian customs and culture
- •Greetings
- •Building trust
- •Portuguese
- •Working late
- •Technology
- •Conclusion
- •References
- •What is user testing?
- •User testing is…
- •User testing is not…
- •What is a user study?
- •A good user study has clear and measurable outcomes
- •A good user study is easy to facilitate
- •A good user study must be sufficiently detailed and interactive
- •Self-evaluation
- •User testing in an agile world
- •User testing at conferences
- •Attempt #1: puppetconf 2012
- •Attempt #2: puppetconf 2013
- •What did we learn?
- •Conferences let you cut the fat out of recruiting
- •Conferences let you validate your entire roadmap
- •Conferences are chaotic, but process can help
- •Conferences allow your competitors to snoop
- •Conferences are a great way to build user empathy
- •Conferences are a black hole for data
- •Process is king, but organization is queen
- •Use retrospectives to learn and improve
- •Should you add conferences to your toolbox?
- •Tips to make this work for you
- •Resources
- •Articles and examples
- •About The Authors carolyn chandler
- •About Smashing Magazine
Plan more time than you think you need between interviews
If you ever find yourself in São Paulo conducting interviews in varied locations, plan at least 90 minutes between interviews to navigate traffic. Similarly, if you are conducting a lab study, I also recommend planning extra time between sessions to account for participants who are running late because of traffic. In 2013, CNN published an article5 noting that São Paulo is the “seventh most congested city in the world.” It didn’t take long for us to understand just how bad it was. On one occasion Google Maps informed us that it would normally take 22 minutes to get to our next interview, but in current traffic it would take over an hour. Unexpectedly, this was one of the most important takeaways from the trip because it helped us understand why locals are so motivated to find homes near the subway.
Over-recruit in anticipation of no-shows
Owing to heavy traffic congestion and a generally laid-back culture, participants cancelling interviews or starting very late is not uncommon. We had a couple of last minute cancellations that we struggled to fill until the very end. It would have been a major missed opportunity to not reach our quota after spending so much time, energy and money to travel to Brazil and plan for the research. For these reasons you need to over-recruit your study. Plan to tack on an extra couple of participants for every 10 whom you would normally recruit and be prepared to go with the flow. Trust me, it’s worth the expense to have that security. My colleague avoided this problem during his research in Brazil by setting aside a half-day at the end of the study that he could fill with people who needed to reschedule. Below are additional tips about recruiting:
Incentives
When recruiting, you will want to encourage candidates to participate with some sort of compensation. Our research partner explained in some cases this could be a bottle of high-quality liquor. For our study we used $190 USD as the incentive. If you go the cash route, you will want to make sure the amount reflects both the duration and location of the interview. Our interviews were 90 minutes each, so a 60-minute interview might be $125 USD. Similarly, it would be appropriate to compensate participants more for in-home research rather than lab research because they are allowing you and your colleagues to visit their homes.
Class structure
Brazil is different from the U.S. in that they have a well-defined and widely understood class structure based on income level6. Levels range from A (the super rich) to E (the very poor). Don’t be afraid to ask candidates what class level they fall into when you’re recruiting. We were looking for a mix in class levels, yet wanted to focus on those who would likely search for homes online; thus we recruited participants from A, B and C level classes. When you’re in Brazil, the class structure will become clearer when you see extremely low-income communities side-by-side with the super rich, especially in urban areas. Note: it may be easier to recruit participants in A, B and C classes since it is more likely that they have a phone where you can reach them.
