18th September 2019
If you check out our blog once in a while or follow us on social media (maybe head over to Twitter and give us a follow if you’re not doing that already?), you may have noticed that we have been talking a lot about the relevance of remote research and unmoderated online tasks. Back in July, we launched our new survey and online task recruitment service, so we have been focussing on how to help you get the most out of this research option.
Today we’re talking about five important things you need to consider when planning your unmoderated remote research project and, specifically, when choosing the perfect tool to run the sessions. According to the this article by the Norman Nielsen Group, “unmoderated sessions require a more complex platform than moderated remote sessions, for which online-meeting software such as GoToMeeting is enough. For unmoderated user testing, you need an application that plays the role of a session facilitator: it guides the participants through the session and records what happens.”
Choosing the right tool to run your remote sessions is essential, as it will determine how the participants, for example, view and feed back on your prototypes and share quality insights. Keep an eye out for the following.
Check that you are able to write and provide your own tasks to your users, but also that the process of delivering said tasks to the participants during the session is user-friendly and straightforward.
Although most remote research platforms can provide sample tasks, these should ideally only be used as inspiration for your sessions, as they are often too generic. Also make sure that the platform you have chosen doesn’t limit the amount of tasks you can share with the participants: having a time limit is normal in most scenarios, but a good platform will allow you to write as many tasks as you want.
If being able to see a recording of the session is essential to help you achieve your goals, then this is functionality you must look for ahead of the research or testing. However, don’t forget the importance of being able to listen to the recording: “screen recordings are helpful, but, in the absence of an audio recording, it is easy to miss why certain behaviour occurred. […] The audio recording of participants verbalising their actions is essential,” the nngroup.com writes.
Be aware that, if testing with people who are not familiar with the tool you have selected, some users may not feel comfortable with the idea of being filmed or recorded and that could make the recruitment more challenging.
Make sure that the tool you are planning to use allows you to test with multiple devices – web and mobile on desktop, smartphones, tablets – and research into the specifics of what each service offers. Something else to look for is the ability to upload your own prototypes and sketches to the platform, seamlessly integrating them into the structure of the session.
… or as quickly as possible depending on how niche your audience is and how many participants you need. It’s also worth checking how the platform provides the results: is it just a data dump or can you actually get an organised report with different graphs and charts? Can you see results being updated in real time and feeding into a nicely designed dashboard, which can be accessed by your entire team using different logins?
Before we start thinking about the results, however, we need to consider how you will find the participants, which brings us to the following question.
While some tools only provide you with a link to submit to your own participants, other platforms offer extras like user recruitment services. There is also a third scenario: working with a user recruitment agency like People for Research to find the right participants for your sessions.
+ Using your own participants
Pros: participants are already engaged with your brand, so involving them in the project should be fairly easy. This is also the cheapest recruitment option, as you only need to provide the participants with incentives.
Cons: if you run regular testing or research with this panel, they are likely to be too knowledgeable when it comes to research or your brand. Also, if they are your customers, it’s likely they will go into the sessions with positive or negatives assumptions resulting from previous interactions with your company.
+ Using the platform’s user recruitment services
Pros: users are familiar with the software and methodology and can participate in your session as soon as they have time.
Cons: once again, you risk running sessions with “serial participants”. Most platforms will not tell you how many times users have taken part in research/testing previously, which could be damaging for your project. Also, check the targeting options offered by the platform to make sure they are not too basic for your requirements.
+ Working with an agency like People for Research
Pros: a specialist recruiter like PFR will tailor the process to your needs and deliver the participants you require according to your brief. If needed, some recruitment agencies can also run feasibility studies ahead of the recruitment and feed back on your screening process. If you are considering working with a recruitment partner, make sure that you select one (like PFR) that has experience in recruiting participants for unmoderated remote research/testing and work according to the Market Research Society’s code of conduct.
Cons: recruitment is likely to be a bit more expensive and lengthy compared to using the platform’s user recruitment services, but there is a guarantee that you will get the users you need – and everyone knows that great participants translate into quality insights.
If you would like to find out more about how we recruit participants for remote research and online tasks, read this blog or email firstname.lastname@example.org.
Vicky Karran, Head of Projects
If you would like to find out more about our in-house participant recruitment service for user research or usability testing get in touch on 0117 921 0008 or email@example.com.
At People for Research, we recruit participants for UX and usability testing and market research. We work with award winning UX agencies across the UK and partner up with a number of end clients who are leading the way with in-house user experience and insight.