Within AppStoreResearch, you have the option to create screener questions on Step 3 of the project creation form. Feel free to skip them for broad research, but if you're targeting a specific audience, take a moment to check out this guide for crafting the right questions.

Our platform provides all types of screener questions: open answer, single answer, multiple answers.

If you want people with specific expertise, skills, or app stack to join your research interviews, it's important to ask the big questions upfront. This simple step can save you a significant amount of time in selecting the most suitable participants for your project. 

Common mistake

Some people use screener questions to ask research questions instead of a tool to narrow down on the audience. This is the wrong approach.

Our participant form already includes details such as location, role, industry, company size, skills, tech stack, Shopify Plan and monthly revenue. For the screener question, consider including something more specific. 

How to create right screener questions?

If you're looking for the right participants, it's key to craft smart screening questions. It's not always as simple as it seems! You need to phrase questions in a way that doesn't guide people to specific answers, yet still be clear to ensure everyone understands.

1. Keep it simple and choose the right words

Screener surveys aren't an opportunity for participants to tell you everything about them. They work best when they include only targeted questions that help you ensure participants will be able to provide relevant answers during your research interview.

• Avoid double negatives. 

• Keep the questions short. 

• Be specific.

For instance, when you request numerical values like period of time, size, or frequency, just make sure your values don't overlap.

Correct: 0-1, 2-3, 4-5
Incorrect: 0-1, 1-2, 2-3

We recommend keeping the number of questions you ask to a minimum (think 3-10 questions instead of 15+), and using skip logic to make your screener easier for participants.

The more clearly worded and specific your questions are, the less likely participants will be to get confused and answer inaccurately. Leave no room for misinterpretation!

2. Don't ask leading questions

If you tell your participants exactly what you want them to say during your screener survey, you lower your chances of getting good, honest feedback. 

A nice trick to spot a leading question is when it drops a hint or leaves out some answers.

For example, asking someone "On a scale of 1-10 how much do you hate using X app?" tips them off that the right answer is probably "10 - it's the worst stuff in the world!"

On the other hand, asking someone "On a scale of 1-10, 1 being "I hate it" and 10 being "I love it", how do you feel about using X app?", obscures your intention and allows the participant to say how they really feel about particular app. This means you'll get more honest responses, both in the screener phase and during your research study.

Another trick to avoid leading questions is to offer a bunch of random options as answers. For instance, if you're trying to filter out users with analytics problems, instead of asking:

Are you concerned about your analytics tools? (leading)

You could come up with a question like this (not leading):

What topic worries you the most as a Shopify seller?

• Mobile Optimization. 

• Payment Issues. 

• Slow Loading Speed.

• Analytical Issues. ✅

• I don’t know. / None of the above. 

Similarly, it's best to steer clear of yes/no or true/false questions as they can come off as leading. Users may feel inclined to answer in a certain way to qualify for the study. 

Exceptions will involve the app or tool experience of participants.

3. Add a general alternative choice.

Be sure to add a 'none of the above,' 'I don’t know,' or 'other' option to cover any exceptions. This way, you won't have someone in your study who feels out of place due to a limited choice. Also, it helps avoid excluding good participants just because they don’t perfectly align with the provided answers.

4. Ask bigger question upfront

Don't make potential participants fill out the whole screener before knowing they might not qualify. Get rid of unqualified folks at the start. Think of it as a funnel. 

The simplest way is to write down your questions, prioritize them, and check for any connections.

For instance, if you're making an app for florists with a physical floral shop, start with this question before asking about what apps they use or what difficulties they face.

Here are a few examples of screener questions from actual projects.

• Have you synced your inventory between Shopify and other platforms like Amazon, Walmart, Ebay, Etsy, TikTok, etc,. in the past 12 months? 

• Do you use FAQs in your store? If yes, where? 

• Have you ever migrated from one theme to another? 

• Do you use an agency or Shopify expert/developer to complete work on your theme? 

• How many times do you make changes to your size charts each month?
  
  

Conclusion

When you're putting together a screener for your study, it's really important to think about including a diverse group of participants, starting off with those big questions, and organizing your questions in a way that just makes sense. 

By doing this, you'll make sure your study is welcoming and runs smoothly, giving you the chance to gather some really interesting insights from different viewpoints. Don't get caught up in sticking to specific criteria or leaving out potential participants just because they don't fit a certain mold. 

Stay open-minded and focus on getting helpful info rather than sticking strictly to pre-conceived ideas. By keeping these tips in mind, you'll be all set to create a well-thought-out screener that lays the groundwork for a successful study.