Things to keep in mind when creating surveys
This document introduces common mistakes we see on Google Surveys. Having good survey design for your research helps to enhance data quality and a better user experience.
In this article:
Using not a suitable language (all)
Unnecessary capitalization (all)
Asking for demographic information (all)
Inappropriate question format (all)
Missing an opt-out answer choice (Single Answer Q)
Conflicting answer choices (Multiple-Answers Q)
Rating scales not clear (Rating)
Character limit (Open-ended)
Surprisingly to some, the most popular mistake is spelling and grammar, which can be crucial for your data quality.
Using “u” instead of “you” or “Cofee” instead of “Coffee” could be misunderstood by respondents and could affect the quality of your responses..
Make sure to preview the content to double-check. It is also advisable to use a spelling/grammar checker before submission.
Questions and answers need to be written in a language widely accepted and understood in that country.
The question and answer choices are written in Japanese while its targeting option is set to the U.S.
Rewrite the question/answer choices in English, keeping the targeting option to the U.S.
Change the targeting option to Japan, keeping the question and answer choices in Japanese.
Question/answer texts may not contain unnecessary capitalization of words or phrases.
Unnecessary emphasis on the sentence or/and wordings.
Making a word or phrase bold by putting asterisks around it (*Apple*), or italic by using underscores (_Apple_), also has the same highlight effect.
If you plan to ask the respondent to specify their age range, gender, race, ethnicity, religion, or immigration status, make sure the question meets the following requirements:
- The answer choices are in groups or ranges.
- There is an “I prefer not to say” answer choice.
- For questions asking for age, the answer choices shouldn’t directly or indirectly contain any age under 18.
The answer choice “Under 18” is not allowed, and it does not include “I prefer not to say” option.
Remove “Under 18” and add an “I prefer not to say”.
If you want the respondents to select only one choice, the Multiple-answers question format won’t be appropriate because it would allow them to choose more than one answer.
The respondents can choose more than one answer.
Use the format to Single-answer or Rating Scale question type instead.
An opt-out answer choice such as “None of the above” or “Others” can help keep the response quality high when the answer choices don’t apply to everybody.
Those who don’t drink alcohol at all won’t be able to answer the question.
Add an answer option “None of the above” or “Other”.
More than one answer and there is an automatic “None of the above” option to the list), make sure there are no conflicting answer choices in the list.
If a respondent picks “Germany” and “I have never been abroad before” at the same time, then it won’t make sense and result in poor data quality.
Remove the option, “I have never been abroad before”.
The “Rating Scale” format allows people to choose from a range of options. The clarity of the range is crucial in order for the respondents to provide an accurate response.
The question asks “how important”, but the scale ranges are from “no” to “yes”.
Edit the ranges from “Not important” to “Very important".
The question asks for as many names as possible, but the respondents can enter a maximum number of characters (e.g., 44 characters in English).
Change the second sentence to "Please type 2 to 3 names that you can recall".