Things to keep in mind when creating surveys
This document introduces common mistakes we see on Google Surveys. Having good survey design for your research helps to enhance data quality and a better user experience.
In this article:
Spelling and grammar issues (all)
Using a suitable language (all)
Unnecessary capitalization (all)
Asking for demographic information (all)
Inappropriate question format (all)
Missing an opt-out answer choice (Single Answer Q)
Conflicting answer choices (Multiple-Answers Q)
Rating scales not clear (Rating)
Character limit (all)
Numeric value answers in open-ended format (Open-ended)
Each survey question can only ask one question (Open-ended)
Binary (Screening Q)
Inappropriate Image (Image Q)
Inappropriate Video (Video Q)
Pinning the right answer
Most mistakes involve spelling and grammar, which can be crucial for your data quality.
Using “u” instead of “you” or “Cofee” instead of “Coffee” could be misunderstood by respondents and could affect the quality of your responses.
Use a spelling/grammar checker and preview your content before submission.
Questions and answers need to be written in a language widely accepted and understood in the target country.
The question and answer choices are written in Japanese while its targeting option is set to the U.S.
Rewrite the question/answer choices in English, keeping the targeting option set to the U.S.
Change the targeting option to Japan, keeping the question/answer choices in Japanese.
Question/answer text may not contain unnecessary capitalization of words or phrases.
Unnecessary emphasis on individual words or phrases.
Making a word or phrase bold by putting asterisks around it (*Apple*), or italic by using underscores (_Apple_), also has the same highlight effect.
If you plan to ask respondents to specify their age range, gender, race, ethnicity, religion, or immigration status, make sure the question meets the following requirements:
- The answer choices are in groups or ranges.
- There is an “I prefer not to say” answer choice.
- For questions asking for age, the answer choices shouldn’t directly or indirectly contain any age under 18.
The answer choice “Under 18” is not allowed, and it does not include “I prefer not to say” option.
Remove “Under 18” and add an “I prefer not to say”.
If you want respondents to select only one choice, the Multiple-answers question format isn’t appropriate because it allows them to choose more than one answer.
The respondents can choose more than one answer.
Use the Single-answer format or Rating Scale question type instead.
An opt-out answer choice such as “None of the above” or “Others” can help keep the response quality high when the answer choices don’t apply to everybody.
Those who don’t drink alcohol at all won’t be able to answer the question.
Add an answer option “None of the above” or “Other”.
More than one answer and there is an automatic “None of the above” option to the list. Make sure there are no conflicting answer choices in the list.
If a respondent picks “Germany” and “I have never been abroad before”, then it won’t make sense and result in poor data quality.
Remove the option, “I have never been abroad before”.
The “Rating Scale” format lets people choose from a range of options. The clarity of the range is crucial in order for respondents to provide accurate responses.
The question asks “how important”, but the scale ranges are from “no” to “yes”.
Edit the ranges from "Not important” to “Very important".
Some text appears to be incomplete. The creator tool allows a maximum number of characters to be entered (e.g., 44 characters in English per answer text and 175 characters in the question).
Watch out for indicators that the character limit has been reached, such as the red line and the character count below the text. Look at the right hand pane of the creator tool to check for cut-off or incomplete texts.
The question asks for answers in numeric values, e.g. 0, 1 or 2 (times), but open-ended format (including open-ended “other” field) is only suitable for text answers
Change the question type to single answer format and include answer options with numeric values for respondents to choose from.
There are 2 questions in the example above. For open-ended question format, only a single question is allowed.
Consider splitting into two separate questions, or possibly reword.
The first screening question should have more than 3 answer choices because incidence accuracy is better when binary questions are not used.
The question above has 2 answer choices, Yes or No.
Having three answers or more helps eliminate confusion for the respondents, provides a better user experience, and improves the quality of survey results. Please add a possible third response such as "Maybe" or "Not sure".
Images should be clear, legible and compliant with all other content policies. Images larger than 300x250 pixels will be shrunk to that size, and must be in GIF, JPEG, or PNG formats. Animated GIFs are not allowed.
There can only be one video in a survey, and it must be shorter than 2 minutes, match the survey language in either its audio or subtitle, set to public or unlisted and be strictly compliant with all other content policies. Also, surveys with video questions can only have one screening question.
Answer choices "None of the Above", "All of the Above" or “XX of the above” must be pinned (by using the pinning feature) to always show at the bottom of the answer list.