Survey questions can display a maximum of seven answer options at one time to a respondent. When the number of answer choices for a question exceeds the number that can be displayed at one time, a subset of the answer choices is shown.
The subset of answer choices always contains the maximum number of answer choices that can be displayed.
The answer choices presented are generated randomly (i.e., a random subset of all answer choices), without regard to the number of times a particular answer has been shown or to the answer combinations that were previously generated.
Survey results are weighted using the techniques described in A Penalized Maximum Likelihood Approach for the Ranking of College Football Teams Independent of Victory Margins by David Meese. The methodology is the same one used by the NCAA to determine team rank in tournaments. Answer choices are weighted solely on their wins and losses against competing answer choices. This methodology compensates for answer bias that may occur from the randomly generated answer subsets. This bias grows smaller as the number of responses increases. The weighting can be turned off in Options to show the raw scores.
Note that we envision that customers use partial ordering to glean the top-seven answers from a list of more than seven answer choices. Once you know what the top-seven choices are, you can run a follow-up survey with just those choices, and see which answer is the statistical winner.