Surveys
How to design, deploy, and analyse UX surveys — from question writing to sampling strategy — to collect reliable attitudinal and preference data at scale.
What is it?
Surveys are a quantitative (and sometimes qualitative) research method for collecting self-reported data from a large number of users simultaneously. In UX research, surveys are used to measure attitudes, preferences, satisfaction, and needs — data that is difficult to obtain from behavioural analytics or that requires scale beyond what interviews can achieve.
Why it matters
Surveys are one of the most scalable UX research methods — a well-designed survey can collect structured responses from thousands of users in days. They are particularly valuable for: measuring satisfaction (NPS, CSAT, SUS), understanding user demographics and context, prioritising features across a large user base, and tracking attitudinal changes over time. However, surveys are also one of the most misused methods — poorly designed surveys produce data that actively misleads design decisions.
Best Practices
- Define your research question before writing a single survey question. Every question should be traceable to a research objective.
- Write one concept per question. Double-barrelled questions ("How easy and enjoyable was the checkout?") produce uninterpretable responses.
- Avoid leading questions. "How helpful did you find the new navigation?" assumes it was helpful. "How would you rate the navigation?" does not.
- Use established scales for attitudinal measurement: Likert scale (1–5 or 1–7), NPS (0–10), SUS (10 standardised questions). Don't invent your own scales unless necessary.
- Put the most important questions first — survey completion drops rapidly after the first 3–5 minutes.
- Target 5–10 minutes maximum for general UX surveys. Task-specific intercept surveys should be 2–3 minutes.
- Random sampling matters. If you survey only active users, you are systematically excluding users who churned — often the most important group to understand.
- For NPS and CSAT: always follow up the numeric rating with an open-text question ("Why did you give that score?") — the qualitative response is often more actionable than the number.
- Pilot the survey with 5 users before full deployment to catch ambiguous questions.
- Analyse open-text responses with thematic coding, not keyword counting.
Common Mistakes
- Writing questions first and defining the research objective after — produces surveys that answer no meaningful question.
- Double-barrelled questions that cannot be cleanly interpreted.
- Leading or loaded questions that bias responses toward expected answers.
- Survey length that causes satisficing — users give any answer to finish rather than their true opinion.
- Using surveys when observation would produce more accurate data. Users report what they think they do; observation shows what they actually do.
- Convenience sampling: surveying only users who voluntarily engage — these are usually your most enthusiastic users, not representative of the whole user base.
- Treating correlation in survey data as causation without supporting evidence.
- Never closing the loop: collecting survey feedback and making no visible changes — damages user willingness to respond in future.
Checklist
Research & Theory
System Usability Scale (SUS — Brooke, 1986)
A 10-item standardised questionnaire measuring perceived usability. Score of 68 = industry average; above 80 = excellent.
Why it's relevant
SUS is the most widely-validated, most used quantitative usability measurement tool. Every UX designer should know how to deploy and interpret it.
Net Promoter Score (NPS — Reichheld, 2003)
"On a scale of 0–10, how likely are you to recommend us?" Promoters (9–10) - Detractors (0–6) = NPS score.
Why it's relevant
NPS is a single-number loyalty measure widely used in product teams. Useful as a trend metric — rising NPS correlates with improving product satisfaction.
Cognitive Biases in Survey Design (Krosnick, 1999)
Research cataloguing how question wording, order, and scale design systematically bias responses. Response acquiescence, social desirability, and anchoring effects all distort survey data.
Why it's relevant
Survey design is not neutral. Every question wording and scale choice introduces potential bias. Understanding these biases is essential for collecting valid data.
Real-World Examples
Intercom
Deploys NPS surveys via in-product chat after 90 days. Follows up with qualitative interview offers to NPS detractors. Trends NPS quarterly by cohort and feature set.
Atlassian
Uses CSAT surveys on support interactions and CES (Customer Effort Score) on onboarding completion. Survey insights are tracked per product quarter and reported to design leadership.
Figma
Deploys targeted intercept surveys to users who just completed specific workflows (export, sharing, component creation) — extremely high relevance and response quality.