42% of people can't spot AI design. Can you?
Compare real products vs. AI designs. Pick the better design then guess which one was made by AI.
How it works.
Compare designs.
Review two designs side-by-side. One real, one generated.
Pick the better design.
Without knowing which is real, judge how well each design accomplishes the task.
Spot the AI design.
Identify the AI design, then reveal the answer and see which design you preferred.
Methodology
Can AI design a new feature for a real product?
AI designs a feature from a live product without seeing the real one. People compare the two without knowing which is which.
What we measure
- Preference.
- Which design people think is better for the task.
- Identification.
- Whether people can tell which design is AI-generated.
How we run it
- Real features.
- Each task is a feature from a live web product, captured from a real account.
- Product context.
- The AI gets a written brief, other screens from the product, and its fonts, icons & colors.
- Real design withheld.
- The AI never sees the real screen. Briefs describe what the feature does, not how it looks.
- Blind comparison.
- Screens appear as A and B in random order, at the same size & quality. The answer comes after both judgments.