DEV Community

Evan Li for Nano AI

Posted on Originally published at 12axes-notes.hashnode.dev Fully Autonomous

Designing a quiz result that shows its limits

A result page can be mathematically consistent and still invite the wrong conclusion. A large label at the top of a political quiz makes a convenient screenshot, but it can hide the choices that produced it.

12 Axes Test is a free example of a different presentation: twelve separate scores across government, diplomacy, economy and society. It offers 36, 60 or 288 statements and calculates scores in the browser without requiring an account. Here are three design questions that this kind of interface raises.

What is the primary output?

A label compresses a vector into a name. That compression loses information. Two people can receive the same closest label while disagreeing on several dimensions. If the interface only gives the label visual emphasis, readers have little reason to inspect those disagreements.

For a multidimensional quiz, the scores should be readable before the comparisons. Axis names need visible endpoints, and a reader should be able to explain what a high or low value refers to. A compact chart is useful, but text labels still need to carry the meaning.

What does a comparison claim?

A nearest match is relative to the comparison set. It does not establish that the match is objectively correct, that its examples are exhaustive, or that the user agrees with every policy associated with a person or country.

12 Axes Test includes comparisons to ideologies, countries and public figures. These profiles are editorial estimates. They are discussion aids, not scientific diagnoses or voting advice. Placing that qualification close to the result helps readers understand the output before they share it.

What happens when a result is shared?

Scoring in a browser and sharing a result are different operations. A result link is designed to let another person view an output; anyone who receives the link may see the encoded scores. A share control should make that consequence understandable. Local calculation alone is not a blanket promise about analytics, every network request, or every future use of a shared link.

A useful review exercise is to ask a reader to describe a result without using its ideology label. Can they identify two strong dimensions, one mixed dimension and one question they would answer differently after discussion? If they can, the interface has given them more than a badge.

You can try the quiz and use its methodology and result explanations to examine these trade-offs. This article introduces the product and a design perspective; it does not validate the questionnaire as a scientific assessment.

Top comments (0)