Dimension		Competitor 1	Competitor 2	Competitor 3	Competitor 4
Factual accuracy	991st	991st	983rd	983rd	935th
Relevance to your document	991st	933rd	784th	991st	335th
Easy to understand	941st	922nd	855th	884th	893rd
Plausible wrong answer choices	691st	553rd	534th	285th	562nd

Factual accuracy

991st

Competitor 1

991st

Competitor 2

983rd

Competitor 3

983rd

Competitor 4

935th

Relevance to your document

991st

Competitor 1

933rd

Competitor 2

784th

Competitor 3

991st

Competitor 4

335th

Plausible wrong answer choices

691st

Competitor 1

553rd

Competitor 2

534th

Competitor 3

285th

Competitor 4

562nd

In random order, the listed competitors are Quizlet, Turbo, Gizmo, and Studyfetch.

Scores collected by having each platform generate questions on the same 3 documents, anonymizing which platform the question came from, and then scoring the questions through a question quality LLM judge. As you can see, the hardest part is making the wrong answer choices good enough to be believable.