Social Choice Quiz Results

Dominik Peters, February 2026

Note: The models were given all 25 questions in a single prompt and asked to answer all questions. Thus, this also tests stamina and not getting confused between questions. Where possible, I deactivated web access. Grok ran many web searches.

ModelScore
gemini-3-1-pro-preview.txt20/25
gemini-3-flash-attempt2.txt17/25
gemini-3-flash.txt16/25
claude-sonnet-4-6.txt12/25
gemini-3-pro-preview.txt12/25
gpt-5-1-thinking-extended.txt12/25
gpt-5-2-thinking-extended.txt12/25
grok.txt8/25
o3.txt8/25
mistral.txt6/25
claude-haiku-4-5.txt5/25

Question 1: Which of the following properties does the Borda count satisfy?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 2: Suppose I only have access to voter preferences via an oracle that tells me, given a voter and a subset of alternatives, which alternative in the subset is the most preferred by the voter. To find a winner according to Install-runoff voting, how many queries to the oracle do I need in the worst case?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 3: Which of the following properties does the Method of Equal Shares satisfy in the context of approval-based committee selection?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 4: Which of the following properties is compatible with Condorcet consistency, in the context of resolute social choice functions?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 5: Which of the following voting rules satisfies independence of clones?

ModelABCDEF
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 6: Which of the following voting rules satisfies participation?

ModelABCDEF
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 7: Which of the following properties does Proportional Approval Voting (PAV) satisfy in the context of approval-based committee selection?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 8: Which of the following properties does the Max Nash Welfare (MNW) rule satisfy in the context of allocation of indivisible goods with additive utilities?

ModelABCDEF
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 9: Which of the following properties does the leximin rule satisfy in the context of allocation of indivisible goods with additive utilities?

ModelABCDEF
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 10: Does the Borda count satisfy the majority criterion?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 11: Consider the domain of single-peaked preferences with an odd number of voters. Which of the following statements is true?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 12: Suppose there are exactly three candidates and voters have linear order preferences. Which of the following statements is true?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 13: Suppose there are exactly two candidates, voters have linear order preferences, and the number of voters is odd. Which of the following statements is true?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 14: Which of the following rules satisfy both Justified Representation (JR) and committee monotonicity in the context of approval-based committee selection?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 15: Which of the following rules satisfy the Condorcet loser criterion?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 16: Which of the following properties of a social choice function are preserved under refinement, i.e., if a social choice function f satisfies a property P, then every refinement of f also satisfies P?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 17: Consider social choice functions with linear order preferences. Suppose that the number of voters is strictly smaller than the number of candidates. Which of the following statements is true in this case?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 18: Consider the allocation of indivisible goods with submodular utilities. Which of the following methods satisfy envy-freeness up to one good (EF1)?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 19: Consider the allocation of indivisible goods with additive utilities. Which of the following statements is true?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 20: Which of the following properties does the Borda count satisfy?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 21: Suppose there are m alternatives that are ordered on a left-to-right axis. How many different linear orders are single-peaked with respect to this axis?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 22: Suppose there are exactly 4 alternatives. What is the minimum number of voters with linear order preferences such that there exists a profile with no Condorcet winner?

ModelABCD
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 23: Which of the following apportionment methods satisfies lower quota?

ModelABCDEF
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 24: Which of the following apportionment methods satisfies house monotonicity?

ModelABCDF
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt

Question 25: Which of the following statements about apportionment methods is true?

ModelABCDE
Correct
claude-haiku-4-5.txt
claude-sonnet-4-6.txt
gemini-3-1-pro-preview.txt
gemini-3-flash-attempt2.txt
gemini-3-flash.txt
gemini-3-pro-preview.txt
gpt-5-1-thinking-extended.txt
gpt-5-2-thinking-extended.txt
grok.txt
mistral.txt
o3.txt