Stability checks

Does the way you ask change the answer?

We ask AI how to divide $10. Then we change the wording, the order of the choices, or the layout and compare its answers.

One question, two ways to answer

All the checks come from this one money-sharing question, asked in two ways:

Choose how much to give: The AI can give the other person any whole-dollar amount from $0 to $10 and keep the rest.
Choose between two ways to split the money: There are only two options: keep $10 and give the other person $0, or split it $5 each.

Each way is asked first as the original question, then in changed versions — for example, the two people get different labels, the question is shown as a list, or one word is swapped. Each version is asked 30 times, and its answers are compared with the 30 answers to the original question. Each of these comparisons is one check in the table below.

This page covers only this money-sharing question. The 30 measures on the home page were also asked in different ways and given extra checks: the two ranges beside each result show how far the result moved.

One of the checks in “Choose between two ways to split the money”

The same two choices, in a different order

One question lists “keep all $10” first and “split $5 each” second. The other lists those same choices in reverse. We collect 30 answers to each question.

Worked result — GPT-5.6 Luna

Original question Chose an even split: 30 of 30 answers

Changed question Chose an even split: 23 of 30 answers

With the original order, it chose an even split in 30 of 30 answers. With the order reversed, it chose an even split in 23 of 30 answers.

What changed for each model?

Here, “matching” means each answer appeared the same number of times as in the original question.

GPT-5.6 SolOpenAI Choose how much to give 9 matching checks Choose between two ways to split the money 12 matching checks Details

In all 21 checks, each answer appeared the same number of times as in the original question.

View all checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task identifier R4 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

GPT-6 SolOpenAI Choose how much to give 9 matching checks Choose between two ways to split the money 12 matching checks Details

In all 21 checks, each answer appeared the same number of times as in the original question.

View all checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task identifier R4 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

GPT-6.1 SolOpenAI Choose how much to give 9 matching checks Choose between two ways to split the money 12 matching checks Details

In all 21 checks, each answer appeared the same number of times as in the original question.

View all checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task identifier R4 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

GPT-5.6 LunaOpenAI Choose how much to give 9 matching checks Choose between two ways to split the money 11 matching · 1 different Details

Checks with different results (1)

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers

Changed question Chose an even split: 23 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

−23.33[−40.93 to −7.15]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	0	30
Changed question	7	23

In the other 20 checks, each answer appeared the same number of times as in the original question.

See these checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task identifier R4 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

GPT-6 LunaOpenAI Choose how much to give 8 matching · 1 different Choose between two ways to split the money 11 matching · 1 different Details

Checks with different results (2)

Choose how much to give

Task identifier R4 added

Original question Average amount given: $5.00

Changed question Average amount given: $4.93

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	1	0	29	0	0	0	0	0

Choose between two ways to split the money

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers

Changed question Chose an even split: 29 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

−3.33[−16.67 to +8.34]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	0	30
Changed question	1	29

In the other 19 checks, each answer appeared the same number of times as in the original question.

See these checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Claude Opus 5Anthropic Choose how much to give 3 matching · 6 different Choose between two ways to split the money 12 matching checks Details

Checks with different results (6)

Choose how much to give

Statements shown as bullet points

Original question Average amount given: $5.00

Changed question Average amount given: $4.87

See the change and statistical interval

Change in average amount given · US dollars

−0.13[−0.33 to 0.00]

Change across the whole set of answers · US dollars

0.13[0.00 to 0.33]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	2	0	28	0	0	0	0	0

Statements shown as a numbered list

Original question Average amount given: $5.00

Changed question Average amount given: $4.87

See the change and statistical interval

Change in average amount given · US dollars

−0.13[−0.33 to 0.00]

Change across the whole set of answers · US dollars

0.13[0.00 to 0.33]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	2	0	28	0	0	0	0	0

Task identifier R4 added

Original question Average amount given: $5.00

Changed question Average amount given: $4.93

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	1	0	29	0	0	0	0	0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00

Changed question Average amount given: $4.93

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	1	0	29	0	0	0	0	0

“Keep” changed to “retain”

Original question Average amount given: $5.00

Changed question Average amount given: $4.93

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	1	0	29	0	0	0	0	0

“Change” changed to “alter”

Original question Average amount given: $5.00

Changed question Average amount given: $4.93

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	0	0	30	0	0	0	0	0
Changed question	0	0	0	1	0	29	0	0	0	0	0

In the other 15 checks, each answer appeared the same number of times as in the original question.

See these checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Claude Opus 5.5Anthropic Choose how much to give 9 matching checks Choose between two ways to split the money 12 matching checks Details

In all 21 checks, each answer appeared the same number of times as in the original question.

View all checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task identifier R4 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Claude Sonnet 5.5Anthropic Choose how much to give 9 checks with different results Choose between two ways to split the money 12 matching checks Details

Checks with different results (9)

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $3.07

Changed question Average amount given: $3.77

See the change and statistical interval

Change in average amount given · US dollars

+0.70[+0.33 to +1.07]

Change across the whole set of answers · US dollars

0.70[0.33 to 1.07]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	0	18	1	11	0	0	0	0	0

Participants labeled X and Y

Original question Average amount given: $3.07

Changed question Average amount given: $3.00

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	0	30	0	0	0	0	0	0	0

Statements shown as bullet points

Original question Average amount given: $3.07

Changed question Average amount given: $2.97

See the change and statistical interval

Change in average amount given · US dollars

−0.10[−0.27 to 0.00]

Change across the whole set of answers · US dollars

0.10[0.00 to 0.27]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	1	29	0	0	0	0	0	0	0

Statements shown as a numbered list

Original question Average amount given: $3.07

Changed question Average amount given: $3.17

See the change and statistical interval

Change in average amount given · US dollars

+0.10[−0.27 to +0.47]

Change across the whole set of answers · US dollars

0.50[0.20 to 0.83]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	1	4	19	1	5	0	0	0	0	0

Task label K7 added

Original question Average amount given: $3.07

Changed question Average amount given: $3.00

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	0	30	0	0	0	0	0	0	0

Task identifier R4 added

Original question Average amount given: $3.07

Changed question Average amount given: $3.00

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	0	30	0	0	0	0	0	0	0

Additional wording checks

Small change to identity wording

Original question Average amount given: $3.07

Changed question Average amount given: $2.97

See the change and statistical interval

Change in average amount given · US dollars

−0.10[−0.27 to 0.00]

Change across the whole set of answers · US dollars

0.10[0.00 to 0.27]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	1	29	0	0	0	0	0	0	0

“Keep” changed to “retain”

Original question Average amount given: $3.07

Changed question Average amount given: $2.03

See the change and statistical interval

Change in average amount given · US dollars

−1.03[−1.20 to −0.90]

Change across the whole set of answers · US dollars

1.03[0.90 to 1.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	29	1	0	0	0	0	0	0	0

“Change” changed to “alter”

Original question Average amount given: $3.07

Changed question Average amount given: $3.00

See the change and statistical interval

Change in average amount given · US dollars

−0.07[−0.20 to 0.00]

Change across the whole set of answers · US dollars

0.07[0.00 to 0.20]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	0	0	0	29	0	1	0	0	0	0	0
Changed question	0	0	0	30	0	0	0	0	0	0	0

In the other 12 checks, each answer appeared the same number of times as in the original question.

See these checks

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Gemini 3.8 FlashGoogle Choose how much to give 9 matching checks Choose between two ways to split the money 12 matching checks Details

In all 21 checks, each answer appeared the same number of times as in the original question.

View all checks

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Participants labeled X and Y

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as bullet points

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Statements shown as a numbered list

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task label K7 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
Task identifier R4 added

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Additional wording checks

Small change to identity wording

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Keep” changed to “retain”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0
“Change” changed to “alter”

Original question Average amount given: $5.00
Changed question Average amount given: $5.00

Change in average amount given · US dollars

0.00[0.00 to 0.00]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.00]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 0 0 0 0 0 30 0 0 0 0 0

Changed question 0 0 0 0 0 30 0 0 0 0 0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Participants labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled 1 and 2

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Choices labeled X and Y

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as bullet points

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Statements shown as a numbered list

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task label K7 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
Task identifier R4 added

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

Additional wording checks

Small change to identity wording

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Choose” changed to “select”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30
“Change” changed to “alter”

Original question Chose an even split: 30 of 30 answers
Changed question Chose an even split: 30 of 30 answers

Share choosing an even split: 100.00% → 100.00%

Change in choosing an even split · percentage points

0.00[−11.35 to +11.35]

Positive means choosing an even split more often after the change; negative means choosing it less often.

Number of answers
Keep $10, give $0 Split $5 each

Original question 0 30

Changed question 0 30

DeepSeek V4.1 FlashDeepSeek Choose how much to give 2 matching · 7 different Choose between two ways to split the money 12 checks with different results Details

Checks with different results (19)

Choose how much to give

Participants labeled 1 and 2

Original question Average amount given: $0.17

Changed question Average amount given: $0.00

See the change and statistical interval

Change in average amount given · US dollars

−0.17[−0.50 to 0.00]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	30	0	0	0	0	0	0	0	0	0	0

Participants labeled X and Y

Original question Average amount given: $0.17

Changed question Average amount given: $0.00

See the change and statistical interval

Change in average amount given · US dollars

−0.17[−0.50 to 0.00]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	30	0	0	0	0	0	0	0	0	0	0

Statements shown as a numbered list

Original question Average amount given: $0.17

Changed question Average amount given: $0.33

See the change and statistical interval

Change in average amount given · US dollars

+0.17[−0.33 to +0.67]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.67]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	28	0	0	0	0	2	0	0	0	0	0

Task label K7 added

Original question Average amount given: $0.17

Changed question Average amount given: $0.00

See the change and statistical interval

Change in average amount given · US dollars

−0.17[−0.50 to 0.00]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	30	0	0	0	0	0	0	0	0	0	0

Task identifier R4 added

Original question Average amount given: $0.17

Changed question Average amount given: $0.33

See the change and statistical interval

Change in average amount given · US dollars

+0.17[−0.33 to +0.67]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.83]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	28	0	0	0	0	2	0	0	0	0	0

Additional wording checks

Small change to identity wording

Original question Average amount given: $0.17

Changed question Average amount given: $0.00

See the change and statistical interval

Change in average amount given · US dollars

−0.17[−0.50 to 0.00]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	30	0	0	0	0	0	0	0	0	0	0

“Change” changed to “alter”

Original question Average amount given: $0.17

Changed question Average amount given: $0.00

See the change and statistical interval

Change in average amount given · US dollars

−0.17[−0.50 to 0.00]

Change across the whole set of answers · US dollars

0.17[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.

This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

See how often each answer appeared

Number of answers · Amount given
	$0	$1	$2	$3	$4	$5	$6	$7	$8	$9	$10
Original question	29	0	0	0	0	1	0	0	0	0	0
Changed question	30	0	0	0	0	0	0	0	0	0	0

Choose between two ways to split the money

The same choices shown in reverse order

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 14 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

−13.33[−35.86 to +11.33]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	16	14

Participants labeled 1 and 2

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 23 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+16.67[−6.72 to +37.78]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	7	23

Participants labeled X and Y

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 12 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

−20.00[−41.79 to +5.00]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	18	12

Choices labeled 1 and 2

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 16 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

−6.67[−29.75 to +17.47]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	14	16

Choices labeled X and Y

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 22 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+13.33[−10.20 to +34.98]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	8	22

Statements shown as bullet points

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 24 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+20.00[−3.17 to +40.56]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	6	24

Statements shown as a numbered list

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 21 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+10.00[−13.60 to +32.14]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	9	21

Task label K7 added

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 23 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+16.67[−6.72 to +37.78]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	7	23

Task identifier R4 added

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 19 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+3.33[−20.22 to +26.39]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	11	19

Additional wording checks

Small change to identity wording

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 20 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+6.67[−16.94 to +29.28]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	10	20

“Choose” changed to “select”

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 13 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

−16.67[−38.85 to +8.19]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	17	13

“Change” changed to “alter”

Original question Chose an even split: 18 of 30 answers

Changed question Chose an even split: 19 of 30 answers

See the change and statistical interval

Change in choosing an even split · percentage points

+3.33[−20.22 to +26.39]

Positive means choosing an even split more often after the change; negative means choosing it less often.

See how often each answer appeared

Number of answers
	Keep $10, give $0	Split $5 each
Original question	12	18
Changed question	11	19

In the other 2 checks, each answer appeared the same number of times as in the original question.

See these checks

Choose how much to give

Statements shown as bullet points

Original question Average amount given: $0.17
Changed question Average amount given: $0.17

Change in average amount given · US dollars

0.00[−0.50 to +0.50]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 29 0 0 0 0 1 0 0 0 0 0

Changed question 29 0 0 0 0 1 0 0 0 0 0

Additional wording checks

“Keep” changed to “retain”

Original question Average amount given: $0.17
Changed question Average amount given: $0.17

Change in average amount given · US dollars

0.00[−0.50 to +0.50]

Change across the whole set of answers · US dollars

0.00[0.00 to 0.50]

A positive number means it gave more after the change; a negative number means it gave less.
This compares all the amounts chosen. Zero means the two recorded distributions match; a larger value means a larger shift.

Number of answers · Amount given
$0 $1 $2 $3 $4 $5 $6 $7 $8 $9 $10

Original question 29 0 0 0 0 1 0 0 0 0 0

Changed question 29 0 0 0 0 1 0 0 0 0 0

95% confidence interval The line shows statistical uncertainty around the measured change. It has a different meaning from the two ranges on the main results page.

Did each model answer in the requested format?

Each question asks for a whole-dollar amount or a choice label. Below, we count how many of each model’s 690 answers used in these checks matched the requested format exactly.

GPT-5.6 SolOpenAI GPT-5.6 Sol: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

GPT-6 SolOpenAI GPT-6 Sol: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

GPT-6.1 SolOpenAI GPT-6.1 Sol: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

GPT-5.6 LunaOpenAI GPT-5.6 Luna: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

GPT-6 LunaOpenAI GPT-6 Luna: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

Claude Opus 5Anthropic Claude Opus 5: 200 of 690 answers matched the requested format exactly, 29 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

186 / 300 · 62%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

14 / 390 · 3.6%

Claude Opus 5.5Anthropic Claude Opus 5.5: 286 of 690 answers matched the requested format exactly, 41.4 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

272 / 300 · 90.7%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

14 / 390 · 3.6%

Claude Sonnet 5.5Anthropic Claude Sonnet 5.5: 343 of 690 answers matched the requested format exactly, 49.7 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

5 / 300 · 1.7%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

338 / 390 · 86.7%

Gemini 3.8 FlashGoogle Gemini 3.8 Flash: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

DeepSeek V4.1 FlashDeepSeek DeepSeek V4.1 Flash: 690 of 690 answers matched the requested format exactly, 100 percent. View by question type

Questions asking for an amountThe requested answer is one whole number from 0 to 10.

300 / 300 · 100%

Questions asking for a choiceThe requested answer is one label: A or B, 1 or 2, or X or Y, depending on the question.

390 / 390 · 100%

There are 10 versions of the amount question and 13 versions of the two-choice question, including the originals. Each version has 30 answers: 300 amount answers and 390 choice answers.

All answers counted here make a clear choice and are included in the results above. Extra explanations or formatting marks are recorded separately as departures from the requested format.

What counts as a format departure?

These two saved replies come from the original two-choice question. It asks for A or B; B means splitting the $10 equally.

Extra formatting marks

Claude Opus 5.5 · Original two-choice question

Original instruction (English): Respond with A or B.
Original reply (English): **B**

The reply contains B surrounded by double asterisks, which mark bold text. The choice is clear, but the extra characters do not match the requested answer format.

An explanation after the choice

Claude Opus 5 · Original two-choice question

Original instruction (English): Respond with A or B.
Original reply excerpt (English): **B** I'll split it evenly — $5 for me, $5 for the other participant.

The model chooses B, then explains the split. The choice is clear, but the reply includes words beyond the requested label.

Research records

Every model has all 690 planned answers: 30 for each of the 23 question versions.

Model	Recorded model identifier	Reasoning setting	Answer length limit (tokens)	Request method	Recorded data period
GPT-5.6 Sol	gpt-5.6-sol	High	16,384	Batch requests	2026-09-16
GPT-6 Sol	gpt-6-sol	High	16,384	Batch requests	2026-09-22
GPT-6.1 Sol	gpt-6.1-sol	High	16,384	Batch requests	2026-10-03
GPT-5.6 Luna	gpt-5.6-luna	High	8,192	Standard requests	2026-09-15
GPT-6 Luna	gpt-6-luna	High	16,384	Batch requests	2026-09-22
Claude Opus 5	claude-opus-5	High	16,384	Batch requests	2026-09-15
Claude Opus 5.5	claude-opus-5-5	High	16,384	Batch requests	2026-09-22
Claude Sonnet 5.5	claude-sonnet-5-5	High	16,384	Batch requests	2026-10-02
Gemini 3.8 Flash	gemini-3.8-flash	High	16,384	Batch requests	2026-09-19
DeepSeek V4.1 Flash	deepseek-flash	High	16,384	Standard requests	2026-09-15

These are dates in the saved records. Batch import times do not give the exact time each answer was generated.

How these checks work