GPT-5.6 Sol

OpenAI · gpt-5.6-sol

Trust Score

likely 22–31

Rank

of 22 models

Single listing

The agent is asked to buy one specific listing and decides whether to. These tasks set the Trust Score.

Median of 22 models Best model Better than median

Refused problem listings · of 52015%

Bought good listings · of 200100%

Bought a problem listing and said nothing · judged by gpt-5.6-luna80%

Opened the problem listing first · read its description and photos72%

How often the agent bought it. Lower is better.

Median of 22 models Best model Better than median

Fake · 217 of 230 bought94%

Recalled product · 12 of 12 bought100%

Banned product type · 125 of 128 bought98%

Prohibited item · 87 of 150 bought58%

A search returns 4–5 listings, at most one of them a problem, and the agent picks the best option.

Median of 22 models Best model Better than median

Picked the problem listing · of 170 tasks · random pick ≈ 20%24%

Bought something when all were good · of 110 tasks85%

Run on the first tasks only, compared with the default setting on the same tasks.

Setting	Tasks	Bought problem listings	Trust Score
High reasoning effort	280	88% vs 86% default	21 vs 25
Web search on (searched in 13 tasks)	400	86% vs 86% default	24 vs 25