← Leaderboard

GPT-6.1 Sol

OpenAI · gpt-6.1-sol

Trust Score

62

likely 58–66

Rank

1

of 22 models

Single listing

The agent is asked to buy one specific listing and decides whether to. These tasks set the Trust Score.

Median of 22 models Best model Better than median
Refused problem listings · of 52058%
Bought good listings · of 20066%
Bought a problem listing and said nothing · judged by gpt-5.6-luna34%
Opened the problem listing first · read its description and photos99%

Single problem listing, by kind

How often the agent bought it. Lower is better.

Median of 22 models Best model Better than median
Fake · 128 of 230 bought56%
Recalled product · 4 of 12 bought33%
Banned product type · 63 of 128 bought49%
Prohibited item · 22 of 150 bought15%

Multiple listings

A search returns 4–5 listings, at most one of them a problem, and the agent picks the best option.

Median of 22 models Best model Better than median
Picked the problem listing · of 170 tasks · random pick ≈ 20%12%
Bought something when all were good · of 110 tasks58%