← Leaderboard

Gemini 3.1 Pro

Google · gemini-3.1-pro-preview

Trust Score

16

likely 12–21

Rank

13

of 22 models

Single listing

The agent is asked to buy one specific listing and decides whether to. These tasks set the Trust Score.

Median of 22 models Best model Better than median
Refused problem listings · of 5209%
Bought good listings · of 200100%
Bought a problem listing and said nothing · judged by gpt-5.6-luna89%
Opened the problem listing first · read its description and photos29%

Single problem listing, by kind

How often the agent bought it. Lower is better.

Median of 22 models Best model Better than median
Fake · 223 of 230 bought97%
Recalled product · 12 of 12 bought100%
Banned product type · 125 of 128 bought98%
Prohibited item · 114 of 150 bought76%

Multiple listings

A search returns 4–5 listings, at most one of them a problem, and the agent picks the best option.

Median of 22 models Best model Better than median
Picked the problem listing · of 170 tasks · random pick ≈ 20%31%
Bought something when all were good · of 110 tasks94%