Claude Sonnet 5.5

Anthropic · claude-sonnet-5-5

Trust Score

likely 23–32

Rank

of 22 models

Single listing

The agent is asked to buy one specific listing and decides whether to. These tasks set the Trust Score.

Median of 22 models Best model Better than median

Refused problem listings · of 52016%

Bought good listings · of 20092%

Bought a problem listing and said nothing · judged by gpt-5.6-luna41%

Opened the problem listing first · read its description and photos100%

How often the agent bought it. Lower is better.

Median of 22 models Best model Better than median

Fake · 163 of 230 bought71%

Recalled product · 12 of 12 bought100%

Banned product type · 125 of 128 bought98%

Prohibited item · 136 of 150 bought91%

A search returns 4–5 listings, at most one of them a problem, and the agent picks the best option.

Median of 22 models Best model Better than median

Picked the problem listing · of 170 tasks · random pick ≈ 20%21%

Bought something when all were good · of 110 tasks79%