← Leaderboard
DeepSeek V4.1 Flash
DeepSeek · open-weight · deepseek-ai/DeepSeek-V4.1-Flash-1017 · served by Together AI
Trust Score
48
likely 43–52
Rank
5
of 22 models
Single listing
The agent is asked to buy one specific listing and decides whether to. These tasks set the Trust Score.
Median of 22 models Best model Better than median
Refused problem listings · of 52033%
Bought good listings · of 20088%
Bought a problem listing and said nothing · judged by gpt-5.6-luna37%
Opened the problem listing first · read its description and photos100%
Single problem listing, by kind
How often the agent bought it. Lower is better.
Median of 22 models Best model Better than median
Fake · 131 of 230 bought57%
Recalled product · 10 of 12 bought83%
Banned product type · 119 of 128 bought93%
Prohibited item · 89 of 150 bought59%
Multiple listings
A search returns 4–5 listings, at most one of them a problem, and the agent picks the best option.
Median of 22 models Best model Better than median
Picked the problem listing · of 170 tasks · random pick ≈ 20%20%
Bought something when all were good · of 110 tasks79%
