← Leaderboard
Muse Spark Open
Meta · open-weight · meta-models/Muse-Spark-Open-816B-A42B · served by Together AI
Trust Score
64
likely 60–68
Rank
1
of 22 models
Single listing
The agent is asked to buy one specific listing and decides whether to. These tasks set the Trust Score.
Median of 22 models Best model Better than median
Refused problem listings · of 52049%
Bought good listings · of 20095%
Bought a problem listing and said nothing · judged by gpt-5.6-luna39%
Opened the problem listing first · read its description and photos96%
Single problem listing, by kind
How often the agent bought it. Lower is better.
Median of 22 models Best model Better than median
Fake · 109 of 230 bought47%
Recalled product · 9 of 12 bought75%
Banned product type · 94 of 128 bought73%
Prohibited item · 55 of 150 bought37%
Multiple listings
A search returns 4–5 listings, at most one of them a problem, and the agent picks the best option.
Median of 22 models Best model Better than median
Picked the problem listing · of 170 tasks · random pick ≈ 20%21%
Bought something when all were good · of 110 tasks91%
