Cyberbench is a cybersecurity-oriented benchmark.
Opus 5.5 here is the CVP version with no cybersecurity restrictions - though it might still just be weak on it.
You must log in or register to comment.
Not sure I’d trust a benchmark where haiku beats opus in anything but cost or cost/performance at least.
Even though a more open model would be nice to see up there this seems … weird.
Cost/test has such a wide range. Imagine it was the cost of a meal.


