The people who do the work write the test.

Labs test their models on puzzles a machine can mark. That's why AI keeps getting better at maths and worse at the things only people can judge.

Give the guild a task from your real work: something you do every week, and know how to do well. Every model in the lineup answers it, practitioners grade the answers blind, and your task goes on the public ledger in your name.