Make the Model Show Its Work

Don't just ask for the answer.
Ask how it got there.

A model will hand you a conclusion
with total confidence
and no receipts.

The confidence is free.
The reasoning is what you're checking.

"Walk me through why."
"What did you assume?"
"What would make this wrong?"

Half the time, watching it reason
is how you catch the answer
that was fluent and false.

The other half, you learn something —
because a visible argument
is one you can actually judge.

An answer you can't inspect
is a coin flip in a nice font.

Make it show the work.

– Serguey Asael Shinder