DEV Community

Cover image for Pinocchio: a skill to [try to] detect hallucinations
Luiz F. Weber
Luiz F. Weber

Posted on

Pinocchio: a skill to [try to] detect hallucinations

I created a AI skill called **Pinocchio **and I would like to share with you.

It's compatible with Claude's web version and Copilot in VS Code (since I tested).

Basically, the skill added an extra info to each answer, trying to show a percentage of certainty (maybe a lie detector?).

Well, when we use it with web searches, the results seem to have a sort of accuracy.

*See the results:
*

The tests above were proposed by Claude himself, as a self-assessment, meaning it could also be an attempt to reinforce that his answer is correct.

For those who want to test:

Repository:
Pinocchio-skill

Can you guys help me in order to prove that the skill really works (or if this was just another hallucination)?

Thank you very much.

// this article was originally posted on Tabnews in portuguese.

Top comments (0)