DEV Community

Cover image for 5 open source tools for effective ML Testing

5 open source tools for effective ML Testing

Bap on January 25, 2024

Hi there 👋 In this week's article, we will look into various Machine Learning testing tools. The below tools are made to improve your model's ac...
Collapse
 
mmabrouk profile image
Mahmoud Mabrouk

I would add to these github.com/agenta-ai/agenta
It provides a UI to compare and evaluate prompts and LLM apps. Compared to promptfoo it provides in addition an interface for human evaluation/annotation, and take care of versioning and deploying the applications.

Collapse
 
fernandezbaptiste profile image
Bap

Thanks for sharing this Mahmoud! Agenta's interface does look very slick 💅

Collapse
 
g5f profile image
g5f

Really interesting repos, thanks @fernandezbaptiste !

Collapse
 
fernandezbaptiste profile image
Bap

Thanks a lot! Appreciate your comment :)

Collapse
 
uliyahoo profile image
uliyahoo

Cool! Haven't heard of some of these, will definitely check them out.

Collapse
 
fernandezbaptiste profile image
Bap

🙃🌟

Collapse
 
matijasos profile image
Matija Sosic

Good stuff, thank you! Promptfoo looks especially cool.

Collapse
 
fernandezbaptiste profile image
Bap

🚀

Collapse
 
jacksbridger profile image
Jack Bridger

awesome!

Collapse
 
fernandezbaptiste profile image
Bap

Thanks a lot for the kind comment Jack!

Collapse
 
mfts profile image
Marc Seitz

perfect timing . thanks for sharing :)

Collapse
 
fernandezbaptiste profile image
Bap

woop woop 🙌

Collapse
 
sunglassesdev profile image
Sunglasses Dev

Awesome list ;)

Collapse
 
fernandezbaptiste profile image
Bap

Appreciate it 🙏

Collapse
 
fernandezbaptiste profile image
Bap

Please share the ML testing tools you use in the comment below! 👇