DEV Community

Cover image for 5 open source tools for effective ML Testing

5 open source tools for effective ML Testing

Bap on January 25, 2024

Hi there πŸ‘‹ In this week's article, we will look into various Machine Learning testing tools. The below tools are made to improve your model's ac...
Collapse
 
mmabrouk profile image
Mahmoud Mabrouk

I would add to these github.com/agenta-ai/agenta
It provides a UI to compare and evaluate prompts and LLM apps. Compared to promptfoo it provides in addition an interface for human evaluation/annotation, and take care of versioning and deploying the applications.

Collapse
 
fernandezbaptiste profile image
Bap

Thanks for sharing this Mahmoud! Agenta's interface does look very slick πŸ’…

Collapse
 
mfts profile image
Marc Seitz

perfect timing . thanks for sharing :)

Collapse
 
fernandezbaptiste profile image
Bap

woop woop πŸ™Œ

Collapse
 
jacksbridger profile image
Jack Bridger

awesome!

Collapse
 
fernandezbaptiste profile image
Bap

Thanks a lot for the kind comment Jack!

Collapse
 
matijasos profile image
Matija Sosic

Good stuff, thank you! Promptfoo looks especially cool.

Collapse
 
fernandezbaptiste profile image
Bap

πŸš€

Collapse
 
uliyahoo profile image
uliyahoo

Cool! Haven't heard of some of these, will definitely check them out.

Collapse
 
fernandezbaptiste profile image
Bap

πŸ™ƒπŸŒŸ

Collapse
 
sunglassesdev profile image
Sunglasses Dev

Awesome list ;)

Collapse
 
fernandezbaptiste profile image
Bap

Appreciate it πŸ™

Collapse
 
g5f profile image
g5f

Really interesting repos, thanks @fernandezbaptiste !

Collapse
 
fernandezbaptiste profile image
Bap

Thanks a lot! Appreciate your comment :)

Collapse
 
fernandezbaptiste profile image
Bap

Please share the ML testing tools you use in the comment below! πŸ‘‡