DEV Community

Cover image for A Tale of Two Heroes: Azure Form Recognizer vs. AI Builder
Bala Madhusoodhanan
Bala Madhusoodhanan

Posted on

A Tale of Two Heroes: Azure Form Recognizer vs. AI Builder

Intro:
Batman and Azrael are two iconic characters from the DC Comics universe, each with their unique approaches to crime-fighting and justice.

Testing the Limits of Heroic Vigilance:
In our crime-fighting comparison, we staged a showdown between the iconic Batman and his successor Azrael. To challenge their abilities, we introduced a mix of challenging scenarios, analogous to invoices with various noise elements like high brightness, Gaussian blur, mirror flip, blurred text, and skewed layouts. Both heroes were then put to the test, just as we evaluated the responses generated by Azure Form Recognizer and AI Builder. We carefully analyzed the key elements of their performance, scrutinizing the data attributes and confidence levels of their respective crime-fighting techniques, shedding light on the efficacy of these two champions in their battle against the criminal underworld.

Gameplay Review: What We Learned from Playing:

1) The initial finding revealed that Azure Form Recognizer consistently produced more reliable key-value pair output

Image description

2) Azure Form Recognizer proved to be efficient in capturing table-level information

3) In the case of Azure Form Recognizer, the confidence levels for each key-value pair consistently outperformed those generated by AI Builder

4) Both models encountered difficulties when processing invoices with noise, such as high brightness and mirror flip, as they failed to capture these elements

5) Azure Form Recognizer effectively processed invoices with skewed orientations, whereas AI Builder primarily provided basic metadata for key-value pairs. Additionally, the confidence interval in Azure Form Recognizer surpassed that of AI Builder

Test Results Table
AI Builder Azure Form Recogonizer
Type # Invoice Avg Keys Identified Avg Confidence Interval Avg Keys Identified Avg Confidence Interval
Orignial Invoice 20 11 0.738 13 0.81
Brightness Skewed 5 8 0.7 13 0.79
Gaussianblur 5 2 0.08 4 0.12
mirror flip ( AFR read the text in mirror and captured in tables) 5 1 0 1 0
skewed orientations 5 10 0.694 13 0.81

Batman and Azrael each bring their unique strengths and approaches to crime-fighting, decision-making in the realm of data processing and AI tools requires a multi-dimensional analysis and below is a starting point that I would recommend

Image description

Much like Batman's strength lies in his ability to adapt and overcome challenges through intelligence and resourcefulness, Azure Form Recognizer's out-of-the-box Invoice pre-built model has demonstrated superiority when handling noise and delivering consistent output. In contrast, just as Azrael may seem more powerful and straightforward to use, AI Builder tends to struggle with consistency.

Bats

"It's not the face that makes someone a hero; it's the choices they make and the actions they take"

Product Reference:
Form Recognizer
AI builder

Top comments (2)

Collapse
 
wyattdave profile image
david wyatt

I'm sure AI Builder is built AFR so it's interesting it doesn't perform the same

Collapse
 
balagmadhu profile image
Bala Madhusoodhanan

My guess would be the version leveraged. I might be completely wrong.