Great article- i use AxeDevTools IGT+ WAVE + Google Lighthouse accessibility score when app ready post UIT and it helps reducing bugs in UI. Similarly Google Accessibility Scanner for Android apps and Accessibility Inspector of XCode in iOS to catch on native.
True- None of these tools represent 100% of real user with accessibility needs hence using those screen reader for laptops (NVDA,JAWS) and voice over,talk back in mobiles are critical and that helps in finding essential defects which are otherwise unattended by scanners. Example: FBN three finger movements of users in firefox using voice over in mobiles are not covered in any scanners and not discoverable by code audits hence manual test matters a lot
Meanwhile none of the tools ready with WCAG 2.2 new rules (as of 25Feb2022) hence audits are just pre-requisites and not actual tests in my test strategy.
Note on Axe: AxeDevTools IGT got better coverage when comparing with lighthouse but looking forward to see what we have from Axe Auditor and those bundle of new tools from Deque in 2023
Great article- i use AxeDevTools IGT+ WAVE + Google Lighthouse accessibility score when app ready post UIT and it helps reducing bugs in UI. Similarly Google Accessibility Scanner for Android apps and Accessibility Inspector of XCode in iOS to catch on native.
One thing worth to mention is that Google Lighthouse uses Axe, but limited to 25 (if I recall correctly) rules.
True- None of these tools represent 100% of real user with accessibility needs hence using those screen reader for laptops (NVDA,JAWS) and voice over,talk back in mobiles are critical and that helps in finding essential defects which are otherwise unattended by scanners. Example: FBN three finger movements of users in firefox using voice over in mobiles are not covered in any scanners and not discoverable by code audits hence manual test matters a lot
Meanwhile none of the tools ready with WCAG 2.2 new rules (as of 25Feb2022) hence audits are just pre-requisites and not actual tests in my test strategy.
Note on Axe: AxeDevTools IGT got better coverage when comparing with lighthouse but looking forward to see what we have from Axe Auditor and those bundle of new tools from Deque in 2023
Yes, some cases require manual testing. The complete Accessibility audit is a combination of automated + manual testing.
P.S. Great post.