research-article

Comparison of Free and Open Source WCAG Accessibility Evaluation Tools

Authors:

Fatima Ezzahra Chadli,

Aniss MoumenAuthors Info & Claims

NISS '23: Proceedings of the 6th International Conference on Networking, Intelligent Systems & Security

Article No.: 2, Pages 1 - 6

https://doi.org/10.1145/3607720.3607722

Published: 13 November 2023 Publication History

Abstract

Access to the internet is essential to any individual, including people with disabilities that encounter many challenges and obstacles while browsing the Web. To tackle those problems, the Web Accessibility Initiative (WAI) [1], since its creation in 1997, has worked on improving accessibility of the Web for people with disabilities by providing guidelines (WCAG) and tools for Web Accessibility Assessments. This study aims to compare free and open-source tools from the official (W3C) list of WAETs for evaluating websites against the Web Content Accessibility Guidelines (WCAG) 2.1 standards [2]; the comparison is based on the coverage error ratio (CER) metric that compares the performance of WAETs in identifying Web accessibility problems.

References

[1]

Web Accessibility Initiative (WAI). Retrieved from https://www.w3.org/WAI/about/#world-wide-web-consortium-w3c-web-accessibility-initiative-wai

[2]

Web Content Accessibility Guidelines (WCAG) 2.1. Retrieved from https://www.w3.org/TR/WCAG21/

[3]

The World Wide Web Consortium (W3C). Retrieved from https://www.w3.org/Consortium/

[4]

W3C Selecting Tools for Evaluation. Retrieved from https://www.w3.org/WAI/ER/tools/

[5]

Fatima Ezzahra Chadli, Driss Gretete, and Aniss Moumen, ‘Digital accessibility: A Systematic Literature Review’, SHS Web of Conferences, vol. 119, 2021.

[6]

Shadi Abou-Zahra (2008) Web accessibility evaluation. In: Harper S, Yesilada Y (eds) Web accessibility: a foundation for research. Springer, London, pp79–106

[7]

Giorgio Brajnik. 2008. A comparative test of web accessibility evaluation methods. In Proceedings of the 10th international ACM SIGACCESS

Digital Library

[8]

conference on Computers and Accessibility. 113–120.

[9]

Almendra Nuñez, Arturo Moquillaza and Freddy Paz, "Web accessibility evaluation methods: A systematic review", Design User Experience and Usability Practice and Case Studies, pp. 226-237, 2019.

Digital Library

[10]

Milton Campoverde-Molina, Sergio Lujan-Mora and Lorenc Valverde Garcia: Empirical studies on web accessibility of educational websites: a systematic literature review. IEEE Access 8, 91676–91700 (2020)

[11]

Giorgio Brajnik and Markel Vigo. 2019. Automatic web accessibility metrics. Where We Were and Where We Went. (Springer, Ed.) Web Accessibility, 505–521.

[12]

Beatriz Martins and Carlos Duarte. Large-scale study of web accessibility metrics. Univ Access Inf Soc (2022). https://doi.org/10.1007/s10209-022-00956-x.

Digital Library

[13]

Terry Sullivan and Rebecca Matson: Barriers to use: Usability and content accessibility on the web's most popular sites. In: Proceedings of the 2000 Conference on Universal Usability. CUU ’00, pp. 139–144. Association for Computing Machinery, New York, NY, USA (2000). https://doi.org/10.1145/355460.355549

Digital Library

[14]

Eric Velleman, Christophe Strobbe, Johannes Koch, Velasco, C.A., Snaprud, M. (2007). A Unified Web Evaluation Methodology Using WCAG. In: Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Applications and Services. UAHCI 2007. Lecture Notes in Computer Science, vol 4556. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73283-9_21

[15]

Stephanie Hackett, Bambang Parmanto, Xiaoming Zeng: Accessibility of internet websites through time. In: Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility. Assets ’04, pp. 32–39. Association for Computing Machinery, New York, NY, USA (2003). https://doi.org/10.1145/1028630.1028638

Digital Library

[16]

Bambang Parmanto, Xiaoming Zeng: Metric for web accessibility evaluation. J. Am. Soc. Inform. Sci. Technol. 56(13), 1394–1404 (2005)

Digital Library

[17]

John Bailey and Elizabeth Burd: Tree-map visualisation for web accessibility. In: 29th Annual International Computer Software and Applications Conference (COMPSAC’05), vol. 1, pp. 275–2802 (2005). https://doi.org/10.1109/COMPSAC.2005.161

Digital Library

[18]

Abdullah Alsaeedi: Comparing web accessibility evaluation tools and evaluating the accessibility of webpages: proposed frameworks. Inf. (Switzerland) 11(1), 1–21 (2020)

[19]

Website Accessibility Conformance Evaluation Methodology [WCAG-EM]. Retrieved from

[20]

https://www.w3.org/WAI/test-evaluate/conformance/wcag-em/

[21]

WAVE by WebAIM accessibility evaluation tool

[22]

Retrieved from wave.webaim.org/. [Accessed 20 Jan 2023]

[23]

TAW accessibility evaluation tool. Retrieved from https://www.tawdis.net/?lang=en. [Accessed 20 Jan 2023]

[24]

QualWeb by Faculdade de Ci�ncias da Universidade de Lisboa.

[25]

[Internet]. Available from: http://qualweb.di.fc.ul.pt/evaluator/.

[26]

Mauve++ accessibility evaluation tool. Retrieved from

[27]

https://mauve.isti.cnr.it/

[28]

Lera accessibility tool Retrieved from:

[29]

https://chrome.google.com/webstore/detail/lera/neninfnjnhknniefcpognoooalfdaofc

[30]

IBM Accessibility Equal Access Toolkit: Accessibility Checker by IBM. Retrieved from https://www.ibm.com/able/toolkit/

[31]

Free Axe devtool accessibility. Retrieved from

[32]

https://chrome.google.com/webstore/detail/axe-devtools-web- accessib/lhdoppojpmngadmnindnejefpokejbdd

[33]

Bulk accessibility tool. Retrieved from

[34]

https://www.experte.com/accessibility

[35]

Accessible Web Helper accessibility tool. Retrieved from

[36]

https://chrome.google.com/webstore/detail/accessible-web- helper/gdnpkbipbholkoaggmlblpbmgemddbgb

[37]

Accessibility Insights for Web by Microsoft. Retrieved from https://accessibilityinsights.io/.

[38]

Marian PADURE and Costin PRIBEANU, 2020. "Comparing Six Free Accessibility Evaluation Tools," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 24(1), pages 15-25.

[39]

Rita Ismailova and Yavuz Inal, "Comparison of Online Accessibility Evaluation Tools: An Analysis of Tool Effectiveness," in IEEE Access, vol. 10, pp. 58233-58239, 2022.

[40]

Patricia Acosta-Vargas, Sergio Luj�n-Mora,Tania Acosta, Salvador-Ullauri, L. (2018). Toward a Combined Method for Evaluation of Web Accessibility. In: Rocha, �., Guarda, T. (eds) Proceedings of the International Conference on Information Technology & Systems (ICITS 2018). ICITS 2018. Advances in Intelligent Systems and Computing, vol 721. Springer, Cham. https://doi.org/10.1007/978-3-319-73450-7_57

[41]

Sergio Luj�n-Mora and Firas Masri. "Evaluation of web accessibility: A combined method."�Information Systems Research and Exploring Social Artifacts: Approaches and Methodologies. IGI Global, 2013. 314-331

Cited By

Herrera Mendoza MChanch� Golondrino GPuello Marrugo P(2024)An�lisis de accesibilidad y visibilidad para los portales acad�micos de las universidades de CartagenaSuma de Negocios10.14349/sumneg/2024.V15.N32.A415:32(29-38)Online publication date: Feb-2024
https://doi.org/10.14349/sumneg/2024.V15.N32.A4

Index Terms

Comparison of Free and Open Source WCAG Accessibility Evaluation Tools

Index terms have been assigned to the content through auto-classification.

Recommendations

Migrating from WCAG 1.0 to WCAG 2.0 - A comparative study based on Web Content Accessibility Guidelines in Taiwan

The primary purpose of this research was to explore a comparative analysis of the ''Web Content Accessibility Guidelines (WCAG)'' standard in Taiwan and the international WCAG standards (WCAG 1.0/WCAG 2.0). The WCAG in Taiwan was established by the ...
Web accessibility evaluation of top-ranking university Web sites in Spain, Chile and Mexico
Abstract
The purpose of this study is to evaluate the web accessibility of home pages of universities in Spain, Chile and Mexico. The sample used in this study was the 15 top universities listed in the ranking Webometrics. The study has been carried out ...
Accessibility evaluation of Arabic University websites for compliance with success criteria of WCAG 1.0 and WCAG 2.0
Abstract
Content and services provided by a website should be accessible equally by all users including people with disabilities. Saudi Arabian universities are gradually shifting from traditional classroom teaching to online web-based teaching with the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NISS '23: Proceedings of the 6th International Conference on Networking, Intelligent Systems & Security

May 2023

451 pages

ISBN:9798400700194

DOI:10.1145/3607720

Copyright � 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

NISS 2023

NISS 2023: The 6th International Conference on Networking, Intelligent Systems & Security

May 24 - 26, 2023

Larache, Morocco

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
95
Total Downloads

Downloads (Last 12 months)95
Downloads (Last 6 weeks)8

Reflects downloads up to 19 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Herrera Mendoza MChanch� Golondrino GPuello Marrugo P(2024)An�lisis de accesibilidad y visibilidad para los portales acad�micos de las universidades de CartagenaSuma de Negocios10.14349/sumneg/2024.V15.N32.A415:32(29-38)Online publication date: Feb-2024
https://doi.org/10.14349/sumneg/2024.V15.N32.A4

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents