Webmaster Papers








The Problem with Automated Accessibility Testing Tools


An automated accessibility tool is a piece of software which can test a web page, or even an entire website, for accessibility. Automated accessibility tools are useful because they can save you a huge amount of time. Don't want to check images for alt text on each and every page on your website? Run the site through an automated tester and it'll do it all for you!

Automated accessibility testing tools have been around for a long time and have historically been a useful way of checking websites for accessibility. Bobby, one of the first and most well-known automated accessibility testing tools, is now almost 10 years, and although is no longer freely available, plenty of other free tools such as WebXact (http://webxact.watchfire.com/) and Wave (http://wave.webaim.org/index.jsp)do exist.

But are these tools a little too good to be true? Can you test a website for accessibility so easily? Unfortunately the answer is a resounding no. There are a number of underlying problems associated with using just automated tools to test for accessibility:

Literal interpretation of guidelines

Any automated accessibility testing tool, being a piece of software, doesn't have very much in the way of common sense. It will interpret each and every accessibility guideline literally, without bearing any other thought to what else is on the page.

The definition of the word guideline, according to Dictionary.com, is "a rule or principle that provides guidance to appropriate behaviour". A guideline simply offers guidance to what the best practice is - it shouldn't just be applied without regard to other factors.

For example, one of the W3C accessibility guidelines states that a table summary should be provided for all tables. (This summary doesn't appear on the screen, but it's read aloud to screen reader users before reading through the table content.) Table summaries are useful as they tell screen reader users what to expect in the table. However, there may be a heading directly before the table and it describes what the table is about. In this instance, this summary is essentially useless as it will just repeat what the previous heading said.

Can't check any content issues

The way that content is structured both on the page and across the website is a massive part of accessibility. A website may be perfectly coded and conform to the highest coding standards. If its content is poorly structured though, the site will prove difficult to impossible for some special needs web users.

There are a number of important accessible content considerations, none of which automated accessibility testing tools can check for. Some of these important considerations include:

- Front-loading content so that each paragraph begins with the conclusion

- Ensuring content has been broken down into manageable chunks with descriptive sub-headings

- Using lists wherever appropriate

- Ensuring that plain and simple language is used

Can't check many coding issues

The vast number of accessibility guidelines tend to be related to how the site is coded. Automated accessibility testing tools are unfortunately unable to test for many of these too. Examples of HTML-related accessibility considerations which these tools can't check for include:

- Ensuring that text is real text and isn't embedded within images

- Making sure that the site functions without the use of JavaScript or Flash

- Providing equivalent text links if using server-side image maps

- Ensuring that the structure within the HTML reflects the visual appearance (e.g. headings are labelled as headings within the HTML code)

Outdated guidelines are used

Automated accessibility testing tools generally use the W3C accessibility guidelines, which by now are over five years old. As such, a number of these guidelines are outdated and don't apply anymore. In fact, some of them are now thought to hinder accessibility rather than help, so it's best to totally ignore these guidelines.

For example, an automated accessibility testing tool will probably insist that form items contain default place holding text. It may also insist that links need to be separated by non-link text. Neither of these guidelines are relevant anymore and their implementation could make accessibility worse rather than better.

Most guidelines aren't properly checked

Automated accessibility tools can check for a number of guidelines, and can tell you when a guideline isn't being adhered to. However, when the tool claims that a guideline is being fulfilled this may in fact be a false truth.

For example, if all images contain alt text then the software will report a pass for this guideline. But what if the alt text isn't descriptive of its image? What if alt text is crammed full of nonsensical keywords for search engines? How can an automated accessibility tool possibly know this?

Warnings may be misinterpreted

The reports generated by automated accessibility tools provide warnings, as well as errors. These warnings are basically guidelines that the automated tool can't check for, but which may be errors. Often they're not, and in fact they're often not even relevant. However, some people reading a report may try to get rid of these warning messages by making the appropriate changes to their site. By doing so, they may be implementing guidelines that needn't be implemented and inadvertently lowering the website's accessibility.

Conclusion

Automated accessibility testing tools can be useful as they can save a large amount of time in performing some very basic checks for accessibility. However, they must be used with caution and they cannot be used as a stand-alone guide for accessibility checking. Indeed, some expert accessibility knowledge should always be applied in evaluating a site accessibility, perhaps in conjunction with the fantastic web accessibility toolbar (http://www.nils.org.au/ais/web/resources/toolbar/) to help dramatically speed up manual checks.

This article was written by Trenton Moss. He's crazy about web usability and accessibility - so crazy that he went and started his own web usability and accessibility consultancy (Webcredible - http://www.webcredible.co.uk)

RELATED ARTICLES


Building a Great Intranet Taxonomy
While it may seem like a "quick and easy" task, defining the navigation structure and organization of your intranet site will be one of the most challenging tasks you will face in the course of your project. It is also one of the most critical success factors. The site structure, also referred to as the information architecture or taxonomy, is the foundation of your intranet. Creating an effective taxonomy is as much an art as it is a science. Use the wrong terms and your users won't be able to navigate by intuition. Make your site too deep and they will never find the content they're looking for.
Internet Marketing Website Promotion -The 7 Biggest Mistakes I See People Make With Websites!
1. Many people are not getting good or complete advice. Often for example people don't understand all the concepts of Internet Marketing and having a website so they simply pay to have a website developed. Often this website may look good but it falls far short in the area of being "search engine friendly". This is typically because many businesses that deal with the web are very one track focused.
Do You Need a Web Database?
Does My Web Site Require A Web Database?
Are You Losing Sales Because of These 4 Simple Website Mistakes?
Losing website sales and traffic is sometimes simply a case of web usablity - your website just isn't clear to your visitors. By fixing these simple mistakes, you'll easily increase your conversion rate and make more online sales.
What ROI You Should Expect From Your Web Site
Is Your Web Site an Expense or an Investment?
Building eCommerce Websites that Work - Part 2
Succeeding with an eCommerce website is a dream for many these days. It may seem nearly impossible at times, but it can be done. This series covers some of the basic success factors - things you must consider in creating, implementing, managing and developing a quality eCommerce web site. There are many ways to do business on the internet - and, not surprisingly, a lot of ways to both make and lose money. Mainly, I'm focusing on eCommerce sites intended to sell products of various kinds. Not every factor is going to apply to every site, but since a major failing of many internet entrepreneurs is the lack of multiple income streams, you'd do well to carefully consider all factors and apply them as needed in developing alternate revenue streams.
Frequent Business Question: How Do You Start a Web Business?
Today it seems everyone is jumping on the entrepreneur bandwagon, and who could blame them? Setting your own schedule, working from the comfort of your own home, and never having to deal with a horrible commute or office politics again, this option is quite popular among all ages. With the advent of the technology age, it seems more individuals are looking to the internet to provide them with goods or services. Without having to leave your computer to shop for whatever your heart desires, web businesses have boomed over the past decade. More popular than ever, starting your own web business is an excellent way to earn an extra income or replace your current income. However, many individuals who wish to begin this new chapter in their lives do not have any experience in starting or running a business, spurring them to ask the question: how do you start a web business? The answer is: easy! All you need is a computer, internet connection, and a dream and you are halfway there.
How to Listen on the Web
When building a relationship, listening is more important than talking.
How To Write More Powerful Online Text
Although there are significant differences among the various types of online communication, there all have one critical thing in common - they're read off a screen. There are substantial benefits, too, in that while your message is on someone's screen usually it has their undivided attention. You are genuinely "one-to-one" with them and that's something you must respect - you are literally "in their face" and encroaching on very personal territory. The bad news about online communications is that your message can be "disappeared" faster from a screen than with any other medium.
Business Website Building Do?s and Don?ts
First, using a lot of web graphics, flash, banners and pictures on your home page may make it look fancy or cool; but it will slow down the loading time extensively. And lets be real here, most people that look at your web page will leave if it doesn't load in 3 seconds or less. Because most people are naturally impatient. If they click on a banner or link that leads to your home page, they expect to see it the second they click, all of it. Not too many people will sit there and wait for your web graphics, flash intro, banners or 30 pictures to load. Keep in mind that not all visitors computers will load pages as fast as yours may. Set your screen resolution at 800x600, or at least put a notice on your page what resolution your site is best viewed in, because people hate to have to scroll back and forth to read from side to side.
Trinkets, Lockets And Empty Pockets
It never ceases to amaze me how many people set-up a website, without any type of plan or clue about how to promote it, how to write a sales letter, how to write an ad-- nothing!
Benefits Of An Accessible Website: Part 2 - The Business Case
The DDA (Disability Discrimination Act) states that service providers must not discriminate against disabled people. A website is regarded as a service and therefore falls under this law, and as such must be made accessible to everyone.
Make Your Own Brand!
There are millions and millions of websites on the Internet. You NEED to be different in some way from all of them! If you could get a visitor to your website, that means nothing. Only returning visitors must be counted. When they return the second time, "branding" starts to occur. Huge companies advertise not because they want to provide you with information about their product. They do that because they're trying to "brand" its name and image. Actually, it is the brand you are paying the money for when you buy something from "Adidas", "Nike" or "Coca-cola". People will actually be willing to pay for the brand they know, so make it as bright and memorable as possible. However, it is useful to remember that too complex logo will definitely slip out of peoples' minds.
The 5 Biggest Mistakes Almost All Web Designers Make
Huge Mistake #1: Creating a Website with Flash -- Did you know in a recent study, top internet marketers discovered that having a website created with Flash, actually DECREASED the response from prospects and customers by as much as three-hundred-and-seventy percent?
Content Management
More and more businesses are recognizing the importance of content management when it comes to their websites. Website content is more important than ever before, and as the Internet matures and changes, it is likely be become even more important. Many smart companies are beginning to make their website content the centerpiece of their Internet presence.
From Concept to Website
You've decided to create a website to market your products or services. More and more people start their information searches online, so having a website is the logical next step. But without web development skills or knowledge, how do you build and market a website?
5 Essential Traits Of A Home Business Website
So you've decided to start an online work at home business and are just beginning to build your website. You probably have a million different ideas for what you want the site to look like. You will want to take into consideration that your idea of a great website may differ drastically from what a website designed to make sales should be like.
Ecommerce for Beginners
Like most average persons, I wanted some extra money to supplement my regular income. I had considered a part time second job at times, but hated that option because it would take me away from the family, make me more tired and probably just pay minimum wage. I also wanted to be able to work from home.
Why Do I Need A Web Site?
Even though the Internet has been around for a long time and many people are "educated" about the Internet, most have little knowledge about what a web site is and what can it do for their business.
Web accessibility for screen magnifier users
The needs of screen magnifier users are overlooked when implementing web accessibility on to a website. Screen magnifiers are used by partially sighted web users to increase the size of on-screen elements. Some users will magnify the screen so that only three to four words are able to appear on the screen at any one time. You can try using a screen magnifier yourself by downloading the Zoomtext screen magnifier from http://www.aisquared.com/Products/ZoomText8_mag/FreeTrial/Z8FreeTrial.htm for a free 30 day trial.