QA & UX
February 17, 2013
Quality assurance impacts the user experience: when things don’t work, users question their understanding and develop superstitions and inefficient workarounds.
Evidence-Based User Experience Research, Training, and Consulting
Quality assurance impacts the user experience: when things don’t work, users question their understanding and develop superstitions and inefficient workarounds.
Winners of the Intranet Design Annual competition for 2013, with summaries of key intranet design trends. The number of people on intranet teams grew substantially compared to earlier years.
Over the last several years, entry-level salaries have dropped, while pay for experienced usability staff has been more stable. (Updated to 2012.)
3 approaches to better design: each has its uses, but the costs, benefits, and risks differ dramatically.
Enemies of usability claim that because 'the experts disagree,' they can safely ignore user advocates' expertise and run with whatever design they personally prefer.
The average business metrics improvement after a usability redesign is now 83%. This is substantially less than 6 years ago, but ROI remains high because usability is still cheap relative to gains.
Having a specialized usability person is best, but smaller design teams can still benefit when designers do their own user testing and other usability work.
Having a good designer doesn't eliminate the need for a systematic usability process. Risk reduction and quality improvement both require user testing and other usability methods.
Although the gains don't fall into traditional profit columns, there are clear arguments for improving usability of non-commercial websites and intranets. In one example, a state agency could get an ROI of 22,000% by fixing a basic usability problem.
An organization that reaches the managed usability stage still has far to go to reach usability nirvana. Attaining these higher maturity levels requires many years of effort.
As their usability approach matures, organizations typically progress through the same sequence of stages, from initial hostility to widespread reliance on user research.
The evangelism strategies that help a usability group get established in a company are different from the ones needed to create a full-fledged usability culture.
Yes, it is possible for white-collar workers to work smarter and become more productive. While intranet usability provides substantial initial gains, workflow usability can go much further and will save millions of jobs.
Better prioritization, fewer interruptions, and concentrated information that's easy to find and manage helps people become more productive and stop wasting their colleagues' time.
On average across many test tasks, users fail 35% of the time when using websites. This is 100,000 times worse than six sigma's requirement, but Web usability can still benefit from a six sigma quality approach.
Usability improvements can save time-on-task, but critics argue that this is not the same as saving money. Others worry that productivity gains cause unemployment. Neither is correct: usable design saves money and saves jobs.
Development projects should spend 10% of their budget on usability. Following a usability redesign, websites increase desired metrics by 135% on average; intranets improve slightly less.
To save costs, some companies are outsourcing Web projects to countries with cheap labor. Unfortunately, these countries lack strong usability traditions and their developers have limited access -- if any -- to good usability data from the target users.
Usability is a well-paying profession these days: A usability specialist in California with five years' experience had an estimated cash compensation of $90,118 a year in 2001, not counting stock options or other benefits. This number is at the high end of our detailed survey, which analyzes salary data from 1,078 professionals who attended the User Experience World Tour from November 2000 to April 2001. The survey respondents represent a response rate of 40% of the 2,682 conference attendees. Because we surveyed people at a high-end professional conference, the data probably reflects the salaries of good user experience professionals.
A survey of 1,078 user experience professionals finds that usability specialists make more money than designers and writers in the same field. In all three areas, salaries are highest in the U.S., lower in Canada and Asia, and much lower in Europe and Australia.
Never listen to what people say in response to a survey: asking high-tech employees what will keep them in their jobs provides very different answers than the factors that actually drive retention.
Web design is a core competency for the network economy and should not be outsourced, even though certain specific components may be outsourced.
Web project management impacts usability significantly. Mistakes include having site structure mirror your orgchart, outsourcing to multiple agencies, generic links from offline collateral, and lack of strategic thinking
You need to hire someone to design your Web site. What should you look for before signing on the dotted line? Let's look at a few different types of consultants.
In 4 case studies, the median usability improvement was 165% from the first to the last iteration, and the median improvement per iteration was 38%. Iterating through at least 3 versions of a UI design is recommended, since some usability metrics may decrease in some versions if a redesign has focused on improving other parameters. Nielsen, J. (1993). Iterative user interface design. IEEE Computer 26, 11 (November), 32-41.
User interface standards can be hard to use for developers. In a laboratory experiment, 26 students achieved only 71% compliance with a two page standard; many violations were due to influence from previous experience with non-standard systems. In a study of a real company's standard, developers were only able to find 4 of 12 deviations in a sample system, and three real products broke between 32% and 55% of the mandatory rules in the standard. Designers were found to rely heavily on the examples in the standard and their experience with other user interfaces. Thovtrup, H., and Nielsen, J. (1991). Assessing the usability of a user interface standard. Proc. ACM CHI'91 Conf. Human Factors in Computing Systems (New Orleans, LA, 28 April-2 May), 335-341.