August 28, 2008

8 Things you need to know about improving online experience- new study

User_happy A new study (July 2008) entitled 'Factors that Improve online experience' by Sathish Menon and Michael Douma from the Institute for Dynamic Educational Advancement offers key insights on the current state of online user experience.

The study reinforces known usability truths, sheds light on user perceptions but more interestingly points to disconnects between designers and users. The study surveyed perceptions, expectations and practices across various audiences and contrasted the results.

The key findings and what they mean:

1) Designers underestimate the thresholds for an effective site. Respondents consider a site “effective” when visitors are satisfied with respect to enjoyment, can find information somewhat easily, and never get lost in the site. By at least one point on a five-point scale, visitors have higher expectations for effectiveness than do designers. Nonprofit organizations believe that effective sites do not have “information gaps between what visitors want and what the site provides” and that visitors are at least “somewhat satisfied” with their sites. Designers should give greater consideration to overall effectiveness, thereby reducing the chance of failure for a user to find the information they seek.

Comment: Designers rely too much on a "they'll figure it out" approach and underestimate that users need transparent designs that support intuitiveness over flair.

2) Easy access to complete information is key to visitor enjoyment. All three survey groups believe that the ease with which visitors can find information and the ability to maintain orientation is critical to enjoyment. Both organizations and visitors believe that reducing the gap between what web sites provide and what visitors seek is critical to enjoyment. These variables explain 25% to 30% of the variance in visitor enjoyment; hence, ease of finding information is an important foundation for most sites.

Comment: The feeling of satisfaction is highly relevant to how well a visitor found the information they were looking for.  

3) Good visual design and up-to-date information are critical. Over 80% of designers and organizations believe that good visual design is important. A healthy 50% of the visitors agree. Fully 80% of visitors and organizations believe that up-to-date information is very important. Only 60% of designers believe that to be the case. When budgeting for your project, don’t be overly seduced by fancy graphics and multimedia. Invest in strong, clear design and simple methods to quickly deliver current information to your visitors.

Comment: Of course, "fancy graphics" is open to interpretation as is "strong, clear design"; as is multimedia. For example, video or a flash demo may be exactly what you need to communicate your product or process.

4) Visitors want information fast. Web site visitors are looking for simple, accurate, fast, and easy to navigate web sites - preferably with links to information they seek. A significant number of comments revolved around the need for speedy access, including but not limited to download speed, in order to find the information visitors are looking for. Even in a broadband age, visitors value fast sites, both those that are fast loading and those that quickly deliver sought-after information.

Comment: This is why popular e-commerce site Zappos.com Director of Development views a key user experience challenge as delivering load times in 1 second or less (view video).

5) Visitors want a broad range of topics. Relative to designers and organizations, visitors more strongly believe that a broad range of topics is important. Visitors believe sites can be more effective by helping visitors find interesting information - even if they are not looking for it. Designers and content developers can provide ample sidebars that link to other recommended pages, and extensively cross-link to other pages based on keywords.

Comment: Visitors want to go to one place with links to many more places, versus navigate to many places for content. the study findings advise: Designers and content developers can provide ample sidebars that link to other recommended pages, and extensively cross-link to other pages based on keywords.

6) Designers are overly optimistic about visitors' ability to maintain orientation. In the survey, the ability to maintain orientation was defined as visitors' ability to know "where they are, where they can go next, and which pages are related." About 70% of designers believe that visitors are almost always able to maintain orientation. That drops to about 30% when non-profit organizations express their view. In contrast, only about 10% of visitors report being able to almost always maintain their orientation. Fewer than 5% report that they tend to get lost frequently. Said another way, your visitors don't know your site as well as you do, so make sure it is obvious how to find information through meaningful menus, prompts, and not too much clutter.

Comment: Usable navigation is classically over-looked by designers and web agencies. I've seen this disconnect between how designers think about navigation and how end-users actually interact with sites consistently for the past eight years. The home link on a top navigation bar is a good example. Users want it there, designers and design boutiques are convinced it is "old school" and every dummy knows to click the logo. A survey we did of a high tech audience (employees who worked for the company) found only 20% knew that the logo meant "home"!

7)  Visitors still need hand-holding. The study asked about hypothetically providing visitors with personal assistance using a site. About 70% of organizations and visitors believe that a personal guide would increase the effectiveness of a web site. Only about 50% of designers believe the same. Designers tend to overestimate the clarity of their designs.

 

Comment: The problem here I think is those of us working in this industry get too familiar with the Web. We take for granted that everyone else knows what has become implicit knowledge for us. This is also true of usability consultants. I'm frequently called in after another usability consultant has been working on a project to bail out the project. Usability "people" often underestimate their users, it's a classic (and yes shameful)  common mistake- it's not just designers!

8) Visitors point to the lack of breadth and depth of site content as causing an "Information Gap." Although over 90% of visitors say that they are able to find the information they are looking for, over 50% report that there is a gap between what they are looking for and what typical web sites provide, and 60% think that a personal guide would help them navigate web sites. The reported gap is negatively correlated to visitors' ability to find information, and positively correlated to the need for a local search engine. This indicates that most web sites are unable to provide the breadth of information that visitors seek. Visitors often request broader and deeper information, when in fact they need to find existing information more easily.

 

Comment: This is a tricky problem because it's so context dependent. Typically usability best practice says solve the users immediate task or problem first, then give them options to explore, expand and enhance the discovery, search or experience.

There are specific interaction design techniques that can help with this problem. I discuss a few here: progressive disclosure (giving users what they need, then offering more) and forcing functions (limiting choices to help users get what they need).

Download a copy of the study here

Best Wishes,

Frank Spillers, MS

May 26, 2008

Design Like You Give a Damn!- Sustainable Design

Gaviotas_stamp Design Like You Give a Damn is the name of a really great book on architectural responses to humanitarian crises. The book details design projects around the world from the ecologically dry toilet to the hippo water roller.

Sustainable design is also the theme of an aerial dance and acrobatics show my daughter plays a part in that's premiering in Portland this month, called ¡Entusiasmo!, a true story of Gaviotas, Columbia. The show is written by Do Jump's Robin Lane, based on Alan Weisman's book Gaviotas: A Village to Reinvent the world.

Gaviotas, located in a remote area in eastern Columbia (Vichada in Los LLanos region), is one of the world's most fascinating case studies in sustainable and renewable design technologies. For 40 years, this experimental community has pioneered sustainable technologies now used in over half of the developing world.   

"Built from scratch in a treeless corner of the country, this community of scientists, tinkerers, and refugees - now numbering more than 200 - has created a verdant rainforest where once there was nothing but scrub grass. It has also devised and deployed dozens of inventions with a frequency and success rate that puts some of America's most storied technology companies to shame.

Its products include a hydroelectric microturbine that generates 30 kilowatts and thousands of RPMs from a mere 1-meter drop in a low-fall dam; a system of solar panels, spherical boilers, and tanks that can provide hot water for housing projects as large as 30,000 units; and a remote-controlled zeppelin that uses videocameras to spot forest fires.

Unlike the startups that dot Silicon Valley, Gaviotas has done all this and more with virtually no funding, no well-endowed university backing, no incubators or venture capitalists, and no access to a national power grid, airport, or freeway system. In fact, Gaviotas lies 15 hours east of Bogotá, the nearest city of note, by a two-lane road that traverses the estates of narcotics traffickers and disappears occasionally into sloughs of mud..."

Source: CNN Money / Business 2.0 The Village that could save the Planet (Sept. 27 2007)

In 2007, the founder of Gaviotas, Paulo Lugari, was awarded an honorary PhD in Science in Technology from Carnegie Melon University for his commitment to sustainability. Also last year the United Nations named the village a model of sustainable development. Gabriel Garcia Marquez has called Paolo Lugari the "inventor of the world."

If you haven't seen the Do Jump theater production ¡Entusiasmo!, which tells the story of Gaviotas in aerial theater/acrobatics and humor it is playing now in Portland (Oregon, USA) at the Portland Center for Performing Arts and this weekend (May 31st 2008) the show will be attended by Paulo Lugari, who will answer questions afterwards.

What Gaviotas teaches us about Sustainable Design
  • It is possible to design and maintain complex technology with almost no resources (no capital investment) in an inhospitable environment with low environmental impact.
  • There is no failure, only feedback: Around 58 types of windmill were tried and tested before Gaviotans determined that the distinctive ‘sunflower’ design functioned best in the arid plains of Los Llanos.
  • A user interface can be created to positively conceal the underlying intention of a device: a sleeve pump designed in Gaviotas incorporated school children's suggestions to add a sea-saw, hence providing an interface to power the pump seamlessly.
  • Poverty reduction and 'green' technology go hand in hand: Gaviotas developed their own fully solar-powered hospital (solar kitchen and solar kettle inventions using heated cottonseed oil); the hospital serves anyone in the area in need. The solar technology developed in Gaviotas also powers a number of Bogata's buildings including the US Embassy and the Government Palace.
  • Designs do not always have to be tethered to electricity (e.g. Gaviotan hand-pumps for micro-aqueducts or hand-cranking radios originally developed for remote areas of Africa). "Power-free" is a valid design constraint when you consider 1.6 billion people — a quarter of earth's population — live without electricity.  [Millennium Development Goals Report 2007]
Why Sustainable Design?

The world is in dire need of innovations that address real economic,  social and environmental crises. Consider the implications of the 'design problem':

  • Half the world — nearly three billion people — live on less than two US dollars a day [2007 United Nations Human Development Report]
  • One in two of the world's child population live in poverty [UNICEF 2005]
  • For every $1 in aid a developing country receives, over $25 is spent on debt repayment. [World Bank, accessed March 2008]
  • Annually, more than 60 percent of global industrial carbon dioxide emissions originate in industrialized countries, where only about 20 percent of the world’s population resides. [World Resources Institute 2007]
The division between developed and developing, rich and poor nations is only growing. China and India's emerging middle class are modeling Western consumption patterns, a trend that can have serious implications on environmental, social and economic standards inside these countries and the larger eco-system. At the same time, interaction and industrial designers, architects and innovators are largely focused on creating user experiences that support the design problems of the privileged lifestyles we lead in North America, European and certain Asian economies.

Design Innovation in high demand


Bridging the gap between design innovation for Western/Northern hemisphere audiences and the estimated untapped market potential among the 4 billion people who make less than $2 a day is one of the key challenges in the 21st century. The challenge should be approached with the same imagination, creativity, boldness and humanity that Lugari used to establish a working protoype in Gaviotas... and recently with Gaviotas II - the megaproject that is poised to put Gaviotas on the world stage.


Considering that nearly a billion people entered the 21st century unable to read a book or sign their names, [UNICEF 1999] what does this mean for manufacturers who's products currently reach global audiences? Nokia is blazing the trail in this area, lead by Jan Chipchase (Nokia Research Center) who conducts field studies in 'emerging markets' in order to discover the mobile phone needs of non-literate users (see Jan's Illiteracy research PPT).

As the economy is "greening" (marketers seem to be wearing their green hats like it's Saint Patrick's Day), and Web 2.0 realizing it's social computing potential (eg. 'the Social Web', 'Social Media' etc), so too are organizations gaining ground called Social Capitalists or Social Entrepreneurs. The popular magazine Fast Company even holds an annual award for the earned title. Let's face it: no auto manufacturer would be caught dead without alternative green engineering in their design rooms, and industry as a whole is beginning to catch on driven by necessity and consumer demand.

Social venture capital firms like The Acumen Fund seed initiatives around the world connecting ideas and social needs to capital and fruition. Several of their projects are featured in the book Design Like You Give a Damn.

"It's all about innovation," says CEO Tim Brown of IDEO, who advises Acumen. "The money is there, but the solutions aren't. Designers can contribute. We're pretty good at taking a bunch of disparate components and figuring out the solution."

Source: Business Week Designing Change March 12 2007

Efforts like the non-profit $100 laptop (One Laptop Per Child) project are a huge step in the direction of extending humanitarian "aid" into areas of low literacy and cognitive development. The laptop embodies sustainable design by providing a water/sand proof keyboard and screen; a built in wireless and mesh-network (forms ad-hoc peer to peer connections across geography to strengthen the wi-fi cloud); a hand-crank for energy; a full sunlight back light screen and more. MIT's Nicholas Negroponte started the project as a humanitarian effort, but later ran into the politics of distribution and market turf-battles from Intel in 2007. (Intel ran a competing product against the project; tried to strangle the project then partnered with OLPC; were kicked off the project and finally went back to competing with the project in a for-profit capacity).

Changing how we think about audiences we don't design for

Jakob Nielsen recently took fire (as well he should) from bloggers for blasting the OLPC project, with his main criticism that the $100 laptop was not user tested (though the laptop has been in field use in Cambodia and elsewhere for several years). Nielsen also criticized the operating system- a new user interface paradigm called Sugar OS (see a demo of Sugar OS). Did Jakob Nielsen completely miss the point???

The guru of usable technology should be supporting the humanitarian effort behind the interface. This CBS video piece called "What if Every Child Had a Laptop?" illustrates the social, emotional and community transformation the laptop "beta" had in its Cambodian village trials (children started loving school, families were delighted to use the lighting emitted from the laptops screen in their electricity-lacking home etc) and provides more inspiration than Nielsen was able to offer in his shameful nitpicking comments for Business Week.

If the $100 laptop with it's lack of usability testing and non-standard interface can give a poor child hope in the future and an interest in education, then it's achieved it's goal as far as I'm concerned.  However, it's clear that as we expand our conversations in sustainable design, the armchair analyzing (read: lack of empathy; lack of context; lack of awareness) mindset will need a new design solution as well. It's too easy to sit and judge a Gaviotas or a $100 laptop for Third World kids from the comfort of a North American interface, running water, electricity etc. context without realizing that whatever you give a child in the South (having personally grown up in Africa) will be deeply appreciated and may even have a lasting impact on their life.


Guidelines for Sustainable Design

So as sustainable design becomes more important in our lives and how we think about our future, here are some guidelines that capture the best practice of Gaviotas (though you'll want to refer to Weisman's book to get the depth of technique applied by Lugari). Also many of these links on these sites are broken, ironically.


Best Wishes,

Frank Spillers, MS

December 24, 2007

AJAX Usability Checklist (Free holiday bonus for our readers)

This Ajax Usability Checklist is a bonus guide that accompanies my AJAX Usability Seminar, I am offering it in the  form of this post as a bonus for readers- thanks for your support!

The Web is changing fast. New standards are emerging, new approaches to coding such as Scriptaculous, AJAX, Ruby, Flash/Flex, Silverlight and others are creating a leap-frog situation where many new websites, web apps and portals are implementing next year's User Interface elements.

Yet, when it comes to implementing the new interface techniques AJAX offers, we need to be mindful of how AJAX can improve the specifics of the user experience.

Two simple guidelines for AJAX Usability:

1)    If the user has to ”play” with the interface control too much it is probably used inappropriately.

2)    If the interface control does not follow the user’s task, it is probably used gratuitously.

1. When and where to use AJAX

    a) When presenting complex features or functionality

    b) When building a data set for the user

    c) When presenting depth of information

    d) To correct or intelligently help the user

a) When presenting complex features or functionality

Bluenile_3

EXAMPLE: Bluenile.com offers a complex ring configurator with advanced filtering and sorting functionality.

An AJAX interface allows users to hover over ring specifications.

Sliders help narrow the selection.

Note: Top to bottom sliders are novel and should be tested since they are less familiar UI elements on the Web.

b) When building a data set for the user…

GoogleEXAMPLE: Google Analytics offers Save to Dashboard and hidden report control features to give users more control over the analytics reporting experience.

c) When presenting depth of information

Google_2
EXAMPLE:
Finance.google.com offers pull sliders and instant click in their finance application to give users immediate data overlay feedback.

The end result is a quicker, more robust sense of interactivity with the market data.

d) To correct or intelligently help the user

Kayak
EXAMPLE: Kayak.com uses a “just in time” help system to walk uses through AJAX filter features. The format is a contextual dynamic help system that utilizes a wizard metaphor (next/back).

This is a best practice and should be modeled. 

2.    Key Lessons: Google style AJAX; Yahoo! Style AJAX

  • Create transparency with complex functionality
  • Reinvent old experiences with AJAX elegance
  • Leapfrog the competition
  • Get known by your user experience
  • Improve performance
  • Revitalize the presentation layer

Create transparency with complex functionality
Example: Yahoo! expanded the “social web” with a portal social networking approach. Yahoo!’s MyWeb for example, allows users to save search results, as well as share and discover bookmarks and interests. Yahoo! extends the search experience by adding social networking and social browsing with simple AJAX interactions and features.

Reinvent old experiences with AJAX elegance

Example: Google Maps redefined the mapping user experience with AJAX. Characteristics included full screen, direct manipulation maps, with the ability to search listing or make a VoIP call from inside a floating dialog.

Leapfrog the competition
Example: Google Docs has entered a new category of software as live service competing directly with Microsoft. Zoho.com has taken Google Docs a step further and is offering a full AJAX suite of productivity applications online.

Get known by your user experience
Example: Yahoo! assumed industry leadership in photo sharing with its Flickr acquisition and is now a leader in AJAX user interface best practice.  Flickr took the lead as a Web 2.0 best practice example (though Bubbleshare.com has a better experience it was not first to market).

Improve performance
Example: Google’s Gmail improved the email user experience by creating an AJAX friendly email client. User experience improvements with AJAX included integrated presence (IM), threaded conversations and search among others.

Revitalize the presentation layer
Example: Yahoo!’s email client made email and junk mail management easier by introducing desktop-like functionality with its new release of Yahoo! Mail. Yahoo! Travel has also revitalized travel planning with its AJAX powered social networking Trip Planner site.

3.    How to design for progressive disclosure* contexts using AJAX.

a) Extend discoverability
b) Provide dynamic “smart” help
c) Give the user less “drill down”,  more shallow navigation
d) Show related details or content

*Progressive disclosure is an interaction design technique that sequences information and actions across several screens in order to reduce feelings of overwhelm for the user. By disclosing information progressively, you reveal only the essentials and help the user manage the complexity of feature-rich sites or applications.

a) Extend discoverability >> make it ease for users to find stuff.Tripadvisor

 

EXAMPLE: tripadvisor.com gives users a progressive disclosure of links contained in a category with an opaque “click to expand” window. The interface feature appears only once and gives way to an ‘accordion’ menu of the other 4 categories.

This is a novel, but potentially valuable device to orient users to further discover the contents of a page section.

 

 

b) Provide dynamic “smart” help >> give users better contextual help that provides in-line tutorial type information.

Kayak2

EXAMPLE: Kayak.com uses a “just in time” help system to walk users through AJAX filter features. The format is a contextual dynamic help system that utilizes a wizard metaphor (next/back).

This is a best practice and should be modeled.

c) Give the user less “drill down”, more shallow navigation >> make it easier to get to and from search results and the home page.

Patagonia

EXAMPLE: Patagonia.com lets users view contents of a product from the search results page in an AJAX dialog.

The move to viewing product details and acting from a pop-up window is not new, it is just back from having disappeared with html pop-ups a few years ago.

Extending the pop-up, AJAX offers more direct features from the page without page load/reload such as favorite, add to cart etc.

d) Show related details or content >> give users “just in time” content, controls and features .

Cnn

EXAMPLE: CNN.com offers an accordion style menu selection with in-line tabs that users can change views (without page reload).

Note: Page tabs should not require page reloading. For a bad example see priceline.com search results “Sort by” tabs (pages reload and reposition users on the page).

4.    Five questions you should ask when considering AJAX

Question 1: Will using AJAX greatly improve the user experience with my site or web application?

Do not use AJAX if it does not enhance a strategic aspect of your user experience.  AJAX pitfalls (browser incompatibility) can create technical and usability headaches for your JavaScript developers and your users. Be sure to test, refine code and re-test. Just because the AJAX element works on your browser, does not necessarily mean it will work on your users.

Question 2: What is the user experience strategy that compliments the AJAX deployment?

AJAX can be used to add sizzle but you should think of AJAX as a collective strategy used to improve a users ability to complete his or her tasks more effectively. AJAX is not the answer to every design problem and often times is inappropriate or irrelevant.

The excitement in a design is on “how can this improve the user’s task?” not “how can we Ajaxify this page to make it cool?”

Question 3: Will JavaScript gracefully degrade in browsers and is there an alternate if users browsers get stuck?

Support graceful degradation using JavaScript detect scripts and support JavaScript-free and mobile friendly versions. Try to keep AJAX to user interface elements that add value throughout the experience, but do not primarily require the technology to get through a website for example.

Question 4: Is there a real need to use AJAX or is it “just because”?

The technical pitfalls associated with AJAX require a disciplined use of JavaScript and AJAX. Think strategically about how AJAX can help the user on this page or that page. Do not take AJAX for granted as a user interface technique!

Assume users will not be familiar with the interface tricks AJAX offers, instead try to make everything transparent. For example, a plus button that opens up should have a “Details…” link beside it.

Question 5:
Are you inventing completely new or reinventing problematic designs and how will you know if they work?

Good AJAX usability comes from testing your design with your target audience. Users rarely drink the cool-aid of new “whiz-bang” technologies or interface enhancements.

AJAX should be used in context of a users task and it should help remove the “work” traditionally associated with a browser fetching pages and handshaking with a database.

AJAX usability means that a user can do something on the screen that changes the display without waiting, with minimal effort and with a responsive and “just in time” interface.

Download this AJAX Usability Checklist:

Download ajax_usability_checklist_bonus_guide.pdf

Subscribe to Experience Dynamics usability Research Newsletter to be informed of seminars and research alerts.

Note: This AJAX Usability Checklist accompanies the AJAX Usability seminar with Frank Spillers, MS. Please refer to that presentation and recording for additional examples, guidelines and for more context on designing for AJAX Usability.

Best Wishes,
Frank Spillers

 

 

January 02, 2007

Is Usability a Public Relations problem?

Word_of_mouthIt will be if you don't do something about it.

At Experience Dynamics, (a Portland, Oregon usability consultancy) we recently helped one of our Fortune 10 clients with some usability testing on a product that was actively being improved for usability.

The client pointed us to a blog entitled "Worst Experience Ever" where the blogger recited his experience with the actual process the program manager was interested in usability testing. This blogger's posting had drawn the attention of the entire product team (yes, they are listening- keep writing). So, we tracked down the blogger and invited him to participate in our usability test. Needless to say, our client and the blogger were both delighted! As it turned out the blogger and other users were experiencing the same problems- he just had the wherewithal to write about it. The outcome was positive for both the end-user (a customer and fan) and the program manager who was able to directly include this user in the usability testing.

This is an interesting case of how the web can put you in touch with your users directly.

Bottom Line: Look to bulletin boards, forums, blogs, private and analyst reviews (and user comments on both) for input and feedback about weak areas with your product, brand, website or feature offerings. User researchers are now studying these information sources for leads into user thoughts, opinions and perceptions relating to product usability-- what is now dubbed "virtual ethnography".

A positive and sustained User Experience is the ultimate public relations

Think Google. In 1998, Google began providing a consistent and simplified search user experience (search box interface as well as search results). Popularity with the search engine grew in the dot com sector and with IT pros initially (many of whom still use it like they did from those early days). Google created a great public relations campaign by directly sustaining and nurturing a positive user experience.

Experiential Public Relations

The web is looking for democratization of content, because arrogance either accidental or inherent is not an option anymore. Word of mouth is now a highly legitimate concern of online marketers everywhere. For more see WOMMA the word of mouth association set up to promote awareness in this area. Experience shapes and influences perceptions, loyalty and word-of-mouth referrals.

Sustaining Criticism from Usability People

When a usability person (self-taught or classically trained) rants, they usually drop the roof on you. Usability is powerful and allows for multiple vantage points into an issue- you see business, you see technology, you see marketing rules and pitfalls wrapped around the user interface.

I have this theory that the more you learn about usability, the more elegant your bitching about poorly executed technology becomes. Does this explain Jakob Nielsen's "problem"? (opens How Usable is Jakob Nielsen? article)

The simple rule for sustaining the attack of a usability person is this: if your application or product has caused a usability evangelist to bark, you had better fix or address the problem, today. Of course, this advice comes to you from a usability consultant. Read more to see what happens if you don't heed this advise.

Another personal example from our recent deployment of a custom shopping cart. Due to the large number of international orders we had to deploy an international shipping cart for our Importance of User Experience poster. On a late night deployment of the cart our developer kicked a switch on the way out and disabled a form error checking element. A few days later we were alerted to a post by former Blogger CEO (now Odeo) Evan Williams. Thankfully Evan accepted our gratitude for waking us up to the Experience Irony and was kind enough to repost It Pays to Blog.

Here's an Interesting Line up of User Experience Offenders (flogged in cyberspace)

1) Apple- from usability guru  Bruce Tognazzini with "Top Ten (Nine) Reasons the Apple Dock Still Sucks". Tog's conclusion: "Keep the Dock as long as it helps close sales, but provide the real tools needed by people with serious work"

2) Adobe- from usability guru Jakob Nielsen with "PDF: Unfit for Human Consumption". Jakob's conclusion: "For online reading, however, PDF is the monster from the Black Lagoon. It puts its clammy hands all over people with a cruel grip that doesn't let go".

3) Macromedia (now Adobe)- from usability guru Jakob Nielsen with "Flash 99% bad". Jakob's conclusion: "About 99% of the time, the presence of Flash on a website constitutes a usability disease". Note: read the bottom of the article for more kind use of words about Adobe since they became Nielsen's client- which for the record, was Adobe's reverse-PR coup used to turn around the negative Flash publicity.

4) Microsoft- from CNET with "Five things you love and hate about Vista (Beta 2)"- June 19th 2006. CNET's take: "But based on what I've seen after living with Windows Vista beta 2 for a week, here are five things I think you'll like about the new operating system--some of which might persuade certain fence-sitters to upgrade--and five things that may convince others to stick with Windows XP for a few more years". Note: during the summer months, I saw more caustic analyst reviews of Vista Beta than praise. The top ones included error message handling SNAFU's like this one...(Flickr image) or this one.

5) MySpace- from Wired magazine with "Web 2.0 Winners and Losers". Wired's conclusion: MySpace is a loser; "The user interface is clunky and counterintuitive".

6) Sharp- another personal example. When I wrote this review of the Sharp Zaurus PDA for NewsFactor Network, I concluded (after doing some usability testing with the device first): "Enterprise deployment of the Zaurus may be another story, but from a productivity and technical standpoint, the Zaurus fails to meet the usability standard that has been set by other popular PDAs, such as Palm, iPaq, Treo or BlackBerry. In a highly competitive PDA market, ease of use is a distinct differentiator. On a scale of 1 to 5, users in our study gave the Zaurus a 2.0 rating". It's interesting to note that when my review came out, the first call I had the next morning was from the Public Relations firm that was handling the "Zaurus account" who insisted it was not a PDA but a "data terminal"... <sigh>.

How to avoid bad public relations due to poor user experience

1) Fix the problem and let your users know you are doing something about it if possible. When this angry blogger complained about Salesforce.com's poor performance, the Salesforce CEO replied to users (and blogged about it- now removed). See how Salesforce handled it here. If this can't be done, see #4 below with examples.

2) Use usability testing to flush out problems with mismatched tasks and expectations. Users want to be successful and bring expectations to your user interface. If their brain wants to go one way and your design has them go the other, you'll likely create "cognitive dissonance". Usability testing early and often throughout a release will help remove many of the embarrasing problems that are often structural and difficult to fix later on. These are far worse than technical issues or bugs that can be squashed quickly typically.

3) Let analysts and the media know what is happening if possible. If your users are having issues, analysts will be having them too and will write about them. For example, earlier last year I noticed Firefox performance and crashing (Feb-March time period). I asked a colleague and sure enough the same issues were reported. A few weeks later, this Business Week post appeared with similar complaints.

An interesting side note with this Firefox VP interview (and others in the past), when user experience is touted, users in the comments redirect the conversation to the huge memory bleed that is core to Firefox's architecture. To my knowledge FFX acts like it's not there but it's users don't ;-) As one users said, "stop focusing on usability and fix the huge memory leak!".

4) Be tactful with your users no matter how cheesed-off they are. I need to tell you there are a myriad of usability issues with Typepad (the blog software used for this blog), some small- some major. Half of my support tickets are pleas to Typepad to improve known usability issues. And it turns out many Typepad users are also frustrated. One user blogged about the less than perfect Typepad experience and after hearing Typepad's response concluded: "Typepad doesn't suck. In fact it's pretty sweet". Typepad then artfully followed up with a We Heard You message.

Contrast this to the way project management software Basecamp (also has it's share of unintuitive functionality) handled their angry users recently:

"Jason Fried: JWright, thanks for the advice on how we should develop our products, but we feel like we have it under control. We know what we're doing." (posted on this blog)

Interestingly this handling is not an isolated incident for Basecamp who experienced a lot of success last year with increased subscriptions. In one Basecamp forum thread, Fried implied that a disgruntled user should go create a rival product. Several users have abreacted to Basecamp's rough handling and even set up a Basecamp Sux site.

Parting thought: Is Web 2.0's "perpetual beta" philosophy a way of inoculating against the responsibility of dealing with online PR from poor user experience?

Web 2.0 promises us a fancy user experience (aka Rich Internet Applications) driven by ease of use. However, remember that usability is not just an idea (it's research that needs to be done properly). We now have over 20 years of documented and applicable usability guidelines and standards (UI Style Guidelines) we can learn from. Great user experiences grounded in matching features to user tasks and expectations produce deep seated loyalty and trust. And in terms of communicating our usability flaws, bugs or blunders, we need to remember to communicate with elegance, courtesy, and grace....

Best Wishes,
Frank Spillers, MS

December 05, 2006

Personas LIVE! Transcript- Interview with Frank Spillers, Tamara Adlin and John Pruitt

PersonaswarholThe following is a transcript of a live interview with Persona book authors John Pruitt and Tamara Adlin, conducted by Frank Spillers in October 2006.

This seminar is available with the slides and audio presentation here (requires brief registration, privacy protected).

Transcript of Personas LIVE!: 

This interview follows the publication of Adlin and Pruitt's personas book, "The Persona Lifecycle : Keeping People in Mind Throughout Product Design"- published earlier this year...

Frank Spillers     Welcome... For those of you who have joined us today for Personas Live – an interview with Personas book authors John Pruitt Pruitt and Tamara Adlin Adlin who we have live on the phone here. I’m Frank Spillers Spillers. This presentation, or seminar, is aimed at understanding a little bit more about what went into the publication and writing of the book. It’s a unique opportunity to hear from the author’s themselves, John Pruitt and Tamara Adlin. We’ve got something exciting stuff for you here, so let’s look at the agenda for today. So first up is the Persona Lifecycle which is one of the major methodologies or themes that the book wraps itself around. We’re going to look at a couple of case studies. Then we are going to look at some Persona best practices and discuss the issue of using personas in a way that maximizes the organizational return on investment. And then we are going to open it up for some questions and answers with the authors. Before we begin let’s do a little brief introduction. Tamara Adlin Adlin is formerly the Customer Experience Manager at Amazon.com and John Pruitt Pruitt is currently with a Senior User Experience Lead at Microsoft with Vista,  Tablet and other projects. Tamara Adlin, would you like to tell us a little bit more about yourself?

 
Tamara Adlin  Yes. About a year ago I left Amazon after helping to set up their customer experience group for their Platform services, allowing lots of other online retailers to use the Amazon technology behind their site. I then started my own consulting company called Adlin Inc. I do a lot of customer experience consulting for online retailers, other online businesses and also traditional product design.

Frank Spillers   Okay thanks. John Pruitt, give us a little bio.

John Pruitt  Yes. I’ve been at Microsoft for a little over eight years now, mostly with the Windows team but I’ve been about three years with MSN, working on MSN Explore and a variety of other web products over there. I’ve been with the tablet and, mobile PC division for a little over a year and a half, closing in on two years now. We are working on getting the mobility side of Windows Vista out the door as well as some new products like ultra mobile PC’s and some new stuff that’s coming down the pipe.

Frank Spillers  And I’m Frank Spillers Spillers and I help run the user experience and usability consultancy firm Experience Dynamics. I’ve been working with Personas for about 9 years now. It’s a pleasure to have you both with us today and thank you so much for joining us. I just wanted to let our audience know, that this is actually a re-run and we are recording this session of the quick release we did of a similar presentation. And there is a little bit more content in today’s session. That had an overwhelming response so we decided to re-it again here today. Just a few weeks after the original publication is where this session first came together. The reason that we wanted to bring the authors on and talk about this book is because I think it is a major landmark in the usability and user experience community. For the first time we now have one place that we can refer to that is really interesting and solid and useful information. If this book isn’t on everyone’s bookshelf in the next few months then I really would wonder what they were doing, because I think this is just a valuable asset. So, thank you so much for putting this book together. Why don’t you start by telling us a little bit about the structure of the book. How is it laid out and why?

Tamara Adlin  Well, the first thing I want to say is thanks for saying that. When we originally started off to do this book, our idea was to put together a quick practical bag that was going to be a couple of hundred pages and our intent was certainly to do that. The when we started diving in we realized that there was so much to say and so many stories to get from so many practitioners – that’s a big part of the book by the way – stories from practitioners who are inserted all the way through as case studies. And the whole thing just grew and grew till eventually it became the heavy book that it is today. But it was also our purpose to make it a rich report, a book that you could thumb through and find ideas, no matter where you are in the persona process.

John Pruitt  As Tamara Adlin said, our book really started with case studies. We had organized a couple of workshops at the UPA (Usability Professionals Association) back in 2001 and 2002. At those workshops we had brought together persona practitioners from around the industry. And at the end of those full day workshops the general consensus was that we need a book on personas about the methodology, on how to do it well, and how to use them right, with case studies and best practices. So Tamara Adlin and I and another contributor Holly Jamieson decided we should do a book. But we thought it should be a really small book, about a hundred pages.

Tamara Adlin And we thought we could do it in nine months…..

John Pruitt   Yeah we thought it would take about nine months, but it just grew and grew.

Frank Spillers  So it turned out to have around 725 pages or so of content in here. Why should someone buy this book, and put another 700 or so pages on their reading list?

Tamara Adlin   Well, that’s actually a big challenge and I’m glad you brought that up. This isn’t a book that we intend for you to sit down and read cover to cover. The Lifecycle, which you’ll hear a little bit more about in a minute, came out of the original workshop which we already talked about. We had a lot of practitioners there, and we looked at a lot of their methodologies and we talked about it. And after the first workshop we realized that personas seem to have a lifecycle just like regular people. And they go through a fairly predictable set of phases, when you try to create them and integrate them into a company. And when you look it at through a persona lifecycle model, you notice that personas tend to run into snags or failures at a fairly predictable time too. So we created the book around a lifecycle approach so that could we could talk about how to integrate personas in with other methodologies that are out there. We certainly don’t think they replace other methods but rather they augment it. Also, so that we could talk about how this process integrates with other development lifecycles. So, like this slide says, we give the intro and overview and the background on where the personas idea came from and how our lifecycle is structured. Chapters 3 through 7 are each on one of the phases of the persona lifecycle. Chapters 8 through 12 are invited chapters that we thought would introduce interesting ideas, research and also methods to the body of the book. So it is designed to flip through, get a sense of what’s going on, and maybe read a chapter at a time as you hit each stage in the lifecycle. And as you hit any snags, as you most likely will, because everyone does, you can flip through and get ideas, find out how other people have gotten through it, get inspiration and get tools because we really wanted it to be practical. And really the only way to practically handle a 700 page book is to use the pieces as necessary and that’s hopefully what you’ll do.

Frank Spillers    And you also have these sidebars which are really interesting. I had the privilege of contributing three or four of these sidebars to your book, Why the practitioner involvement? Was that just to pad it out? Why are there so many stories? Practically every page you turn over there are stories from the field. What’s the purpose of that?   

John Pruitt    I think that came out of the fact that we started with workshops and with other practitioners. The more we talked to other practitioners we realized that the persona method isn’t and probably couldn’t be just a single approach. Like user centered design generally, you really have got to fit the method to your organization, your particular product space, or service space, like what are you creating, building or selling. We personally found a lot of value in the stories and best practices, and the case studies that people were bringing to us, and we wanted to bring those out in the book as well and really highlight them. I think that’s really the value of the book. To in and read these, in some cases really detailed case studies about how they applied personas, how they conceived of personas and what they did for their group. I mean they literally are almost one per page. We have hundreds of little side bars through the book.

Frank Spillers   So the book almost reflects the state of the practitioner community in terms of how everybody is trying to work together to try and figure out how best to utilize personas and the user research in their user centered design and their usability efforts. I need to say I think they are absolutely fantastic and if you haven’t looked at these sidebars and looked at the book – it’s a really nice design and a really nicely organization that compliments the state of the other practitioner community. I just want to say for those of you who are listening or are just joining us, we are speaking with John Pruitt Pruitt and Tamara Adlin Adlin the authors of the “Persona Lifecycle Handbook” just released a few months ago. If you are interested in asking a question go ahead and “chat it” in the left-hand window. Those of you who pick up the recording won’t be able to do that obviously. But for those who are live on the call now, go ahead and chat that in there and I’ll pick up those questions and field them as we go along. So let’s look at this lifecycle. You know the more I think about this, this is more of a book that’s about helping you and your organization use personas strategically and operationally. It’s not really about writing a persona,  although that is in there, the use of the actual tactical technique. But the beauty of the book which I think was deliberate on your part, was to have that organizational perspective and of how to use it in your company of where your at.

Tamara Adlin   Absolutely. We just found that there was so much information about persona projects hitting these huge snags. We were in this lucky position of having an overview of so many stories from other practitioners that we could start to see a pattern. And that’s really how we started to organize the book. Everybody has become really excited about personas, since Alan Cooper wrote “The Inmates Are Running the Asylum” back in 1999. And the problem with that book, in the sense that everybody got excited about it, but nobody knew how to do this method. And that’s fine, no critique of Cooper on that. But people did get excited about it, but nobody knew how to do it. And when they tried it they would run into problems. And I think that is because personas are asking an entire organization to change in some fairly significant ways. They are asking organizations to look more closely and more carefully at user data way earlier in the process than most organizations are used to. They are asking for customer focus that’s really walking the walk and not just talking the talk. They are asking them to think about users every single time we have a meeting about this product. And if you don’t address the way that you are asking for change, then the effort is going to fail because the inertia of old methods and the typical lifecycles are just too strong.   

Frank Spillers    Sure, that makes a lot of sense. I actually brought a slide up here since you mentioned the book “The Inmates are Running the Asylum”. And a lot of people attribute personas to Cooper here, in terms of the starting point in the modern use of personas in 1998 and 1999. So people were left hanging, and that was one of the criticisms of the book. Your book fills the gap, which people have been hungry for over the last four or five years it seems.

Tamara Adlin   We were certainly hoping so, yes.

Frank Spillers  Let’s talk about that lifecycle then. What is the persona lifecycle?

John Pruitt    Well, the persona lifecycle is five stages that we related to the human procreation process. The initial stage, which we call “Family planning”, is really about organizational introspection. It is doing what we do as user-centered design people, kind of turned on our own organization. What do we do as a process? How do we push users into the center of our design effort? Do we already do that? Do we do user testing? What other kind of user research do we do? How do we design our products and decide on features and that sort of thing? So, it’s looking at ourselves and then doing some analysis of “Does this persona methodology fit, and how can I best make it fit” So, it’s a planning process. The second part of it is also going out, and collecting the data that we sometimes already have, or generating a new data collection effort to inform what personas we need to create. That is to really provide the meat of persona creation. The second stage is conception and gestation and that is exactly what it sounds like. It is the phase where you create your personas out of data, and in some cases you create them out of educated guesses and assumptions. And then you go through a process of maturing those initial personas into something that’s really substantial and substantiated. The third stage is called birth and maturation and that’s really about getting your personas out and into your team, so that they become alive and your team recognizes who they are. It’s also introducing the persona methodology as well as kicking off a communication campaign that focuses on your personas as a progressive disclosure of information and regular updated basis so that personas don’t just get introduced and then die on the vine. The fourth stage is called adulthood and that’s really when the personas themselves are mature. They are beginning to be known on the team, and they have got to have a job to do. They are adults now, and they need to contribute to your organizational society. So it’s about getting personas to help you to design activities and product decision making, and through the development stage. So it’s in the planning part at the beginning and the part in the middle as well as at the release part. So that when your product is going out to market, your personas have something to do there as well for you.

Frank Spillers    So are we talking at a project level that all this is happening? Or are we talking at an organizational level over a period of years. So, is this months or years, or is it both?

John Pruitt   It’s actually both. Initially you need to think about the project that you are doing personas for. Is it a product or service, a software product, a hard product or a goods product. In some cases as in web products, that may be a six month process. For Windows Vista that was a five year development cycle. So adulthood is about applying personas through that entire development process. If you are fortunate enough to do it, and have the bandwidth and or support from your upper management to think about personas and user-centered design across your entire organization, so not just a specific project or a single product but groups, suites or families of products. This applies to that as well. The final stage is called lifetime achievement and retirement and that it really about when your product has gone to market and you want to recognize what the personas have done for you, if anything. It’s about ROI – return on investment. It’s about really being accountable. We invested time and effort into personas. Did they deliver something? And if so, what is that? So that chapter of the book really talks about different kinds of ROI and how do you measure what personas have done for you. And then the retirement phase is about starting the cycle all over. So if you were going to do the next version of your product, or if you were going to go into a related project area or starting something entirely new, do your personas live on, do you retire them, do you reincarnate them, or do you reuse some of the data. If you look at the persona lifecycle diagram it is kind of circular, but it’s actually spiral in shape. That’s because the persona lifecycle doesn’t always turn a full circle. It actually continues to grow and change and your personas will evolve over time. That’s how you think about your target customers.

Frank Spillers   I wanted to ask Tamara Adlin what is the deal with these fears and these circles – can you clarify that for us?

Tamara Adlin  Sure. I want to add one quick comment. I think that two of the places that practitioners will find the most initial value especially those who have tried personas already, are in the conception and gestation phase and the adulthood phase. There are lots of new ideas in all of these phases but the thing we’ve gotten the most positive feedback on is conception and gestation which shows really talks in practical ways, step by step,  how to get from raw data to personas. And adulthood, where I would say 90% of the personas efforts fail, people put posters up on the wall, and then expect them to magically work. But in adulthood, again, it’s very practical and it tells you how to actually use them in an everyday environments. Going back to the spiral, we thought long and hard about this graphic. We wanted each of the circles to give you a sense of how much time and effort, relatively speaking, you are going to spend in each phase and a sense of how they morph into each other through the transparency. And the cyclical nature of it. We wanted something that was very eye-catching and sort of captured the idea in an unusual way. And that’s how we came up with this. And you should have seen all the drawings we went through to get here. So, that’s where that came from.

Frank Spillers     Okay. I want to ask you a question about retirement and lifetime achievement. That’s the one that when I first saw it I wasn’t sure what that meant. I thought of the beanie baby, where it gets retired or thrown away. Do you take your user profiles and put them up on the shelf when you are done with them? Or pull the poster down, or whatever the case may be. How does that play out with a product that has a product for say one target customer that they are working with over a number of years, say five or ten years. Do you just keep refreshing the persona data or do you literally throw them away and start all over again and then its time for another product to be launched at that target audience?

Tamara Adlin   I love the analogy to beanie babies. No one has ever said that before and I think it’s great. Let’s pull that analogy a little further. Maybe you grow out of your little lion beanie baby. Maybe your company has launched a particular product and now they are moving on to something new, which is related to the old product, but it’s not exactly the same. Or maybe they have been working on the same products for many years. Or maybe they are working on B2 of a product. And so that’s analogous to maybe you grow out of loving your beanie baby by just putting it on a shelf. Or maybe you just stay in love with it like the Velveteen Rabbit so it becomes real. So anyway, to get more concrete about this – its retirement, reuse or reincarnation. Either you are moving on to a product that’s not related to the first product that you created or you if you have made the personas come alive in the minds of your team you have to figure out how to undo that to be ready for the next set of personas. On the other hand, maybe you are going to do V2 or V3 or Version X of your product and you find that the persona has evolved a little bit. You’ve released the first version and now Mary didn’t know anything about online banking, and now maybe she knows a little bit about online banking and so now you are going to have to look a little bit at the data and how the world had changed and maybe she might have evolved a little bit . Reincarnate means well maybe it’s not Mary anymore, but maybe the data you used to create Mary might go into Meredith. So, every single time, what we suggest is to figure out what you need out of personas for the next round, how much you are going to have to introduce, new or revived personas. But at the heart of the effort you have to go through and look back at your raw data again and determine if it’s still relevant and how you are going to use that in the persona effort 

Frank Spillers   Okay. Let’s talk about the idea of personas. If you are not using the word personas you might be using user profiles or something else. Is that okay? There’s been a lot of buzz and what seems like a lot of hype over the last few years, less so now – but around 2002-2004 it seemed like everybody had personas, and everybody had a profile of their customers. Tell us a little more about the terminology of using personas.

John Pruitt   Sure. The concept of personas has been around for a long time. Longer than Cooper’s book which came out in 1999. Cooper re-conceptualized what personas were and also coined the term “personas” which popularized the idea. But abstractions of user’s representations of individuals that are related to groups of people but are caricatures of them have been around for a number of years. But really it began way back in industrial design with a book by Henry Dreyfuss (I believe). And this has gone on and been captured by various marketing folks in terms of representations of user segments and market profiles, user profiles, customer profiles in that regard. The flavor of what’s included in those representations differs. So for marketing purposes, not all of these include photos and try to make the customer feel extremely real, or realistic and have a personality. But they all capture essential information about who your target audience is, so that you can do a better job of decision-making with those users in mind.

Frank Spillers   So how about data-sources then. This is something in my side-bar that I felt was a very important issue in terms of differentiating where your data comes from when you fill the persona or user profile. Is it enough to take your marketing demographics for example this is Charlie, he makes $70-75K, he is 30 years old and likes to play with gadgets. Is that enough? Or does that have to come from ethnographic studies, such as a day in the life, two weeks, five week, five month studies with the target audience and getting deep into their behavior.

Tamara Adlin      We had really rich conversations about this over the years that we worked together on this project. In fact, one of the first debates that John Pruitt and I had was what data you actually needed for personas. So the way I would answer this is that it’s always best to start to create your personas out of richly varied data. In the best case scenario you have ethnographic research, you have market research. You have research from the US government on the behaviors of people similar to the people that you are targeting. You have a huge range of information. However, what I think we found is that the focus that personas can give you is so valuable in an organization that even if you base your personas on raw assumptions, or create what Don Norman effectively called “ad-hoc personas”. Which at the very least get everybody aligned in their assumptions about the users. If you asked around in your organizations right now, for people to describe the user that you are targeting, you would be surprised at how much variety you would get. So even if you just align the assumptions in your organization, personas can be incredibly effective because the focus outweighs any of the risks of them not being “correct”. However, the more data you can use, certainly the better. Certainly for buy in, and certainly for comfort in the entire organization in focusing on the personas.

John Pruitt     I want to add something, going back to your original question there as well. Part of what Alan Cooper really added to the notion of customer representations, is making them real and giving them personality and substance. And in Alan’s case in particular, there’s a big focus on making sure the personas have goals, aspirations and motivations behind why they would be using your product, and what do they do in life, and what matters to them. And I think it’s that human-ness that personas have, that take them way far beyond other representations like market segmentation and user classes of those kind of thing. There become very powerful proxies for our customer targets.

Frank Spillers    So for example, the agency “Organic” has what they call a “Persona Room” and they have developed a scenario of the person. They had a stage designer come in and build a living room. I don’t know what they are trying to test or trying to create, but the idea is to bring the design team in to empathize and build out. What Levis (the jeans company) does is conducts studies and recreates the closets of people. From their ethnographic fields they will come back and rebuild the teenagers’ closet in their offices, and use that as a tool. The criticism that some bloggers have made about Organics personas room is that they never mention that their persona recreations are built on real data. They are not gathered from any type of user intercepts or interviews. Is it enough to emphasis like that, to just say we are going to emphasize and we know our customers. Or do people actually need to budget for field studies and spend the money to go out there and touch base and make contact with their customers and really get to know them and their goals and so forth?

Tamara Adlin    It depends on how advanced the organization is. You’d be surprised how many organizations out there are still doing very self-centered design. They are just thinking about what they would want. If that’s the case, then anything that could bounce you out of that self-centered design, at least to have a little bit of empathy with your target user group is better than what you were doing before. If a company really does say that they are doing user centered design, they may or may not actually be doing what we call tree user centered design where you really go out there and gather a lot of data. The purpose of personas with respect to data: one way to start thinking about that is to make the data useable itself within the organization. The job of developers is not to analyze customer data. The job of developers is to develop. Our job as customer centered design folks or user researchers is to do that research, and get it to those developers in a way that will actually enhance their daily work and inform it with data. That’s one way to look at personas. As a communication technique. And of course, to your point: in some cases in some organizations you really have to be able to say, hey, here is the raw data. You want to go take a look at it, take a look at it, you’re more than welcome to. And we suggest that you make the raw data available within your organization, say on an intranet site. Once people do that once or twice, they tend to start trusting the personas a lot more. They don’t really want to read all of the raw data. They just want to know that you’ve read all the raw data and interpreted it wisely in the persona.

Frank Spillers    Is there a credibility issue there John Pruitt, with regard to where the data comes from say for example in a Microsoft type environment?

John Pruitt     Absolutely. So, when you create assumption personas, which we think are extremely useful and powerful, we also think you need to make sure it’s clear that these are assumption personas. So, you always want to maintain a sense of credibility, in terms of how far can we push these things and have our assumptions been validated in any way. So, credibility for the personas is something that does come up and we have a slide later on in this deck where we talk about some of the issues with personas and maybe we’ll come back to that in a minute. One thing I do want to add related to going out and visiting customers. A really powerful thing that we have seen happen with personas is that once you have the personas in place and the team starts to become familiar with them, then part of the communication plan we think, should be going and finding out real representatives of those personas. So if you have the Abby persona or the Patrick persona then you recruit some of those for either field studies or lab studies. You bring them in or you go out and visit them and you bring your team along with you tell them “Okay today we are going to go and see two different Abby’s. And one of the Abby’s is a man, surprisingly enough”. And they see these instances of the persona in real life. Every time I have seen this happen your team mates go away thinking “Man, that guy was such an Abby, I can’t believe it”. It brings the persona all that much more into focus and really helps people understand who the persona is, and what the essence of this persona is.

Frank Spillers    So, it’s a little bit like a usability test where if you bring in your team or your executives and have them see, hear and feel the user struggle and succeed its much more powerful than a report or a graph.

John Pruitt       Absolutely. And in fact what I’m suggesting here is that on top of that you call your participants by the persona name that they represent. So we do that as we bring people into lab studies. We say “Today we’ve got two Patricks’ and a Sandra and an Abby”. And when we report our findings back we say things like “The Sandra’s had these kinds of issues or reacted to the prototype in this way”. And it really is a powerful thing.

Frank Spillers     So let’s talk about why personas work. With reference to the naming of them, how effective have you found that in your own experience. I want to share an anecdote before I do. On a recent blog posting the former Microsoft blogger Robert Scoble on his Scobelizer blog was talking about the ditching of the name whatever it was. The blog post was called “Ethically Bankrupt Personas”. If you follow the interaction of the developer and Scoble, basically they are getting hung up partly on the name and the naming of it. They say “Let’s get rid of Eric or Bobby” or whoever it was. Do you find that people get attached to names, faces and races? There was an issue with Cooper that came up a few years ago and someone was asking “Should we include different races?” What’s your personal experience around the effectiveness or the confusion around that?

Tamara Adlin   I think that’s actually really funny. Because all of the people on that blogpost I looked at are using the name which means that the persona is actually working. But the fact that they are saying “Let’s get rid of Mike” or whoever, means that they all realize there’s a Mike and they know who he is. If they want to get rid of him that’s one thing. And they know about Mike versus Saundra versus Abby or whatever, but the alternative would then be saying “the administrator” or the user.

John Pruitt     Or not talking about users at all.

Tamara Adlin That’s right. So I love that. So if they don’t like the name, if they don’t resonate with the details of the persona that’s one thing. But that’s a very different level of conversation, much more detailed in terms of users and goals, than it would have been if they had said “I don’t want to talk about the user” which never would have happened. That kind of debate with developers is delicious.

Frank Spillers     Is that one of the outcomes of persona process is to get that dialogue going about the users

Tamara Adlin   Right. All of a sudden you are having that discussion about the users. I just think that blog is one of the best arguments for personas that I have ever seen. The fact that developers are saying lets get rid of this one. And there is a big debate about stereotypes and about racial equity or gender equity in personas. But I think the key is to remember that you’re trying to capture real human goals, needs and behaviors. And if those goals, needs and behaviors vary according to gender or race, I mean when you are talking about a system for people to enter their password into a US immigration server, then yes. I think ethnicity, background and language totally matter. If you are talking about some other type of software or some other website, maybe they don’t matter at all, right? So, online banking, a US online banking system, does gender really matter? I don’t know. I would doubt it.

Frank Spillers   So since personas are grounded in behavior, they typically tend to generalize based on behavioral attributes. And in the book there is that separation. In fact early on in the book, one of the sidebars that I contributed to was the distinction between a marketing persona and a design persona.

Tamara Adlin    That’s right. Marketing personas are for targeting. They are asking things like what magazines does this person read? Where should we advertise? How should we let them know about this new product? Which is very different than saying what goals do people have when they actually use the product? And if you are doing marketing then you need to know the age range, the gender, in many cases perhaps ethnic background, depending on the product. That’s why marketing and product design are two different animals. It’s a different set of needs.

Frank Spillers    When I get asked that question in persona trainings the way I usually answer it around should we use races and different genders is that generally personas are descriptions of behaviors that are extrapolated hopefully out of real and concrete user observation in their settings. It’s the general practice to have diversity and to have awareness of different races and genders and abilities and to include those. I’ll even do that just as a way to remember who I’m serving. One of my users is an international user for example. So I’ll include someone who is not North American just as a reminder so that when I am presenting the data, so that I can say “Oh yes and by the way the user in this country, in  China or in India, struggles particularly with these localization issues for example".

Tamara Adlin    Yes. And in that case it doesn’t matter.

Frank Spillers    I think we have a question. Let’s take our question now. Then we are going to move into case studies. I have just been putting up a few slides there with a quote from Alan Cooper about designing for one person or audience. There have been some really interesting questions on the Internet related to “BaseCamp” the project management tool. Should you design your user needs or should you just design to a general audience. Too much to get into in this discussion though. So here’s a question: “Have personas been proven to be the best design and/or marketing strategy tool versus more standard design techniques which view the customer base as being more diverse than a single persona and thus segmented accordingly?”. This is segmentation versus behavioral slicing issue: “Are there concrete measurements of the success ROI for implementing personas versus traditional design marketing approaches?” This is a great question.

John Pruitt   Yes, great question. So the answer is – are personas the best method? There is no data out there that says they are the best method. In a certain way I wouldn’t ask a question that way. The reason is because what personas are is a way of getting your team focused on end users. I really think the best approach is to think of them in a supplemental way to other user centered design work and other proven market research efforts. We really believe that the best personas, start with good market research and segmentation data. You then build personas from a variety of additional data sources including qualitative field research and the graphic type research to really get a good rounded view of what your end user is. So, describing personas in that way is supplemental. They are not just a single method. Because they can also be applied to a lot of different aspects of your development process including early on decision making, some aspects of product design including visual design and styling. They can influence and be a part of the marketing and messaging. They can be part of documentation. So, because of their multiple applications, it means their ROI can be measured in different ways as a part of the product. So can they affect your bottom line in improving sales of your product, or decrease support costs for your product and calls to the product support line and those kinds of thing? Yes. And there are case studies that have shown personas influencing bottom line dollar, support cost, ease of use, and those kinds of things. They also have broader effects which are harder to measure. Personas can act as a lever to get our catalysts to get more user centered design activities into your organization overall. So it’s like a foot in the door technique. You get personas in, and people resonate with them, and they start discussing customers. They kind of like what they bring. And then this gives you the leverage to say “Hey, let’s do some further research or do some user testing. We’ve never done that before. Or let’s do a focus group, or let’s do some user survey stuff”. We’ve seen lots of cases where personas actually influence your entire organization towards a more user centered design approach. 

Frank Spillers    Yes. I suppose you have had a lot of people writing in as well with all the contributions you’ve got in the book. There are literally dozens of examples of that shared where you can see people are using them. I think that point was really important and thanks for the clarification and expanding on that John Pruitt. I get asked that question a lot myself. People confuse my enthusiasm for personas for a trumping of market research. Its not that personas are better. What you are seeing in the marketing world in the last five years or so, is marketers exhausting their traditional market research design techniques because we are trying to achieve standards of usability, ease of use and user centered design that require usability and behavioral research methods such as personas. And that’s really the point. If you want usability, then don’t use marketing techniques like focus groups and surveys alone. Add to those and expand on those. That’s where a lot of marketers are getting very interested in persona methodologies and behavioral research. This is a good point to talk about case studies, so let’s talk about case studies for a minute. Can you talk about some of the more interesting ones?

Tamara Adlin   One other quick point before we move onto that. Part of that last question should also be about are they (personas) better for design. And I would say this real quickly. It’s almost impossible to design a product for 35 – 55 year old women. I mean what design decisions are you going to make that really have to do with navigation and clarity and consistency across the user interface for a range. But for a specific person, if everybody in the organizations with the thousands of tiny decisions that get made every day are all focusing on the same person, then you are more likely to come out with a product that makes sense from end to end and is internally consistent. The value of that is enormous and it can not be achieved with ranges. So traditional market data does not help with that kind of consistency.

Frank Spillers    Let’s talk about bottom line stuff then and persona lifetime achievement or ROI. Can you lead us into a couple of the case studies that are in the book that are most interesting – the Medco and the Best Buy studies.  As you put this book put together, what have you heard and seen in terms of companies profiting from and the evidence of ROI coming straight from the efforts of personas? Tell us a little more about that……

Tamara Adlin  Well, like the slide says, the ROI should be measured in terms of improvement to your bottom line. More people should buy the product and use it and like it should cost less to support. But there are also improvements that are worth an awful lot of money. That can happen in terms of your team and your company and you internal process. So what we recommend is that during family planning you identify what the problems are that you want to solve with your persona effort. These could vary from organization to organization. And then during the ROI phase you actually measure those and see what kinds of results you have gotten. And now I can turn it over to John Pruitt to talk about the Medco Health case study.

John Pruitt
   So with Medco it was actually with a website that they had applied personas to www.medcohealth.com  What they did with personas was redesign their main site to navigation. What they found was a 33% increase in transactions, they had less abandonment. They also had more prescriptions being ordered online which is pretty incredible. Those are really solid numbers. Moving on to the next slide. I like this example here as well because in this case it wasn’t about building a software product, which is what I think about most of the time. It wasn’t about websites but it was really about the physical layout of a store. The fact that these guys did some really good market research and then did some good ethnographic research and then built personas and then took them really seriously and went out and redesigned a fairly good number of their stores. And then they looked across these test stores compared to the rest of their stores and compared what was happening with sales. The test stores were showing an average of 7% more in sales. Those are some great numbers. It’s not a 100% clean experimental design, but both of these case studies are good examples of showing improvement in the bottom line of your product in places where it impacts your dollars. We’ve got other cases outlined in the book and I’ll just name a few that are interesting: The dish maker “Pfaltzgraff” did some really great work with personas, not only redesigning their website but also rethinking about their actual plate ware and what they were doing as products. And also how they are presenting the website, how they are presenting the catalogue and how they go about selling those products. So that’s a really great case study.


There’s a good one in the book about a game maker company in that went from redesigning their website using personas from which they basically went from having zero sales of their game products through their own website. When they did the redesign, they discovered through their customer data, that who they thought their real customers were, was in fact way-off. They discovered that their real customers were mostly women who were playing these casual games.  So they redesigned with those personas in mind. They created two personas with the redesign in mind and saw an incredible rise in the magnitude of downloads of their product and eventual sales of their games to these customers. This is a really powerful example of putting your user first and really thinking about why would they come here, what are they going to do, what do they get out of it, and positioning and designing your product in that way.

Frank Spillers      We eluded to some of the best practices throughout about how personas can be used and evangelized and so forth. And whether they are hype or helpful, used or misused in an organization. And we talked about assumption personas. Let’s turn to best practices here. Do you document cases in the book about efforts that didn’t work?

John Pruitt      To talk about that, could we move to the slide. It’s the one where there’s a clown on it and it says “Personas are Powerful”. We found over the years, particularly early on when things were just catching on, though it still happens today, that persona efforts are not always met with success. You go out and create them and they just sort of die. There were four main themes that came out of us looking across a lot of case studies and working with companies that had done them, and talking to practitioners. Those four things are: firstly, lots of personas are done as a grass roots effort. So a few people on the team get fired up about the process. They have read Cooper’s book, or they might have read our book and they then start to do it. And unless you get good support, not just from upper management, VP’s and the like, but really I mean support from the influential people on your team. And a lot of time the influential people are just your peers. And so, picking out the peers are really key to having a really successful user centered design effort and getting them bought into personas is a key thing to overcome.

The second thing is that in a lot of cases the persona characters themselves were just not believable. In some cases they are designed by assumptions, by groups of people, who create them. And in other cases, they were based on data but the links to the data is not clear. So, we outline ways to combat this in our book. The essence of this is that you do have to care about credibility. And you do have to make sure that your personas, when they are based on data, that it is clear. And you should always go back to data. Once you create them, we believe that you are not done. You have to validate them and continue to update your understanding of them. The third reason why personas fail is simply that they are not communicated well. We have seen lots of cases where personas are created and a little poster is made. It’s put on the wall, or a few of them are scattered around the walls of your building. And then you’re done. We found that your really have to treat personas as a communication campaign that you launched and then you launch them with the notion of progressive disclosure of information that can’t learn about every aspect of your personas immediately. It’s just like getting to know a real person. When you first meet someone you are lucky if you remember their real name. You hopefully remember their face, and maybe what they do a little bit. But you get to know them over time and then you start to develop a relationship, trust them and ultimately good friendships have lots of influence on you when you really know somebody. And that’s really the way personas need to work. When you communicate them in very explicit ways over a period of time during your development cycle.

Frank Spillers     We are getting really close to the end of our time here. Just to say, the book, that we are discussing here, the issues and themes of the 725 page “Bible” as I would call it, can be picked up at www.amazon.com . It is a Morgan-Kaufman publication. It runs around $55-$60 and you can search Google for “Persona Lifecycle Book” and you should get a number of links directly to the book. Its definitely worth the money, and it probably pays for itself through results over and over again in terms of keeping you on track. Even if you are as seasoned practitioner or if you are new to personas this book will come as a breath of fresh air. I have definitely been recommending it on my trainings as well. As we wrap up here in the theme of the lifecycle tell us a few things to consider regarding the lifecycle framework. What are some of the things that people should keep in mind?

Tamara Adlin       Well I think its everything that it says on here. It’s just another method. Our book is long partially because we want to talk about how you integrate this with other methods that you are doing. And a big take away from all this is – doctor heal thyself. Think a lot about yourself as a user centered designer and think about how you are making your own work usable within your organization. It’s not a one size fits all process. There is benefit even if you just do a little bit. And you should be systematic and strategic in your approach. That’s really what it is all about: making yourself and your own work usable to the people who are consuming the customer data that you are bringing in.

Frank Spillers   Okay, great. And just here as we are wrapping up a few questions. We have already taken a few as we have gone through, but here’s one. “How many personas are needed” one person is asking?

Tamara Adlin   Short answer is it depends…..which is always the short answer. Basically, we talk about looking either at major roles, or major goals or segments in your product. And typically a lot of companies have a way that they are thinking about this. Maybe they are thinking about the audience or the presenter. Or maybe they are talking about the person who plays it economically safe, versus the risk-taker. You are really looking for the key differences that make a difference. So you are looking at prioritizing anywhere between one, two, three or four personas in typical projects. The rest of it really depends on the data you have on the product that you are creating.

Frank Spillers     Okay, another quick question here. Have you ever seen a design team use a real persona to represent, act and think like the persona.

Tamara Adlin   Hire an actor I guess!

John Pruitt     Or we have also seen some cases where companies have identified a target user and said “This is a great example of our key customer”. In that case they keep going back to that same person. It’s a dangerous thing to do. There was also one company that we worked with where there was an individual in the company that served as the persona. That person did a lot of user research and their job was to “be Bill” or whoever that persona was.

Tamara Adlin      Part of our validation process is going back to the users at the end of the project and seeing if they really start acting like the personas. That’s what you hope will happen, that you were right, and that these are the goals and this is how the product will satisfy those goals.

Frank Spillers    Great. Well we are actually up on our time here. I want to thank you both very much. This has been a most interesting and valuable session here. Thank you John Pruitt Pruitt and Tamara Adlin Adlin, authors of “The Persona Lifecycle Handbook” that is definitely worth the $50-$60 that I think it’s going for out there. This seminar will be available for archive playback and in addition to that John Pruitt and Tamara Adlin will be presenting a workshop on personas at the Neilson-Norman event in October in the US and London in November.

Tamara Adlin   People can get in touch with us anytime. Just email us and we’ll be happy to talk to you.

Frank Spillers    Email is up there on the screen right now. John Pruitt’s email is jpruitt <a> microsoft <.> com and Tamara Adlin’s is tamara <a> adlininc <.> com. Finally, I want to thank you guys so much for your time and you insights. This has been really great and we look forward to hearing more from the stories that you gather as you interact with more practitioners. And hopefully there will be a follow-up book in a couple of years. For those of you who may be interested, we may have John Pruitt and Tamara Adlin on our regular web seminar courses coming up so stay tuned to www.experiencedynamics.com or hop on  the email list there and we’ll keep you posted. Thanks a lot and enjoy the rest of your day. 

End of interview.

This seminar is available with the slides and audio presentation here (requires brief registration, privacy protected).

Best Regards,
Frank Spillers, MS

October 03, 2005

Web 2.0: A glimpse into the future?

Web_2_conf_1
What is Web 2.0? (as of Dec. 2005)

A new approach to web and web application development that is characterized by:

  • Web sites offering free (cool) web services and tools (examples below);
  • Open source code (open API's)- software code becomes a viral marketing tool;
  • An enhanced user experience afforded by new approaches to information sharing and use of existing/new web scripting technologies;
  • Giving users the ability to share their opinions, media or to offer back to the community aka "The Architecture of Participation" (see Wikipedia's Web 2.0 definition) or peer-to-peer goes mainstream.

Web 2.0 seems to have taken flight in the last 10 months related to:

  • The rising popularity of social networking websites (like MySpace); online dating sites (like Match.com) and social networking sites (like LinkedIn) that create more emphasis on the "Social Web".
  • Google's rising influence and use of new ways to present a map interface (Google Maps; Gmail; Google Suggest). And Amazon, Microsoft and other big players are working on what will be central to the "Web 2.0" user experience (i.e. Tagging in Amazon and RSS web feeds in IE 7).
  • Yahoo's positioning as a stakeholder in Web 2.0 with it's acquisition of Flickr photo sharing and del.icio.us social bookmarking services and hiring of key "Social Media" executives to spearhead the new effort. "Sharing will be everywhere," said Jeff Weiner, a Yahoo senior vice president in charge of the company's search services. "It's the next chapter of the World Wide Web". FYI: Fortune magazine ranks Yahoo! as #1 in 100 Fastest Growing Companies with a 78% revenue growth rate.
  • The shift in the one-way broadcast or publish model to a two-way flow of information where consumers are active creators in content aka User-Contributed Content (Experience Dynamics web seminar)....or what former US Vice President Al Gore calls "We Media" (see We Media 2005 Conference website).
  • A new momentum largely coming out of San Francisco; largely made up of former dot-com enthusiasts (sober but dreamy)- and a significant amount of Venture Capital dollars financing  Web 2.0 infrastructure.
  • An annual conference called "Web 2.0"(in it's second year) sponsored by O'Reilly Media (see Tim O'Reilly's What is Web 2.0?).

A word about hype

Is Web 2.0 just hype? Many large organization including Yahoo!, Google and Microsoft are investing heavily in the technologies and projects that are driving Web 2.0. If you loathe hype (as I do), perhaps you should see it for what it is: Hype seems to be an expression of the excitement generated by something new; it is often careless, clumsy and poorly thought out- but it's real purpose is to excite and ignite the feeling of change, progress and newness.

Having said that, I think this interesting article by Russell Shaw at ZDnet, is refreshing in terms of putting the Web 2.0 "hype" into context:

"Web 2.0 is bunk. Not that the elements of this rebirth aren't there. I write about some of them, and Richard has them nailed. It's just that they cannot be classified under a common umbrella. They are forward lurches of various standards and technologies, some compatible, some not. Some revolutionary, some evolutionary, some impractical. Some are collaborative, others are highly competitive with each other".

What's New with Web 2.0 as a technology shift?

What's different about this technology curve is that this time, user experience is on the agenda, despite the fact that Amazon's Jeff Bezos sees Web 2.0 as "about making the Internet useful for computers". (Amazon's focus is on creating viral API's with Amazon Web Services). To give Bezos credit, he also has said,though not in his Web 2.0 related interviews,...

If there's one reason we have done better than most of our peers in the Internet space over the last six years, it is because we have focused like a laser on customer experience, and that really does matter, I think, in any business.

Some Dominant Web 2.0 Themes

1. "Mash-Ups"- using others code (e.g. many are using Google Maps) and sharing your own code (e.g. Amazon is trying to provide code) to create a new application or web service such as: London Terrorist Attack map; eBay Motors & Google Maps; Zvents events site; Trulia real estate search;

2. "Tagging"- letting users create categorization on the fly with "tags". The goal is to help create more personalized, context rich search and categorization. Encouraging users to tag, like Amazon is doing currently, helps create better search. Some sites that tag or promote tagging: TagWorld; Tag Cloud; Technorati; 43 Things, del.icio.us (Yahoo!).

3. "User-Contributed Content"- letting users comment, rate, add content or media such as photos, videos etc. Becoming a standard in online newspapers and blogs. Some sites that promote user-contributed content: Judy's Book, Insider Pages; PriceGrabber; IRV2; BBC News, TripAdvisor.

Even conversations are occurring with regard to using the social web to make advertising more relevant.

How Users and User Experience Will Benefit from Web 2.0

1. More Competition Will Improve the Overall Web. Free services and an open source model that is going mainstream will mean more improvements aimed at remaining competitive. Google Maps and Google GMail (two "Web 2.0" applications) have pushed mapping and free email services into over-drive, not to mention desktop search.

2. Better Web User Interfaces Will Improve Subjective Satisfaction. Potentially being able to do more natural interaction (such as drag and drop or zoom) will give users a more intuitive way to interact with data. A focus on sharing will make the web seem more close to home or to a social circle (existing or created). Tagging will potentially create a user-centered "information architecture" that relies on context, semantics and personal labeling systems or so-called "folksonomies" rather than hierarchies or taxonomies.

3. More Trust and Credibility from Institutional Sources. Allowing self-publish or two-way publishing will give users more control, power and choice of data and opinions, views and decision-making resources. Blogs and ways to better integrate or share text, video and audio blogging will change what it means to be informed about a purchase decision or a visit to a destination.

Bottom Line: Web 2.0 seems to be reflecting the changes in the world and the way the current generation of web innovators interpret and re-purpose existing and newly used technologies. Web 2.0 or whatever you call it, is already here. For example Public Relations and Marketing savvy people use del.icio.us to monitor buzz; Technorati to track blog feeds and Epinions to monitor customer criticism, wants and needs. Pay attention to what is happening in Web 2.0, because it represents change at a micro and a macro level and whether you notice or not, change will affect your site whether you like it or not.

Best Wishes,
Frank Spillers

Good Follow Up Reads:

Web 2.0 and the Long Tail (Chris Anderson- Editor in Chief WIRED magazine)

Relax, Everything is Deeply Intertwingled (Adam Rifkin)

Are you ready for Web 2.0? (BayCHI panel -Audio program)

January 25, 2004

Patenting usability improvements- going over the top?

Summary: Questioning Jakob Nielsen’s recent advice about competitor data and his advice to patent usability best practices.

Slashdotters react to Jakob Nielsen’s recent column. And they raise some good points:

• "The reason this logic doesn't follow for many software engineers and software patents, is that the stuff that gets patented is sometimes simple, and a horrible waste of cycles and time happens globally as people work around the patents".

• "Usability is required on *all* sites, not just the ones that have the resources to patent everything".

• "So if I come up with a great usability enhancement, I should patent it? How does that increase the usability of the web overall? We live in a sea of unusable web sites and horribly designed programs.. now he's saying "hey, the goal is actually not to make web sites more usable. The goal is to come up with usability enhancements that one or two web sites will use. The other sites can go stuff themselves."

• "...is just going to be a directory of patents? Just swap out any point where there is actual usability advice with the relevant patent number and you're done".

The key issue here, I think, is that Jakob Nielsen has an unhealthy monopoly on Usability Consciousness. He promotes best practices, he preaches obedience to his guidelines and when he postulates opinions they are interpreted as instructions.

More later on how this has eroded Jakob Nielsen’s popularity within the usability community.

Best Wishes,
FS