Big Data keynotes at #svc2uk

The opportunity in data

On Friday I attended a fascinating series of keynote talks, followed by a panel discussion, about the opportunities for entrepreneurs to use open data. The talk was part of a series of events organised by the group Silicon Valley comes to the UK (#svc2uk). The panel was moderated by local angel investor Sherry Coutu and included:

Overall it was a lively discussion which was attended by around 400 people and watched via a live stream by students in Universities all around the UK.
Big Data keynotes at #svc2uk

First up was Megan Smith from Google, who talked about the opportunities for Google to open up some of their (huge) data sets via APIs, adding “providing privacy is maintained”. One example Megan gave was how the Google Books API had been used by Harvard researchers to analyse the trends in language in literature from 1750 to the current day. The word ‘women’ was apparently not used in literature extensively until the 1970’s, when its frequency of use suddenly rocketed. Megan also highlighted the potential for crowdsourcing data through social applications and the benefits of using Google data to inform the bio and life sciences. The example of trends in flu outbreaks indicated through searches for flu related topics in Google sprung to my mind.

Out of all the speakers, Andrew McLaughlin really stood out for me. Andrew was an advisor to the US government when he worked at Google. He then progressed to deputy CTO at the White House and is now the Head of Code for America. Andrew reminded us that we live in phenomenal times where there have been profound changes in the economics of information. He referred to the impact of internet based information on the relations between states and citizens. This is all too true when you consider how the ready access of information via mobile devices has fuelled significant changes in world politics in recent times, particularly in African and Middle Eastern countries.

Andrew cited Moore’s law and the impact that computing power has had on what we can do with vast data sets, both in terms of storage and processing speed. Coupled with the explosion in cloud computing capability, Andrew advocated the power of data to improve public services and drive positive changes for civic life. He also highlighted some of the challenges, for example data sharing and privacy.

Most interestingly Andrew recalled his experiences when he first started working in government. He expected to be able to drive performance management improvements using available data sets, but quickly found that no agencies showed an interest in making changes to enable data sharing and mash ups. However Andrew found there was appetite to open up data at a City level.

When the panel was asked the question, “which government data sets are most useful?” Andrew was quick to state that all public data should be freely available, so that people can find out themselves which are the most useful data sets, rather than having the decision made by those who manage the data.

At the start of the panel I sent a question by Twitter which I see as one of the biggest issues for anyone working with open data:

My question wasn’t answered directly by the panel, but DJ Patil did cover the topic to some extent. He talked about the challenges of turning data into a meaningful product. In other words, how do you make data useful and usable by people in their every day lives. DJ advised that application developers need to make big data “small and actionable”. He also advised enabling data to facilitate conversations with users, in order to improve data products.

Reid Hoffman was the only one of the panel to talk about linked data. He also suggested that every organisation with more than 20 people should have a technology strategy. By this he didn’t mean which determines what skills are the most valuable for exploiting the potential of technology and data.

The questions from the audience to the panel  indicated a general concern about privacy issues. Although I can see that there are huge opportunities for young entrepreneurs, I also hope that they use public data wisely.

As a User Experience practitioner I believe there are considerable obstacles to overcome to ensure that real world problems and user needs can be identified and solved using data driven applications. There is already an overwhelming amount of data available these days via APIs. But there is far, far more data that still to be unlocked and provided via API. This is most definitely going to be a growing area for UX researchers and designers to be involved in. And events like hack days and design jams can facilitate learning about how to realise the opportunities in data.

Share

UX adoption and maturity

In my current role I’ve spent the last 5 years getting usability and User Experience (UX) principles and methods embedded in the organisation. It’s been hard work and there have been lots of small victories and battles on the way. We’ve progressed from an annual usability survey to having a dedicated UX Architect role and standardised methods and tools. I spoke about our journey at a Software East event earlier this year.

I’ll soon be starting a new role as a UX specialist with a private sector company that has a strong committment to UX. So I’ve been reflecting a lot in the last few weeks about the process of getting UX adopted, and then embedding UX thinking and practise in an organisation.

Whilst we didn’t get as far as having a UX strategy, these are the main lessons I’ve learned in 5 years:

You’ll need a committed UX champion

For me personally it was really important to have a very strong interest and commitment to UX, in order to evangelise the benefits to the team and my manager every day. I was lucky to be well supported by my Manager and Director. The whole of our Web team are now committed to using UX methods and tools on all projects. Their interest and enthusiasm never ceases to amaze me!

However, it’s not always an easy sell. I work in a very large and complex, public sector organisation (local government). Even afer 5 years I regularly find myself having conversations with colleagues who don’t understand what UX or usability is and why it’s important to understand (and design for) customer needs and behaviour.

It’s all about the data

Using data to evidence and support design decisions has been crucial. I can think of many times when user data has helped support an argument. But make sure you present your data in a compelling way, using graphs, visualisations like word clouds (hat tip to Craig for showing us that one), screenshots and video/audio clips where possible.

Develop skills and create a UX toolkit

Mentoring team members and establishing a toolkit of standardised UX methods and tools has been important. We have very little budget, so we rely on low cost methods such as expert reviews, prototyping, and remote research tools and web analytics. When we managed to create a dedicated UX role, the first thing I asked the UX Architect we recruited internally to do was to research and create a UX toolkit. This was important not only to provide a re-usable set of tools and techniques, but also as a development exercise, to help the UX Architect get up to speed with what techniques to use and when and how to use them.

Although we can’t afford much training, books have been incredibly useful to us. They are relatively inexpensive and can go round the whole team. We have built up a useful library of UX books that inspire us and act as a good reference point.

Sketch and prototype, but keep it Agile and collaborative

I think we fell into the trap early on of trying to produce fancy looking wireframes and mockups. Prototypes were created in HTML/CSS to make them production ready. But given that we used the Scrum method, we could have produced a lot more design ideas and got solutions in place quicker during sprints by doing more sketching.

Measure and improve

Measurement of UX is probably the one thing we didn’t pay enough attention to initially. But measurement is extremely important if you are going to prove return on investment.

Process, tools and skills are all useful. But, they are really not that useful if you can”t demonstrate how you’ve improved a website or product. And Senior Managers don’t tend to be that bothered about the ‘how’, they’re more interested in the ‘what’. So make sure you have clear metrics defined to ensure UX improvements are tangible and measurable.

Aim to make small, iterative improvements

Ultimately we were never able to make many of the improvements to our website we wanted to, due to various constraints on resources. And being stuck with a legacy CMS system that was pretty inflexible.

There will always be many ideas and re-design work that customers never see and experience. So avoid too much wastage in the design process by concentrating on things you can realistically implement and use the evidence to make the business case for bigger improvements.

I’m very excited to have the opportunity to talk about embedding UX in a large organisation at UX Cambridge on 10 November. But I’d like to learn about other peoples’ experiences before my talk and gather some stories from out in the field.

I’m running a survey to find out more about UX adoption in large organisations until 28 October. By large I mean over 250 employees. But I’m keen to get responses from a variety of organisations, big or small, so don’t let that put you off completing it.

Please do take 5-10 minutes to complete the survey. I’ll publish the results here once I have done some data analysis. Thanks!

Complete my UX adoption survey

I’m very grateful to Human Factors International for letting me use their UX Maturity checklist for a number of the questions in the survey.

Share
Top Task management - an iterative process

Make users happy by focusing on top tasks

Most local gov webbies will probably already be aware that the focus of Socitm’s 2012 Better Connected review will be on managing top tasks and improving the user experience of Council websites. As a dyed-in-the-wool user experience fanatic I fully support this direction.

Whether your web team takes the Better Connected report with a pinch of salt, or work painstakingly to address all the reviewers’ findings, is neither here nor there, in my opinion. What is important is that Better Connected is aiming to address fundamental problems with the user experience of Council websites.

Now as a local gov web manager, I am painfully aware of the constraints we all work under as Council web teams. Resources and budget can be limited and Council websites can be sprawling, monstrous beasts to control, maintain and improve. And then there’s the governance issues and organisational politics we all have to deal with. Politics with a small ‘p’ and a big ‘P’. But with a bit of determination and a focus on top tasks, I think we really can improve the experience of citizens who have no choice but to Council websites to access certain public services.

On 15 September I attended Socitm’s top task event in London. I was speaking alongside Conor Moody and Kevin Jump from Liverpool Direct and (what an act to follow) the hugely entertaining Gerry McGovern. In the afternoon there were a series of workshops by the Better Connected reviewers and an RNIB accessibility expert. The event was put together by Martin Greenwood and the rest of the Socitm team.

In this context a top task is deemed to be:

the things that users come to your site to do most frequently

On a Council website examples of top tasks are:

  • finding out when your rubbish/recycling bins will be collected
  • checking school term dates
  • renewing a library book
  • paying council tax
  • finding bus routes and times
Disclaimer: in this post I may use the terms ‘citizen’, ‘user’ and ‘customer’ interchangeably.

Although I’ve given a similar talk before, I’ve embedded my updated slides from my talk below to provide some context for those that didn’t attend the event.


Here’s a quick summary of the main points I will take away from the event.

1. Don’t believe what users say, observe what they do through regular, remote user testing sessions

Gerry McGovern used a great example in his talk to demonstrate how easy it is for web professionals to think they understand how users behave, rather than observing how users actually behave. The two are often poles apart. I always love usability testing sessions because they are so eye opening. User testing gives your real insights into your users / customers and confidence in how to improve your website and web content.

But whilst we already do user testing, we don’t do it often enough. Recruiting users has proved to be time consuming and difficult. Gerry advised that we would be better off doing shorter, more frequent remote testing sessions using something like Go To Meeting to connect remotely to participants. This is something I’m pretty sold on now, having recently read Steve  Krug’s book Rocket Surgery Made Easy. If you’re doing user testing on a budget I would highly recommend Steve’s book. He famously has ‘a common sense approach to web usability‘ and provides very clear instructions, tips, guidance and checklists for user testing, which are all incredibly useful.

2. Get control of your content

Getting a handle on content governance is probably second most important thing we need to do to improve our website. If you have no control over what content is being created customer experience can really suffer. Devolved web publishing seemed like a great idea a few years ago. Complex content workflows were created with hundreds (I’m not kidding) of content, or CMS, authors and publishers, who are trained and given permissions to use the CMS. But where are we now?

  • We have thousands of pages and documents, making it increasingly hard for users to come to our website and quickly and easily carry out a task. As Gerry said confusing menus and navigation are one of the prime reasons websites fail.
  • Navigation and content development are not driven by user needs, but rather by the organisation’s perception of what users need. Web content authors and publishers need to own customer journeys. They need access to web analytics and customer feedback. They should carry out or observe user testing sessions to truly understand what customers need, what terminology they use and how they behave.
  • We have noticed that often web pages appear to be submitted for approval then approved almost instantly, showing that our approval process is not really adding any value to the process of web content publishing.

Re-gaining control of your content is not as easy as it sounds. We’re tackling this by:

  • Asking CMS authors who manage sections of the website to carry out content audits and identify what content to delete and improve. I’ve created a spreadsheet to do this based on the method outlined in Kristina Halvorson’s Content Strategy book and I’ll write a separate blog post in due course on how we’re approaching this.
  • Re-defining what kind of content governance is needed e.g. greater control through centralisation and defining specific processes and skills that are required.

3. Re-design your information architecture so there is just one way to navigate to top tasks

I have to admit this can be a daunting task, but more and more Councils are ditching the Local Government Navigation List standard and designing a top task focused IA like Liverpool City Council’s website. There may be similarities between the navigation on your Council’s website and other Council websites (or if you don’t work in local gov, on a competitor website), but you must remember website IA must be based on what your users need. So be inspired by similar websites, but don’t copy them!

Some of the methods we are hoping to use to re-design are IA are:

4. Don’t let the tiny tasks get in the way of the top tasks

“At night the tiny tasks go to bed and dream about being top tasks”

Gerry McGovern

It’s easier said than done, but as Gerry pointed out in his talk, sometimes the tiny tasks can make a customer’s journey on your website really difficult. They can also result in your customers mistakenly thinking they have got the right information to answer their question, when in actual fact they’ve got the wrong information. This is a disaster and when the customer realises their mistake, they are unlikely to trust your website again.

Kevin Jump highlighted how Liverpool have separated Council policies and strategies from service delivery on the Liverpool City Council website. Policies have to be on the site, but are in the About the Council section and don’t clutter up the top tasks pages of their website.

One of our biggest challenges is how we make our website work for customers, when it is also being used by our customer service advisers in the call centre as a knowledge-base. There’s a real conflict between focusing on making top tasks easy to complete for customers and providing information that may be useful to someone, but is only needed infrequently (the tiny tasks). Similarly you may have information on your website which is more aimed at staff and customer service advisers than customers.

Now don’t get me wrong. I’ve not got it in for tiny tasks! I don’t want to remove all tiny tasks from our website, because they have a use. But taking Gerry’s advice we are planning to use hidden pages to provide links to the information that doesn’t meet user’s top tasks (i.e. the tiny tasks). We’ll also aim to gather evidence through user testing our tasks on where the tiny tasks are harming top tasks. Along the way there will be compromises to be made, but hopefully over time we’ll achieve a solution that works for customers and customer service advisers.

Managing top tasks requires a lot of research and constant, iterative user testing and tweaking.

Top Task management - an iterative process

But the more you do it, the easier it gets.

Share
The Invisible Computer by Don Norman

The invisible website

The Invisible Computer by Don NormanRecently someone asked me what websites I like from a user experience design perspective. I couldn’t think. My mind went blank! Which struck me as weird, given that I use websites all the time and I’ve worked in web design and development for around 15 years. Surely some websites should stand out as being well designed, as being inspirational for having a great user experience?

Reflecting on why nothing stood out in my mind when I was put on the spot, I remembered a famous book by Don Norman. In ‘The Invisible Computer‘ Norman argues that good technology design should be invisible to the user:

The current infrastructure for personal computers has outlived its usefulness. Although it was well designed for the problems and technology of the 1980s, it no longer works when faced with the problems and technologies of the 21st century. Moreover, the technology of the personal computer gets ever more complex every year. There is no way out, for it is caught in the tyranny of its own success, of its own marketing, and its business model that demands ever more features every year, thereby ever more complexity.

The only way out is through a disruptive technology, through a break with tradition to a technology that becomes invisible, that starts off focusing upon simplicity, joy of ownership, joy of use: a human-centered development philosophy.

So rather than thinking about websites and web applications I admire for good design or inspiration, I reflected on five of the sites and applications I enjoy using and thought about what makes them a pleasure to use. Just as Norman proposed in ‘The Invisible Computer’, the fact that some websites are simple, and a joy to use, indicates they are well designed and a user centred design process is key to the success of the design.

Google Maps

Google Maps

I once thought “what’s not to like?” about Google Maps. It has some great features and a very clear interface. Street view is particularly cool and I can get lost for ages looking at random pictures. Using the ‘directions’ functionality is easy and flexible, suggesting the quickest route but allowing you to drag routes around on the map and choose other options or add additional places en-route. It’s easy to print add edit your maps. I also enjoy creating my own maps and using the API, Google Maps also integrates well with open source platforms such as WordPress. These days I tend to find myself using Bing Maps quite a bit, for the Ordnance Survey Maps and Birds Eye Views which are sadly not included in Google Maps.

Rightmove

Rightmove

In terms of house hunting Rightmove stands head and shoulders above the rest. Ok it has some quirks, but the home page is nice and clear, the search works well and the details and photos are laid out clearly. In terms of personalisation, I love the draw-a-search feature which combined with alerts and saved searches work brilliantly and makes house hunting a breeze. The mobile version of the site also works very well.

John Lewis

John Lewis

The John Lewis website is a stalwart of e-commerce sites. Faceted search that’s been configured to work well. Nice clean design. Good information. A bit like a visit to a physical store.

The Guardian

Guardian Data Store

I’ve always liked the current Guardian website. Especially the fonts. And the colours. I don’t know why, but I do. I also like the mouseovers on images, the ‘in pictures’ feature and the way that live news has been developed. The Guardian satellite sites have a good visual tie-in with the main site, so you never feel far away from the ‘mother brand’. I particularly the Guardian data store and some of the excellent data visualisations.

User Voice

User Voice

UserVoice is an ingenious social tool which has a variety of uses. Originally designed to enable a website or software user community to suggest changes or new features and vote for them, the tool has adapted well to being used for civic engagement or to generate ideas or concepts when collaborating with other people on projects.

So in summary, I found there are websites and web applications I admire from a user experience perspective, because as a user I enjoy using and interacting with them. They minimise frustration and maximise the experience of finding information, carrying out particular tasks or sharing and communicating with other people. Thanks to Don for that bit of much needed inspiration.

Share
Open-Personae-Blog-Post-300x111

Personas for open data

I’ve often felt that there is a lack of focus on user needs in open data development. But recently I came across a really interesting post that demonstrates a more user-centred approach to open data development. Tim Davies has blogged about how personas are being used to help developers of open data applications understand the type of people who might use their applications and typical user scenarios. In Tim’s words:

We’re creating a set of ‘open personae’ - imaginary profiles of potential users of applications and resources built with IATI data, designed to help techies and developers gain insights into the people who might benefit from the data, and to help provide a clearer idea of some of the challenges applications need to meet.

IATI stands for the International Aid Transparency Initiative and the personas are being developed collaboratively by volunteers involved in AidInfoLabs in Google Docs. Data mash-ups and visualisations can throw new light on complex social problems, by making data more accessible and understandable. But as Tim outlines the design of an application can often focus on the data, rather than user needs:

When open data is the primary raw material for a project, that data can exert a powerful influence in shaping the design of the project and its outputs. The limitations of the data quickly become accepted as limitations of the application; the structure of the data is often presented to the user, regardless of whether this is the structure of information they need to be able to use the application effectively.

Storytelling through a fictional ‘persona’ is a very powerful way to build empathy with users. It would be great to see the IATI personas being fed by demographic and qualitative research data over time. And structured to show specific user goals and attributes.

For anyone interested in the creation and use of personas and storytelling techniques in user experience, there are a couple of great books I’d recommend:

The User Is Always Right: A Practical Guide to Creating and Using Personas for the Web, by Steve Mulder;

and,

Storytelling for User Experience, by Whitney Quesenbury and Kevin Brooks.

Share
toptasks

Managing top tasks

Last week I was at the Building a Perfect Council Website 11 conference. When you manage a website with a wide range of content and services it’s crucial to focus on the main customer tasks and journeys. I did a workshop on ‘top tasks’ with my colleague Matt Godfrey and Conor Moody from Liverpool Direct. Conor shared some excellent insights on how Liverpool City Council’s website has been turned around by focusing on top tasks and content strategy. Our presentation focused on what data we have analysed to identify and improve our top tasks and UX techniques we have used.

Here are the slides from our talk:


Share
Council domain model

Using domain models in IA

Last week the Cambridge Usability Group were lucky enough to have Mike Atherton come talk about information architecture (IA). As a freelance IA, Mike has been working with the BBC for some time to help them tame a huge amount of useful content.

This talk was of particular interest to me. I’ve always had a fascination with how IA’s make complex information structures understandable and easy to navigate. I oversee the management of a large and complex site (a County Council website) which has a lot of varied content. And we need to look at ways to streamline it and focus on user needs.

Mike’s talk was titled ‘Beyond the Polar Bear’. If you have an interest in IA, you might remember the renowned O’Reilly book on IA by Peter Morville and Louis Rosenfeld that Mike was referring to. The main thrust of Mike’s talk was that IA has moved on and UX think needs to be applied all the way through a web project. Information just isn’t neat and we can’t easily categorise information using taxonomies.

Continue reading

Share
Cennydd Bowles

Cennydd Bowles – Designing the Wider Web

Cennydd BowlesThe Cambridge Usability Group was delighted to welcome Cennydd Bowles to talk on Monday 6 June. Cennydd is well known for his UX work at the agency Clearleft in Brighton, his involvement in organising events like dConstruct and UX London and his book Undercover User Experience Design, which he co-wrote with his colleague James Box.

The topic of Cennydd’s talk was ‘Designing for the wider web’. Cennydd felt that the focus on designing for mobile was a bit of a red herring and that the design community now have much more to think about when designing for the web. In Cennydd’s words:

“The wider web will enforce us to embrace diversity”

Cennydd stressed that we need to consider different use cases and whether a website or application will work on multiple devices and screens. He then talked us through some considerations when designing for the wider web including context, display, inputs, connectivity, eco-systems and finally summarised the impact this shifting landscape would have on UX design deliverables.

Continue reading

Share
Tony Russell-Rose

Cambridge Usability Group

I’m one of those people who can’t sit twiddling my fingers for long. So when I finished my MSc last year, I jumped at the chance to get involved in organising some local UX events.

The Cambridge Usability Group has been around since 2005 and was set up as a regional off shoot of the UK UPA. Over the years the group has organised a variety of talks, featuring speakers from the local UX scene and further afield. One of the more notable talks in the last couple of years was Ben Scheniderman who spoke about Information Visualisation.

The next talk is on Monday 11 April and we’ve got Tony Russell Rose, from Endeca Technologies, coming along to talk about how search interfaces can support users in a process of exploration and discovery. Tony has a wealth of experience researching and designing search interfaces and search design patterns. This is an area I’m increasingly interested in. My team manages a large and complex website (for a local Council) which is made up of a thousands of pages of content and a multitude of applications using different technologies. This presents us with a number of UX challenges when it comes to customers and citizens finding information quickly and efficiently.

The abstract for Tony’s talk is as follows:

Tony Russell-RoseThe landscape of the search industry is undergoing fundamental change. In particular, there is a growing realisation that the true value of search is best realised by embedding it in a wider discovery context, so that in addition to facilitating basic lookup tasks such as known-item search and fact retrieval, support is also provided for more complex exploratory tasks such as comparison, aggregation, analysis, synthesis, evaluation, and so on. Clearly, for these sorts of activity a much richer kind of interaction or dialogue between system and end user is required. This talk examines what forms this interactivity might take and discusses a number of principles and approaches for designing effective search and discovery experiences.

If you’re interested in attending the event, don’t forget to book your ticket on Eventbrite!

Share
UX-maturity1

User experience in software development

Yesterday I spoke at a Software East user experience (UX) event. I’ve not attended any Software East events before, so didn’t know quite what to expect. But the event was expertly organised by Mark Dalgarno and generously hosted by Redgate Software in their swanky offices (which reminded me a bit of Google HQ in London!). Almost 100 people attended, which is quite something for a mid-week event in Cambridge. I was particularly impressed to find out that one intrepid person travelled up from Kent!

I spoke about my experience of embedding UX at Cambridgeshire County Council which I’ve written about previously on this blog. I wanted to get across the sense that embedding UX is a long journey, but that UX techniques are not hard to learn, providing you start with small projects where you can demonstrate the value to your colleagues.

I also talked about how to use data to tell a story about your users and win over stakeholders in the business. And the importance of sharing skills across your team.

Here are my slides from the talk:

There were three other talks which I thoroughly enjoyed.

Things we learned when redesigning the Red Gate website, Stephen Chambers (Red Gate)

Stephen Chambers, the Head of User Experience at Redgate Software spoke about the re-design of the Redgate website. He started by showing the evolution of the site over the years and development of the product page, the most popular area of the site. As the product range grew, so did the page! But without much consideration to layout. Stephen also explained that in the past they’d struggled to get consistency between the main product areas of the website and that individual business areas were protective about their product pages.

Part of the challenge was getting the right environment in which to tackle a complete re-design of the website and dedicated resource. But Stephen managed to persuade his bosses to let his UX team take over a meeting room and work solidly on the re-design for 5 weeks – yes 5 weeks! At the council you’d be lucky to get a room of that size for 5 hours, let alone 5 weeks! One of the benefits of having the dedicated space was that the team were able to  move their computers in and put up all their ideas, sketches, wireframes and visual mock-ups on the walls, which improved transparency about the project. Colleagues could come in anonymously and scribble feedback on a post-it and stick it on a design.

Stephen also said this was the first opportunity the UX team had to work together, rather than on separate projects. And this helped them to make the most of their individual skills. There were some lessons learnt, such as not committing to hi-fidelity wireframes too early on.

The actual development of the site took around 3 months following the intensive 5 week design phase. One thing that struck me was the team’s creativity within the constraints of the project. The team used existing research, but I didn’t have the opportunity to ask Stephen if they’d done any user evaluation during the 5 weeks.

Why did you click there?  How to run 1-to-1 usability testing – Jenny Cham (EMBL-EBI)

Jenny gave an insightful talk on one-to-one, moderated usability testing for the European Bioinformatics Institute (EBI). Jenny explained she had come from a science background and was relatively new to UX. She demonstrated how it’s possible to pick up techniques quickly, but that you learn a huge amount through hands on experience.

Jenny’s domain is very specialist, so her knowledge of genome research and analysis of data was useful in designing realistic user tasks for her participants. This point highlights that in some instances using a consultant from outside your organisation would not be appropriate, because they won’t necessarily have the right domain knowledge.

I really liked Jenny’s use of photos and speech bubbles in her slides and a clip of user testing footage from Silverback. Her presentation really helped to convey some of the subtleties of user testing. For example the importance of good planning up front, during recruitment and when scheduling tests, having the right equipment and putting the participant at ease in order to get good test data.

One tip I found useful was Jenny’s use of a grid to collate findings and post-it notes (on the wall of the testing room) to summarise her research findings quickly. She advocated the use of super sticky post-its for this purpose!

Jenny had a wealth of experience to share, despite claiming to be a relative newcomer to the UX field.

Remote User Testing 101, Rob Kerr & Neil Turner (Cambridge Assessment)

Rob and Neil of Cambridge Assessment did a talk on the pro’s and con’s of remote, moderated and unmoderated testing. This is an area I’ve had an interest in myself and wrote about a while back, but at the council we’ve only had the chance to try remote, unmoderated testing.

Rob and Neil suggested various different testing tools that are either free or very cheap and can be used online. One of the questions from the audience was whether remote tools can be used for desktop software development rather than web. It seems that most tools are web based and therefore suited to web development. However Rob explained that remote, moderated testing was possible providing users remote in to your desktop (which does involve them downloading and installing some software on their computer).

Neil also demonstrated how Loop11 worked as a remote tool for testing user tasks, a tool I’m fairly familiar with having run some tests for our corporate website. I volunteered to do a live demo which involved using the Yahoo site to find out information on a film, whilst my actions were being recorded by the tool.

One of the things Neil pointed out was the importance of getting the task design right and piloting tests, as many of the tools (like Loop11) don’t allow you to make changes to your test once it is published and live.

And so ended a very successful evening. I enjoyed chatting to some new people in the break and after the event.

As a follow on, Mark is planning a UX conference in Cambridge later this year. I’ll be posting more details about the conference as soon as they are available.

Share