How we do user research analysis at the Heritage FundJo ArthurDoing Service Design at the National Lottery Heritage Fund

A write-up of a brilliant talk Jo Arthur gave at this month’s UX Glasgow event, where she outlined how the National Lottery Heritage Fund analyse user research remotely. I found it super useful, not least because this is exactly what we need to do at my work right now, and I have taken a lot of inspiration from this. Thanks Jo!

There will be no “back to normal”Nesta

Faded out aerial view of an urban area taken on a fisheye lens

This is more than a month old. In terms of the coronavirus outbreak, that’s an eternity. But I still found this list of possible future scenarios interesting and thought-provoking.

It also comes with the major caveat that predicting the future is a mug’s game at the best of times, never mind during these times. This is inherently recognised in the fact that some of the predictions are contradictory.

I was particularly interested in the political, economic and sociocultural predictions. For instance, I have wondered if in the coming decades society will prioritise getting the basics right more over relentless innovation. This article suggests that may be the case, but that the shift may not last long.

The crisis may prompt a reappraisal of what society cares about most, with short-term attention focusing on the bottom of Maslow’s ‘hierarchy of needs’. (This may have the effect of, for example, boosting relative status of health workers and farmers, and diminishing ‘luxury’ industries, including leisure, gaming, arts – although history suggests that this will be short-lived, and the luxury status of some goods and services may ultimately be reinforced.)

Ignore the customer experience, lose a billion dollars (Walmart case study)Good Experience

This case study would be seen by some as a reason not to understand users at all. “If I asked users what they wanted, they’d say faster horses. Hurr hurr.”

In fact, like the idea of faster horses, it demonstrates how important it is to understand your users in the right way, not just pay lip service to doing so.

Badly-designed user research leads respondents to certain responses. This is often unintentional — avoiding bias is difficult.

Sometimes it’s intentional. Perhaps the survey designer has a pet idea. They might (subconsciously) skew the questions in a certain way to get the answers they want.

A classic example is asking someone if they would like a certain feature to be added to a product. The answer is almost always: “Er, yes, I suppose so.” People think they like choice, so more features sounds good. But in reality, too many features — or too much choice — leads to choice paralysis and greater frustration.

The lesson isn’t to ignore user research. But be aware of your biases. Be wary of surveys as a methodology. And don’t simply ask people what they want. Instead, understand what they do, and why they do it.

Inside the 46-year journey to bring Aretha Franklin’s ‘Amazing Grace’ doc to lifeDavid BrowneRolling Stone

Still of Aretha Franklin singing from Amazing Grace

This film took almost 50 years to hit the cinema screens because the filmmakers inexplicably failed to use a clapperboard, making it impossible to edit until digital technology arrived.

The director was Sydney Pollack, who won 11 Oscars throughout his career.

“There were thousands of pieces of film with no edit points, and they were trying to sync it up to a tape recorder.” Hence the incomplete VHS and Hamilton’s invoice: He had been hired to match up footage to music by reading people’s lips.

Eventually, Pollack gave up and the hours of footage were relegated to vaults. “Sydney couldn’t really explain it to me,” Elliott says of when he brought it up to the late director. “He was a proud man.”

It seems like knowledge of this film was limited until recently, but a lot of people must have been seething at the calamity. I guess it’s a reminder that even the most successful people can make catastrophic mistakes in their field of expertise.

Undemocratising user researchSaswati Saha MitraUX Collective

A magic triangle: "Choose two between sustainability, scale and quality"

This piece really challenged my thinking.

In my job I am currently trying to figure out ways to make quality user research scale across the organisation in a sustainable manner. It’s like one of those triangular diagrams outlining three goals: “you can have two of these things”.

Working in such a large organisation, central resources inevitably have their limits. My desire is to empower others to carry out their own user research. Our role becomes an education role. How we do that remains an unsolved problem. Various attempts have yielded variable results.

But Saswati Saha Mitra, reflecting on her experiences of trying to democratise user research, suggests that it is a bad idea.

A researcher is a dynamic thinker who has to adapt their methods and questions based on who is in front of them, how much they have already learnt and what new areas could be probed on. This did not happen. We got a lot of verbatim and videos which after a point became repetitive and did not add more to the analysis. This then led to analysis paralysis.

I’m inclined to continue trying to empower others to conduct user research. But this article is food for thought.

We’re hiring a Senior Content DesignerWebsite and Communications Blog

View of Edinburgh Castle from our office

The University of Edinburgh Website and Communications team is hiring a Senior Content Designer. Come and join my team!

If you’re passionate about using evidence-based approaches to create great content that meets users’ needs, we want to hear from you.

Read the blog post to learn more about the position and how to apply.