Categories
Innovation Product Research UX

Embrace failure: inform research using a Pre-Mortem

“I have not failed. I’ve just found 10,000 ways that won’t work.” — Thomas A. Edison

One of the most effective ways to kick off a new initiative is to identify how it might go wrong. Similarly, when planning research goals and methodologies, awareness of potential weaknesses can help to establish immediate learning goals.

The Pre-Mortem is a well-established facilitation tool for use early in a project life cycle. As with a number of similar tools, the Pre-Mortem makes use of future projection to address the present.

If you are unfamiliar with it, the activity works like this: an assembled project or product team is asked to imagine a version of the future, a number of months down the line. The project/product/feature has shipped… and has been an abject failure. It wasn’t bought, it wasn’t adopted — whatever failure looks like for the issue in question. The Pre-Mortem then asks, simply: What caused this? Why did it go so wrong?

Eject the elephant from the room

Using a Pre-Mortem, a safe space is created for doubts, concerns or apprehensions to emerge and be expressed as a concern for the future, not as a gripe about the present, even though that’s what it very well may be.

In any team, there are often strongly-held points of view that can seep out throughout the course of not just a meeting, but an entire project. A Pre-Mortem actively invites such thoughts and feelings to be aired. These might otherwise fester, emerging only when there is a bump in the road — “we could have seen this coming!”.

Providing a forum that permits individuals to voice and record their concerns allows these strong opinions to be aired and treated with equity.

“When people have strong feelings about the topic, they often think of the meeting as a contest where their view — which they see as the correct one — should prevail. That leads them to try to convince others that their solution is the right one.”

– Roger Schwarz, author of ‘Smart Leaders, Smarter Teams’¹

While gathering doubts and concerns is a positive step in itself, these can be actively put to work as experiments to find (in Edison’s words) the things that won’t work.

A whiteboard from a pre-mortem workshop, with inputs captured against points in a core user journey
A pre-mortem workshop, with inputs captured around points in a core user journey

Step-by-step

  1. Gather input on post-its . Ask participants to list 3 main factors that will have contributed to the project failing (online this can be done with tools such as MuralMiro, or Google’s free Jamboard).
  2. Group the inputs — take time to find commonalities in the contributions, and collate them into groups.
  3. Identify themes —it may be helpful to think about these 3 categories²:
  • feasibility: can we build, scale and support this — usually this will have a technical skew, but can apply to a broad range of resources.
  • viability: will this be profitable or advantageous for the business.
  • desirability: will customers find value in this.

4. Finally, devise small experiments³, capable of testing problems identified in each area. Be intentional about what you would need to learn, hear or see that will tell you your project will have difficulty succeeding. As a team, discuss the minimum amount of time, capital or resource required to test whether any of the issues represent credible threats to success.

Find what won’t work

If the issue is a real problem, how could you quickly test for it? Even modest pieces of secondary research, prototyping and competitive analysis can qualify, for example:

  • Discover if anyone tried and failed to build something similar before. Have they themselves or others written about their experience? Stories of failure are often well documented.
  • Put low-fidelity prototypes in front of potential customers or users. People testing low-fidelity prototypes are more likely to express negative reactions.
  • Evaluating a market opportunity is a multi-faceted pursuit. But even this can start with a simple examination of existing, successful products which offer similar features, and a realistic assessment of what is required to compete – and where you fall short.

These are rudimentary activities for sure. However, before massive resources are put into motion, such small experiments that address particular elements of risk can challenge flawed beliefs that a product will thrive.

By leveraging the combined wisdom of the team, then gathering corroborating evidence from external objective signals, UX professionals can contribute to de-risking an initiative.

Mitigating risk

The ‘flipped’ nature of the Pre-Mortem is important in establishing a critical mindset. Confirmation bias is a natural human tendency. We look for validation of an idea, and find false positives. Testing for confirmation of weaknesses introduces critical thinking and can counter inherent biases.

“Optionality works on negative information, reducing the space of what we do by gaining knowledge of what does not work.”

– Barry O’Reilly, Optimize to be Wrong not Right

Innovation cannot be manufactured on demand. Success does not follow from throwing unlimited resources and capital at the ‘big idea’. Having more successful ideas is more likely to come from more ideas — small bets — against which small experiments can be run to identify failure points.

No time? No problem

Time more than all resources is limited. If this is the case for you or your team, and follow-up experiments are not an option, try this:

  • Run through the Pre-Mortem exercise until you have a collated set of potential failure points.
  • Discuss mitigations around the issues. Look for actions that can be taken now to alter that possible future. Work towards an actionable plan in the event of anything coming to fruition.
  • Create a reference-able checklist, and review it at each retro or team meeting. If anything highlighted in the Pre-Mortem raising its head, go to your action plan.

Assuming that you have time for the Pre-Mortem itself, the very least you can get out of it is greater awareness. And that awareness can be codified.

Invest in failure

As you plan your stakeholder engagements and workshops, consider investing in a Pre-Mortem. It will typically take anything from 30–90 minutes, and it is capable of revealing that a project is partially or deeply flawed before it begins. For that reason alone it can prove invaluable to your team.


[1]: From ‘Eight Behaviors for Smarter Teams’ https://cdn.csu.edu.au/__data/assets/pdf_file/0008/917018/Eight-Behaviors-for-Smarter-Teams-2.pdf (PDF file)

[2]: From IDEO’s original ‘Three Lenses of Innovation’, introduced in the early 00s https://www.ideou.com/blogs/inspiration/how-to-prototype-a-new-business

[3]: Testing Business Ideas (Bland & Osterwalder, April 2020) is a fantastic resource for understanding how to run experiments against ideas. https://www.strategyzer.com/books/testing-business-ideas-david-j-bland

Categories
Innovation

Unlock innovation with an outcomes-first approach

Some recent reading showcased two simple and powerful ways to boost organisational innovation. Both are proven in their own right; combined, they can offer a robust, end-to-end method for exploring the opportunity space.

I first encountered Amazon’s ‘Working Backwards’ process in this Inc.com piece last year, which I stumbled across again last week.

The Working Backwards framework articulates, through a series of exercises and artifacts, the desired outcomes for a given project or initiative. Characterised by a narrow focus on customer needs, it is an almost literal interpretation of Steve Jobs’ quote from 1997: “You’ve got to start with the customer experience and work backwards to the technology.”

Amazon CEO Jeff Bezos suggests that constructing representations of the outcomes the product will deliver is a better initial investment than any line of code. It forces those outcomes to take centre stage, as a prerequisite to any discussion of implementation.

Done correctly, working backwards is a huge amount of work. But it saves you even more work later. The Working Backwards Process is not designed to be easy, it is designed to save huge amount of work on the backend, and to make sure we are building the right thing.” – Jeff Bezos


Similar themes emerged in another forum a few days later. I was in conversation with Jim Kalbach about his book ‘The Jobs To Be Done Playbook’ for UX Belfast.

As with Working Backwards, the power of Jobs To Be Done (JTBD) lies in a deceptively simple premise. Rather than assume that everyone involved knows the fundamentals around a project or initiative, it demands that any assumed knowledge is set aside, and insights rebuilt through the lens of customer goals, or ‘jobs’.

Typified in Levitt’s famous quote “No one wants a quarter-inch drill bit they want a quarter-inch hole”, JTBD offers a refreshingly pragmatic alternative to an all-too-common approach where, armed with technology, enterprises go looking for a problem to apply it to. To use a second tool-based metaphor, “When all you have is a hammer, everything looks like a nail.”

JTBD requires that an organisation shifts from a mindset of “how can we sell our technology to customers’ to “what outcomes are customers trying to achieve and how can we adapt to become more valuable to them?”. The book presents multiple techniques for reframing challenges in this manner.

Kalbach states: “Before creating solutions, define the value you’re going after. Regardless of the starting point for innovation in your organization – either with a need or with a technology – you’ll need to align around value creation.”

Mapping customer ‘jobs’ requires understanding their intent, their ultimate aims, and then strategically positioning your own solution into the process.

The two frameworks are eminently compatible. JTBD can provide the ‘true north’ for Working Backwards to navigate to.  And these are just two of many frameworks which can be combined to unlock innovation in an organisation.

I have shelves and devices filled with books and articles on thinking frameworks, gathered over the last dozen or more years. If these tools share a common trait, it is one of simple, structured questioning. So simple that it is often a challenge to have them accepted as a credible route to progress.

Asking basic questions can be seen as facile, but more often as an unnecessary obstacle as everyone rushes to get into the weeds.  It is significant, then, that Amazon and increasing numbers of groundbreaking tech companies give store to these techniques.

There may be no silver bullet for success, but there is a sure-fire route to failure – the inability or unwillingness to ask fundamental questions.

  • “What value are we creating?”
  • “Is this solving a real problem?”
  • “What assumptions or limiting beliefs are we working with?”
  • “What outcomes do customers want us to provide? What do those look like?”

Without the capacity to stop and address these kinds of topics, companies are doomed to pursue a ‘build it and they will come’ strategy. Sometimes that works out. Many times it does not.

The irony of the ‘Working Backwards’ moniker is that it makes much more sense than trying to create something from the ether, armed with nothing but assumed knowledge, some smart technology, and marketing muscle.

As suggested in the Bezos quote above, asking hard questions is not easy. Many enterprises bypass this completely and head straight for a comfort zone of technology first. Recent history is rife with impressive innovations that led with technology but failed to solve a real problem or deliver a desirable outcome. Just ask Segway, or Google Wave, even Google Plus. 

Both Working Backwards and JTBD encourage teams to forget the technology and instead focus on what customers want to achieve, and where value can be created.

Unless such fundamentals are addressed, there is no credible foundation for product development. And yet so many are prepared to take the risk and just build.

It’s hard to imagine anything more backward than that.

Categories
Innovation

Alignment above all

Technology may change rapidly, but the fundamentals of effective communication not so much.

The role played by clarity in achieving successful results should not be a surprise. What is surprising is how often it can be overlooked.

Regardless of its nature, the success or failure of any initiative will rely to a large extent on the degree of alignment amongst those involved. The question “what are we building” can yield as many answers as there are factions, and this is true of teams from enterprises to startups.

Executive decisions are rightly expected to be followed by action. But the fear that accompanies an instruction to proceed often kills the opportunity to think deeply about desired outcomes. Agile dogma tells us we need to move fast. The fear of being seen to not be moving can generate countless docs and meetings as attempts are made to assert the rightness of one set of priorities over another. Lots of noise, very little signal, and a dearth of alignment. 

The lure of consensus always looms large. After all, consensus can begin to get everyone moving. At its worst consensus is a form of groupthink. It may be capable of placating a fractious group and get them through to the next meeting. It is unlikely to impress customers however, who won’t care if you reached consensus, but will certainly sense a lack of alignment in the construction of their product or service.

Consensus is tactical; alignment is strategic.

Alignment involves orientation to a direction and commitment to a purpose. It can’t be articulated in purely marketing terms. Or design terms. Or engineering terms. And it must embody unambiguous support, across functions, to the aims of the project. Alignment should release every discipline to plan its contribution to clearly understood outcomes.

The good news is that achieving alignment is not alchemy. Any number of tools or frameworks can assist with driving a team, or multiple teams, towards an aligned state.

As both an exponent and practitioner I will always promote the design thinking process as a fast track to alignment. Your mileage may vary; anything capable of cutting across disciplines and reframing a challenge in objective terms is a positive step.

The most successful teams I have encountered used value as the ultimate framing – specifically, how is it being created or enhanced for the business, and for customers. Anything less than clarity around both of these will lead to muddy goals and unsatisfactory outcomes. We all deal with ambiguity in our working lives. But where this translates to vagueness, danger lies.

“What problem are we solving?” is an easy – even obvious – question to ask, but it can be problematic to answer definitively. It may even take an unpopular pause for breath to do it. To quote Covey, “With people, slow is fast and fast is slow.” 

An aligned team will move faster, and with greater precision, than one without it. 

The investment of time and rigour in achieving true alignment will repay itself many times over. It is worth fighting for.

Categories
Design Process Product UX

Designing systems, not UI

I’ve written a piece for the Puppet blog on the thinking behind an alerts & notifications system for a new product. I’ve had great feedback on the article, which serves to remind me that I should lift the lid a little more often on the work we’re doing.

Covey’s prioritisation matrix is referenced as part of the piece. This is, of course, a commonly known and commonly-referenced framework. Increasingly though I find myself seeking out new models and frameworks to assist decision-making. They are very much part of the toolkit. I hope the system I’ve outlined here makes it into someone else’s.

https://puppet.com/blog/designing-systems-not-just-ui-alerts-notifications/

Categories
Books

Top 5 books 2019

A tough year to pick a top five from, but here goes.


Tragic Design

Jonathan Shariat and Cynthia Savard Saucier

Shariat and Saucier explain how poorly designed products can anger, sadden, exclude, and even kill people who use them. Through a series of historical case studies, the errors of design become woefully apparent. The designers responsible certainly didn’t intend harm, so what can we do to avoid making similar mistakes? For a taste of where the book goes, and how high the stakes for bad design can be, try Googling “ford pinto design flaw”. One of two books on the list where I was fortunate enough to interview the authors for the UX Belfast meetup during 2019.

https://www.tragicdesign.com

Tech Humanist

Kate O’Neill

Ethics and human-centredness in design have been a noticeable emerging theme in the last two years. Here, Kate O’Neill highlights the importance of meaning and purpose in tech. “The Tech Humanist proposal is to ensure that business objectives and human objectives are as aligned as possible so that as automated experiences scale, they scale human values with them, and a sense of what is meaningful to humans surrounds us.” Highly recommended for anyone seeking greater meaning in their work.

Factfulness

Hans Rosling

What a refreshing read. We can become despairing sometimes at the state of the world. And yes, a lot of what we understand in the world is wrong. However, this book by (now deceased) author Hans Rosling illustrates how much the world is improving over time. How quality of life is improving for those in the bottom tiers of society. Yes, there’s a lot wrong with the world, but this book teaches us to appreciate where and how things are getting better. And how we must bring critical thinking to our view of the world. Rosling’s children are continuing his work – see https://www.gapminder.org for more information.

Meeting Design

Kevin Hoffman

This book needed to be written, given the amount of collective time we invest in sitting in rooms together, physically or virtually. This book treats meetings as a design problem, and offers highly practical advice on agendas, facilitation and actions. Favourite quote: “Meetings are usability tests for organizations themselves”. ‘Nuff said.

Ego is the Enemy

Ryan Holiday

A great treatise on objectivity and not becoming attached to anything you feel defines you, either as an individual, or as an organization. “…at some point in time, every industry will be disrupted by some trend or innovation [which] the incumbent interest will be incapable of responding to. Why can’t businesses change or adapt? A large part of it is because they have lost the ability to learn, they stopped being students. The second this happens, your knowledge becomes fragile.” Sobering stuff, and a useful prompt to re-assess some core beliefs about oneself.


Work-related books only this time round. So much great fiction featured during the year also, but these are the books that really stuck with me.