Prototype testing at a large scale requires a careful choice of words.
Let’s work backwards:
Implementation: contains the assumption that the set of concepts has been tested and proven and is worth committing to at full-scale.
Piloting: The set of concepts has been developed, tested in small parts, and is now ready to be tested at full scale.
Field Testing: The pieces are ready to be tested in context. Participants will use parts, some in combination, but the ideas are still being developed.
Prototype Testing: Each individual part will be developed, refined and used in small tests.
These are all terms that refer to testing ideas in context. There may be some usability testing, or other types of tests that happen before bringing the ideas into context.
There is a complexity to systemic design challenges that is becoming clearer to me as we move through the hands-on phase of prototyping in context with nurses. The experience I am leading in this project has many experiences nested inside it. And it is useful to imagine how this project might be different if we realized the nestedness of these experiences in planning the phases.
Most of our energy, and the weight of the work, has been on “transforming” the 4 new hires within the client’s innovation group. This is a huge learning experience for them, and we wanted them to feel inspired and in-control of what they were learning, constructing the experience themselves. Which has, actually, made their experience rather self-centered–which is a wonderful way to be for people who are learning.
But the experience that is nested within their experience, is that of participatory design. The fundamental belief of the innovation group is that the ideas are developed by, with and for the end-user, in our case: the nurses. Which is a very un-self-centered approach. Egoless, even. And I think that we didn’t move into that mode of thinking soon enough. Now it is difficult for the team to give up their own needs for the needs of the nurses, and they continue to have the attitude of learners, without having the service mentality that comes with consulting and developing alongside the hospitals.
And to go one last step further, the ultimate experience that is nested within that participatory design process is that of the nurse in his or her daily work. The nurses are participating in designing something that will soon become a process that they need to follow as a requirement of their job. Thank goodness they have a chance to influence it and have their voices heard. But it needs to be more than a fun and engaging process. It requires them to think critically about what they can change and what they can sustain in their work.
So it seems that each of these experiences needs it’s own ground-rules and structure. And in thinking about a next project, it would interesting to try to identify all of them up front, and perhaps begin with the central experience as the starting point. Rather than working from the outside-in, as we have for this project.
Our team has been talking about the steps of turning concepts into prototypes, and prototypes into tangible ideas. One interesting problem, and one insight arose from the discussions.
First, as a team, we can conflate the two important questions that we have about our concepts, and it can confuse and complicate our user research on the hospital floor. As we seek to understand whether the idea we are exploring is worth pursuing, we need to understand two distinct questions:
– Is this concept worthwhile?
– How would it work?
When we take a prototype onto the hospital floor and we don’t know whether we are trying to understand whether nurses are enthusiastic about the idea, or if it would really he helpful or how the idea could be implemented on the floor, we have trouble asking the important questions and understanding exactly what we are learning from our time on the floor.
So we are making extra effort to make sure that we separate out those two purposes. Testing whether the concept is worthwhile is a combination of both direct questions to nurses about how interested they are in the solution, as well as prototype tests that have observable outcomes, such as fewer patient requests or longer conversations between nurses and patients.
“How would it work?” is more of an investigation question. It takes a lot of legwork to understand the logistics of how a concept can be implemented on the floor… who answers the phones at shift change? How do nurses find the phone numbers they need, etc. But then it needs to be followed up with prototype tests that prove or disprove the methods for making it work.
A new way of working for us.
We are working with an expert client, they have worked with our design firm for a long time. We helped them develop their own innovation process that they have used for years. As we train six new hires, I am finding that we are moving beyond out typical tool set for teaching clients to be human-centered designers. I want to branch into tools for Participatory Design, but we need to make them up as we go.
But it’s tricky. It’s a more difficult learning process to learn design and participatory engagement, because new designers most often want to hold on tightly to the process, not open it up for the unpredictability of people!
For our project, in particular, the finesse required to walk onto a hospital floor and ask a nurse to help solve a problem, is more difficult. It is easier to make a plan in the team room. Bring that plan to a nurse and say, “We’d like you to try X. And if you try X, Z might happen. We’d like to find out what would happen.”
The interaction is less predictable, less controlled, if you walk up to a nurse and say, “We have heard from nurses that Shift Change is stressful and chaotic. We would like to find out how Shift Change would be different if all of the patients were sitting up. Could you help us try this out? What do you imagine would happen?”
How might we help our clients trust the value of showing vulnerability to our users?
In this current project, I am tasked with teaching a client team of newbies how to move through a user-centered design process, WHILE innovating on a real problem in the context of a hospital.
This has made the client team obsessed with doing everything “right.” They want to do as many observations as quickly as possible with exactly the right people. Which is great, but are they paying attention?
Mindfulness is something that we want from the nurses we are designing for. Being present when they are with patients. But is our team *present* when they are in an interview or observation?
We tested them.
For our weekly learning session, we took them off site. Away from their post-its, away from their notes. And asked them to describe some of the key nursing activities. We had other motives as well. Their concern for getting enough done made them question how well they were doing. My teammate recognized that observing in a hospital can make anyone lack confidence. And what this team needed was a chance to recognize how much they had learned.
They were surprised! They didn’t know how much they knew. They were proud of themselves when they saw how much they had learned. And getting off-site for a day was an important refresher at the beginning of another week in the hospital.
Now, as we head into Synthesis, we have planned a daily “Top of Mind” session at 9am, for the whole team to sit down together and talk about the ideas and patterns that are standing out to them as most interesting. This will hopefully remind everyone to be mindful of the work they are doing, we hope they will always be able to describe– without notes- what is most exciting about the evolving information.
Our design team brought our first prototypes into the field for testing with nurses and patients. We are starting slowly. 4 small prototypes, 2 hour sessions.
We started with nurses who know us and are engaged in the project. But still, it is intimidating to bring foam core and markers onto a working hospital floor to interact with people who are very sick. Which is why, for these first concepts, we are using a “resource nurse.” We have hired an extra nurse for a full shift who can either test the ideas him/herself, or can duplicate the work done by the nurse who is testing our concept.
For our first concept, Tom, our resource nurse, tested out the “Understanding Globe.” This concept asks nurses to spend 5 focused minutes with each patient, supported by 5 broad questions that ask patients how they are, and a globe that is on a timer, it glows softly for 5 minutes. When the globe stops glowing, the nurse has a graceful cue to conclude the conversation and continue on with her/his other tasks.
Tom chose one nurse working on the floor and asked her if he could meet with each of her patients, to try out this concept. Sonya gave Tom a brief description of each of her 5 patients (very brief, she was running behind on meds). Tom then introduced him to the first patient, explained that he was trying out a new idea, and began the conversation. When the globe turned off, he gently ended the conversation and said good-bye. He repeated this with 4 more patients. Tom really enjoyed the activity, but he is a nurse who enjoys taking time with patients.
Our real proof of concept will come when Tom needs to work this into his regular workday, and when a nurse who typically rushes through patient interactions in order to complete an ever-growing task list, can actually see the value in 5 focused minutes with patients. But first things first.
Tom discovered that two patients were having problems with their pain medications. One was not receiving doses in time to stop the pain. Another was having an adverse reaction to the pain medicine, terrible headaches. His nurse hadn’t taken the time to explain the side effects of the pain medication, so Tom followed up with his nurse to switch the prescription. Additionally, a woman with a recent MS diagnosis was having a hard time dealing with the emotion of it. She told Tom she talks to her husband about it, but Tom suggested she might also meet with the hospital social worker. And Tom made a phone call to set that up.
Our prototypes will be measured in pilot tests, with Time & Motion studies and other metrics. While we are out in the field refining our concepts we need to keep our eyes open for potential clinical measures of success, and customer satisfaction is not one of them. We may be able to measure the success of this concept by tracking additional referrals to other services and better pain management programs. Eventually with the hope that both of these will lead to faster recovery times and shortened stays in the hospital.
Participatory design can be a challenging approach for any designer. And for designers in a transformation process, who are just learning the human-centered approach, it can be difficult to know how to engage participants in the learning process with you.
If you have a hammer…
As a user-centered designer, everything looks like part of the innovation process. Listening to Paul Romer’s TED talk about Charter Cities helps me illustrate the purpose of setting up prototypes and experiments before introducing new concepts into the world.
Romer describes Hong Kong as a prototype that China and Britain built to test a new way of living in China. The test was successful, and China opened up new rules of capitalism across the rest of the country. But only after testing out the system in a small, subset of the country.
He is proposing that Guantanamo Bay in Cuba be redefined and redeveloped by Canada and other countries as another experiment. Castro can allow Canada to develop a city with new rules, new ideas. People from around the world– including Cube– can choose to participate. If it is successful, it may change the way Castro approaches the rules for the rest of Cuba.
Romer make a powerful point about what can hold us back from prototyping. He brings up the word “Colonialism” and talks about the emotions that come up and get associated with this idea. These emotions can hold us back from trying something important. We need to reach out to others around us to test our assumptions and set up the experiment carefully. But not shy away from trying.