Blog Challenge!

Hello readers,

This is a quick post to let you know that a few friends of mine have started a blog challenge. The challenge (led by Dylan Smith) is to blog bi-weekly over the next six months with a winner take all purse. Be sure to check out their blogs as well:

Dylan Smith: http://www.geekswithblogs.net/optikal
Tyler Doerkson: http://blog.tylerdoerksen.com
David Alpert: http://www.spinthemoose.com
Dave White: http://www.agileramblings.com
Aaron Kowall: http://geekswithblogs.net/caffeinatedgeek/Default.aspx 

(P.S. No - this post doesn't count in the challenge)

Celebrate Failure? [Part 2]

Earlier this year I wrote about Agile's perspective on failure. In that blog I indicated that my brother-in-law (a psychologist) sent me some of the latest research on failure. In particular, there were two fascinating studies that helped me understand why failure is indeed a cause for celebration. In the first part of this series I summarized the results of a study looking at the effects of failure and success in the orbital launch industry. In this blog post I'll look at some interesting research that examines the role of attitude when failure occurs.

Your attitude towards failure (and your organization's attitude) does matter.

A group of researchers led by Joel Albert Kahn set out to discover what the effect of failure norms - or attitudes towards failure would have on closing gaps in performance. Is failure enough incentive for an organization to find ways to improve or does their attitude towards that failure matter?

In an exploratory study they surveyed teams within an automotive manufacturer to look for teams that had both strong and weak "failure acceptance norms". A team with weak failure acceptance norms would be characterized by defensive attitudes when failure occurs. A team with strong failure acceptance norms would be characterized by team members that have an acceptance of failure as normal.

Using survey data they identified the teams with the strongest and weakest failure acceptance norms and then observed those teams over a two year period. What they found is that attitude mattered - the teams with the strongest failure acceptance norms were the teams that closed performance gaps the most effectively.

To those familiar with Carol Dweck's book "Mindset: The new Psychology of Success" or who have seen Linda Rising talk about her research, this should come as no surprise. According to this research, people generally find that they have one of two attitudes.

The first group of people believe that each person is either smart, or not smart - they have a fixed mindset. In this group failure is a strong indicator that you are not smart - they become defensive when failure occurs and gravitate towards easier tasks that allow them to be successful. This group has weak failure acceptance norms.

The second group of people believe that if you work hard you can improve and overcome problems - they have an agile mindset. In this group failure isn't an indicator of intelligence but rather a challenge to try again and work a little harder. This group has strong failure acceptance norms.

Interesting - Carol's research on individuals matches that of Kahn's research on organizations and teams.

One further note about Carol's research. She found that it was relatively simple to move people from the first group to the second. Our words can be powerful. When failure occurs, celebrate it as a learning opportunity!

To end this series I have a suggestion: The next time your team fails, promote an agile mindset and buy them a cake to celebrate:

Credit: www.cakewrecks.com

Further Reading:
- Linda's presentation on this topic
- Linda's keynote from Much Ado About Agile
- Carol's website: http://mindsetonline.com/
- A short video of Carol describing the effects of praise on children

Subscribe to Winnipeg Agilist by Email

You can get the full research from your neighbourhood PhD student but here are a few more details on the studies mentioned above:

"Failure construction in organizations: Exploring the effects of failure norms - Kahn, Joel Albert, 1995, University of Michigan. School of Business Administration. 

Two exploratory studies were used in this research to develop an understanding of the effects of failure norms at an automotive manufacturer. Using the survey data, the two teams with the strongest and the three teams with the weakest failure acceptance norms were identified. These five teams were observed for two years and cause maps were collected from 31 members of the teams."

"Early models of organizations as rational systems assumed that a gap between what is expected of a performance and the performance as it actually occurs will stimulate a search for an alternative approach to a problem. An interpretive perspective, in which performance gaps are socially constructed, suggests that such a search is not the inevitable consequence of performance gaps. Instead, people interpret performance gaps defensively by retrospective rationalization and external attribution to avoid acknowledging failure. People will search for alternatives only when performance gaps are interpreted as failures and not when they are interpreted defensively. Whether or not people interpret performance gaps defensively is determined by norms that are communicated and enforced within an organization an that are considered binding within its teams. Thus, the central idea of this dissertation is that search is not an inevitable response to performance gaps as is often presumed. Instead, search is a response to failure only if people are encouraged to accept failure by strong acceptance norms. …it is the acceptance of failure (strong failure acceptance norms) that encourages the interpretation of performance gaps as failure."

Celebrate Failure? [Part 1]

Earlier this year I wrote about Agile's perspective on failure. In that blog I indicated that my brother-in-law (a psychologist) sent me some of the latest research on failure. In particular, there were two fascinating studies that helped me understand why failure is indeed a cause for celebration. This is the first in a two part series.

"We find that organizations learn more effectively from failures than successes" 

In a 2010 study (more details at the bottom of this post) on the effects of failure and success on organizational learning, a team of researchers found that failure was a crucial ingredient for longer term success.

In order to find suitable organizational data to support their research they searched for and found an ideal candidate - the Orbital Launch industry. This industry was ideal for the following factors:

• Every launch had a high incentive to succeed due to the high cost of failure.
• Placing objects in space is a relatively new activity so data is available for all launches ever attempted.
• Because it is a high profile industry the records were relatively easy to find.
• The sample data contained 4663 launch attempts, 443 failures, 36 organizations, and 9 countries. The data starts with the launch of Sputnik 1 on October 4, 1957 and ends March 2004.

(Note: The Orbital Launch industry is responsible for sending rockets into space to place a payload into orbit around the earth.)

As researchers their goal was to look at the causes of improved organizational performance. Did success drive improvements? What part did failure play in future success? Here are a few of their key findings:

1. Organizations learn more effectively from failures than from successes. Success causes organizations to be complacent in the belief that they have figured it all out. On the other hand, failure increases the desire to learn and challenge existing beliefs. Those organizations that fail end up being more successful in the end.
2. Success breeds complacency and overconfidence and reduces the incentive to learn. Organizations who regularly succeed may in fact suffer from this experience in the long term. 
3. Organizations learn more from large failures than from smaller ones. As part of a community that believes in failing (learning) fast, this one is the hardest for me. But at the least it supports the notion of celebrating failure when it occurs in the larger or the small.
4. Organizations should embrace failure so that they can learn from it. One response to failure is to punish those involved or hide the failure. Organizations that are open about their failures have an increased chance of learning and then improving because of it.

As many people like Luke have pointed out - failure isn't the goal. However, when it happens we can either run from it or celebrate it. The evidence from the Orbital Launch industry strongly suggests that celebrating failure is in order. For even more reason to celebrate, take a look at part 2.

Subscribe to Winnipeg Agilist by Email

You can get the full research from your neighbourhood grad student or PhD but here are a few more details on the studies mentioned above:

Failing to Learn? The Effects of Failure and Success on Organizational Learning in the Global Orbital Launch Vehicle Industry

Abstract: "It is unclear whether the common finding of improved organizational performance with increasing organizational experience is driven by learning from success, learning from failure, or some combination of the two. We disaggregate these types of experience and address their relative (and interactive) effects on organizational performance in the orbital launch vehicle industry. We find that organizations learn more effectively from failures than successes, that knowledge from failure depreciates more slowly than knowledge from success, and that prior stocks of experience and the magnitude of failure influence how effectively organizations can learn from various forms of experience"

Discussion and Conclusion: "These findings do not imply that organizations that fail in period t are more likely to succeed in period t + 1 than are organizations that succeed in period t. But they do imply that organizations that fail in period t improve their own likelihood of succeeding in period t + 1 (relative to their likelihood of success in period t) more than do organizations that succeed in period t. Our definition of learning is inherently self-focused - change in organizational performance as a result of prior experience. ... Consequently, the result presented here suggest that experience with failure allows organizations to improve their performance relative to their own previous baseline, but that experience with success does not generate similar levels of improvement. 

Indeed, this study not only yielded strong evidence that organizations learn by observing their own and others' failures, but also failed to uncover evidence of significant learning from observation of their own or others' successes. In the full models, coefficients estimating the effect of success experience on future performance are indistinguishable from zero. We don not interpret these results as evidence that organizations cannot learn from success to improve performance. But the fact that launch vehicle organizations (which face significant incentives to learn from success as well as failure) did not experience demonstrable learning from success suggests that organizational learning from success is far from an automatic process."

Implications for Practice: "Failure is often difficult for organization members to cope with. Because failures - and those that appear to be involved in them - are often stigmatized, organization members frequently refuse to acknowledge failure, refrain from communicating about it, or redefine it as success (March et al., 1991). Indeed, in Vaughan's (1996, 2005) analyses of the Challenger and Columbia disasters, she noted that the most significant organizational antecedent to both tragedies was the institutionalized practice of ignoring failures. 

Nonetheless, given failure's central role in organizational learning shown here, organizations that stigmatize failure may be depriving themselves of major opportunities for improvement. Consequently, the most significant implication of this study of practice is that organization leaders should neither ignore failures nor stigmatize those involved with them; rather, leaders should treat failures as invaluable learning opportunities, encouraging the open sharing of information about them. Indeed, this suggestion dovetails with existing evidence that members of organization that treat failure nonpunitively report more errors, but experience fewer serious failures, than member of organizations that seek to assign blame for failures (Edmondson, 1999; Weick, Sutcliffe, & Obstfeld, 1999)."

Build Quality In: Applicable in Football too

One of the lean software principles is "Build Quality In". In short, we try to build it right the first time in order to reduce or eliminate re-work and defects. I turns out that this same rule is applicable when training a running back not to fumble.

Here is a story in Yahoo about the Patriot's running back Green-Elllis who at the time of the article had an incredible streak - no fumbles in four seasons. His college coach said:

"Far too often, he has seen players fumble and then heard the coach afterward demand that his players protect the ball by not carrying it carelessly into traffic. This always struck him as backward. Why talk about ball security after a fumble? Why not before? What are the preventative measures? You’ve got to put running backs in a position where they can eliminate fumbles." 

To put this statement in the context of software development:

"Far too often, he has seen the number of failed tests rise and then heard the project manager and testers afterward demand that the software developers write better quality code. This always struck him as backward. Why talk about tests after development? Why not before? What are the preventative measures? You've got to put software developers in a position where they can eliminate defects."

Test first my friends, test first.

An Example of a Self Organizing Team

After a recent presentation where I talked briefly about self organizing teams, someone came up to me afterward and said (I'm paraphrasing) "That team stuff is great and all, but some people are just lazy and need to be told exactly what to do and when." Argh.

But before you judge that person, let me tell you a story. In this true story you'll have the opportunity to judge me for having the same thoughts before trying a different approach. This is the story of my self organizing daughter.

My kids go to a great school - the kind of school that fosters engaged teachers who go the extra mile to create engaged students. Throughout the school year the teachers run numerous clubs before school, at lunch, or after school including run club, football club, circus club (complete with unicycles!), reading club, wrestling club, girls club, gymnastics club, etc. My kids love attending these clubs and my oldest (aged 10 during this story) was determined to be in every one of those clubs.

This is great, except there were a few problems. Many of the clubs started before the school day so she had to be ready and out the door pretty early. Since most of the clubs had a strict attendance policy (if you miss two days, you are out of the club), being on time was important. Further, because of our cold winter weather, she received a ride on many of the mornings with one of her friends. If she was late getting out the door, her friend also risked being late and missing out on the clubs.

So, being the responsible parents that we are, we nagged her out the door each the morning. "Time to get out of bed", "Have you brushed your teeth yet?" "Go comb your hair",  "It's time to make your lunch now!" "Hurray up, you're going to be late!" It made for some pretty frustrating mornings for all of us. We treated her exactly as the statement above: "some people are just lazy and need to be told exactly what to do and when." She would do the task we asked her to do and then wait to be told what to do next. Looking at it now, she was disengaged and dis-empowered. I cringe at the memory.

While this was happening, I was reading the 7 Habits of Highly Effective People by the late Dr. Stephen R. Covey. I had my "Oh crap" moment when he said this:

"You cannot hold people responsible for results if you supervise their methods. You then become responsible for results and rules replace human judgement, creativity, responsibility...  Effective leaders set up the conditions of empowerment and then... get out of people’s way, clear their path and become a source of help as requested.“

After talking it over with my wife, we approached our daughter and apologized. We then discussed a new plan with her. Since she clearly was capable of getting out the door on time on her own, she would take over that responsibility. We would make ourselves available to be a source of help if requested but otherwise stay out of it. She jumped at the chance to take ownership of her morning routine. On the first day of this new arrangement she was ready fifteen minutes early and there hasn't been a day since then that she wasn't ready on time. Not so lazy after all I guess - just the victim of well intentioned managers.

After getting over my embarrassment, I pondered how this is a great parallel to self organized teams:

1. Status is known daily. We had daily status of her progress - if she was late she would miss her ride or be kicked out of a club. Our agile teams have daily standups, visual boards, frequent deliveries and demos so that everyone understands that status of the project at all times.

2. Agreed upon goals. She understood the goal (get out the door on time so that she can keep going to clubs) and desired to reach it. Self organized teams need to understand the goals of the project, not just the tasks to complete the project.

3. Freedom over methods. She started out being assigned tasks and moved to taking ownership of her own methods. Self organizing teams are given freedom to achieve the project goals and pull their own tasks rather than being assigned tasks.

4. Ask for help. She wasn't abandoned if she ran into trouble (oh no! I can't find the shirt that matches these pants!) - we stepped into help when asked. An effective scrum master, agile project manager, IT director, etc helps the team in a similar manner.

5. Empowerment brings results. This change turned a painful morning routine into a simple one because she was given the trust and responsibility to achieve the goal. When a team is given the trust and empowerment to accomplish the goal using their own methods, great things occur.

(Note :You can ready a similar story about Dr. Covey and his son entitled "Green and Clean")