Senex Rex
  • Team
  • Blog
  • Resources
  • Contact

Top-Down Agile Beats Bottom-Up

Posted on April 15, 2015 by Dan Greening Posted in Advocacy 2 Comments

Leaders who publicly demonstrate agile methodologies and promote them top-down drive their organizations to sustain agile practices and succeed. But bottom-up agile transformations lack resiliency and generate cultural strife.

Top-down agile

Taiichi Ohno, agile coach for Toyota and its executives

Agile methodologies are now widely recommended for managing software development, but most large companies require transformation from entrenched “waterfall development,” an intuitively appealing strategy that has created massive project disasters (see Why Software Fails). Traditionally, most large agile transformations have been pursued bottom-up. One approach starts with a single team, proves agile works, and then expands further and higher in the organization. Hopefully that agile team’s success inspires others to become agile. Another approach religiously converts all engineering teams to adopt a specific agile methodology, but leaves management teams and hierarchies, dependencies, promotion policies, job titles, roles, recruiting and budgeting in their previous form. The developers adopt agile, but the managers don’t.

Bottom-up agile coaching is revolutionary coaching. If bottom-up coaches give managers advice at all, they counsel to “let teams self-organize” and avoid command-and-control management, not that managers should organize their peers as agile teams. Bottom-up agile coaches sometimes idolize individual contributors, and discount manager value with amusing but threatening statements like “Kill all the managers.” Yet managers make important strategic decisions, wield diplomacy and budgetary authority to remove significant impediments, and institute coordinated organizational change.

Agile methodologies are difficult to sustain. Agility requires discipline, which benefits from coaching, and coaches cost money, whether they are internal enthusiasts or external contractors. Agile introduces more overhead in iterated build, test and deployment. Agile requires unbiased observation and rapid experimentation, which can unsettle traditional managers and executives. Conservative managers can irrationally fear agile’s occasional low-cost failures, forgetting that waterfall’s failures were massive and deadly. Agile’s transparency can reveal contradictions between manager behavior and corporate goals, creating embarrassment at best and threatening careers at worst. If we fail to publicize evidence that proves agile has helped the organization find markets, improve development and adapt to change, then agile retreat can be the first option executives consider in a crisis—agile process is a pain in the ass, why should we keep it?

Bottom-up agile initially seems cheap, but can cost a fortune. While the expertise required to teach engineering teams how to adopt agile practices is routine, and thus less expensive per coach, companies may ultimately employ an “army of coaches” to complete the conversion, raising the price of bottom-up agility far higher. But bottom-up agile has high recidivism, resulting in waves of “coach army” sweeps to recover lost agility. Examples of companies who have experienced four or more bottom-up agile conversion waves are easy to find.

Bottom-up agile will eventually collide with top-down waterfall assumptions and career demands. Jeff Sutherland reports recently that 80% of “Scrum” teams he visited in Silicon Valley could not ship a product at the end of every sprint, despite that shippable product increments are a bedrock agile practice. I blame executives: They should demand that their teams ship products to users every Sprint. But for many executives, avoiding rapid delivery and feedback loops can preserve the unexamined big-budget funding for a flawed project … and the executive’s career.

Non-software companies suffer the same problems with bottom-up agile. In 1984, long before GM’s bankruptcy, Toyota trained General Motors employees to use the Toyota Production System (TPS) in the NUMMI Fremont manufacturing plant. Employing exactly the same union workers, this plant went from being GM’s worst performing, with drug-dealing and sabotage on the plant floor, to its best, with GM’s highest quality cars rolling rapidly off the line. You might think executives would ecstatically replicate that TPS management approach to other plants, but no. If you have a free hour, listen to this hilarious, compelling and sad episode of This American Life, “NUMMI” [lang2010]. Bottom-up failures in agile transformation will no longer surprise you. If the leaders aren’t themselves agile, you have a problem.

Top-down Agile Conversion

Who can fix this fastest? The highest-ranking officer willing to adopt agile for themselves and their direct reports. Managers at every level have strategic activities that gain from collaboration, belong in a backlog and see greater success when managed with agile methodologies.

Scaled agile is a form of multi-agent optimization, and optimization analogies show top-down wins. In a former life, I examined global optimization in distributed computing, which has many analogies to organizations [gree1995], concluding that top-down optimization reaches a better result faster. Others have found similar results [cres2008].

What does top-down agile conversion look like? Top-down conversion first identifies the organization’s larger strategic goals, decomposes them into a tentative backlog, establishes a collaborative strategy team (composed of executives) to achieve those goals, constructs adaptive experiments to test the hypothesized outcomes, responds to invalidated hypotheses by changing the goals or the process, and solves systemic problems. It looks like Scrum for strategic work, and that’s exactly what it is.

Executives who collaborate under agile become allergic to waterfall dysfunctions in their staff. They stop tolerating activities misaligned with corporate goals and start measuring progress on the company mission. They insist that teams and product managers validate hypotheses before making wild claims. They limit work in process to avoid investing too much valuable time under uncertainty. They demand that their employees take collective responsibility for fixing problems, rather than throwing peers under a bus. They welcome systemic problem solving, including employees examinating how executives can better help the organization succeed.

In short, in top-down agile, executives become the exemplars of self-organization. If they need an agile department to support their efforts (and most will), they will demand agility from the department.


Bill Gross, Minimum Viable Product Approaches You Can Learn From

Our most recognized agile successes—Idealab, Salesforce, Spotify, Toyota, etc.—were led by CEOs or CTOs who understood and embraced agile concepts not only for their teams, but for themselves. Idealab, a firm that pioneered Lean Startup concepts, started over 160 companies with 100 successes (along with 60 failures) [gros2014]. Its entrepreneur leader, Bill Gross, is estimated to be worth more than $300 million. Salesforce dominates the CRM industry, with a market cap of $42B, and was an early adopter of Scrum under the direction of CEO Marc Benihoff. Spotify rapidly grew to a private valuation of $1B, giving its CEO Daniel Ek, a natural agilist, a paper valuation of $300M. Agile coach Henrik Kniberg advises the CTO on down. Toyota became the most profitable car company through the leadership of its CEO Eiji Toyoda, coached by Toyota Production System inventor Taiichi Ohno.

In these top-down cases, the corporate leaders didn’t just promote agile, they themselves were agile. Through their fascination with agile practices, their adoption of agile for themselves, and their insistence that employees follow suit, these leaders’ companies became agile and stayed that way.


References

[char2005] Robert Charette, “Why Software Fails,” IEEE Spectrum (September 2005), http://spectrum.ieee.org/computing/software/why-software-fails.

[cres2008] Valentino Crespi, Aram Galstyan, Kristina Lerman, “Top–Down vs Bottom–up Methodologies in Multi–Agent System Design,” Autonomous Robots 24:303–313, http://www.isi.edu/~lerman/papers/methodRevisedFinal.pdf.

[gree1995] Daniel R Greening, Simulated Annealing with Errors, PhD Dissertation, UCLA Computer Science (1995) https://www.researchgate.net/publication/270648114_Simulated_Annealing_with_Errors.

[gros2014] Bill Gross, “MVPs You Can Learn From,” Lean Startup Conference 2014, https://www.youtube.com/watch?v=sRkdV5Vc_4I.

[lang2010] Frank Langfitt, “403: NUMMI,” This American Life, http://www.thisamericanlife.org/radio-archives/episode/403/nummi.

Share this:

  • Click to print (Opens in new window)
  • Click to share on Twitter (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Reddit (Opens in new window)
  • Click to email a link to a friend (Opens in new window)
  • More
  • Click to share on Tumblr (Opens in new window)
  • Click to share on Pinterest (Opens in new window)
  • Click to share on Pocket (Opens in new window)
agile base patterns agile canon agile leadership enterprise scrum
« What is an Agile Methodology? How does it beat Waterfall?
Call to Submit Papers: Agile / Lean at HICSS (January 5-8, 2016) »

2 thoughts on “Top-Down Agile Beats Bottom-Up”

  1. joefec says:
    April 16, 2015 at 1:16 am

    Hey Dan, after some time growing the bottom-up approach I have to say that I completely agree with this. The culture is set from the top and must be like a drum beat that echos through the organization. Localized gains can be had through grit and coach & team determination. Yet, if one wants to really move the needle with agile, where it makes a change to the profit of the company’s bottom line, an organization definitely needs the sort of leadership you are speaking of. Great article!

    Log in to Reply
    • Dan Greening says:
      April 16, 2015 at 9:36 am

      Thanks Joe Fecarotta. I hope we get to work together at some point!

      Log in to Reply

Leave a comment Cancel reply

You must be logged in to post a comment.

Continue with Facebook
Continue with LinkedIn

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Pages

  • 5 Points
  • Account
  • Agile Capitalization
  • Agile Capitalization Video: Greening and Rudd
  • Agile Training
  • Agility Language
  • Call for Papers: Agile/Lean at HICSS (Kauai, January 5-8, 2016)
  • Call for Papers: Agile/Lean at HICSS
    (due June 15, 2016)
  • Certified Enterprise Coaching
  • Clients
  • Contact Us
  • Courses: Agile Capitalization Workshop
  • Courses: Agile Development
  • Courses: Agile Product Management
  • Courses: Executive Introduction to Agile
  • Courses: [email protected] Practitioner
  • Dan R. Greening
  • Enterprise Scrum: Scaling Scrum to the Executive Level
  • Glossary
  • Home
  • Jeff McKenna
  • John Horton
  • Kay Lynn Gabaldon
  • Login
  • Logout
  • Members
  • Password Reset
  • Premium Content
  • Premium Content 2
  • Privacy Policy
  • Register
  • Release Duration and Enterprise Agility
  • Resources
  • Rob Myers
  • Senex Rex Team
  • Short Course: Agile Manager
  • Sign up for Premium Content
  • Software Moneyball
  • Subscribe
  • The First of Five Challenges to Large Organizations that Force Agility
  • Troy Magennis
  • User
  • Vincent T. Mills
  • Senex Rex Blog Posts
  • Rapid Agile Forecasting

Archives

  • August 2018
  • February 2018
  • February 2017
  • March 2016
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • February 2015
  • August 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • April 2012
  • March 2012
  • December 2011
  • July 2011
  • March 2011
  • February 2011
  • September 2010
  • August 2010
  • May 2010
  • April 2010
  • March 2010
  • January 2010
  • May 2009
  • March 2009

Categories

  • Advocacy (11)
  • Agility (10)
    • Agile Base Patterns (7)
  • Calls for Papers (4)
  • Enterprise (23)
  • Events (5)
  • Job Search (1)
  • Marketing (2)
  • Metrics (12)
  • Personal (7)
  • Personal Improvement (2)
  • Portfolio Management (11)
  • Product Management (9)
  • Quality (6)
  • Scrum (31)
  • Software (4)
  • Training (2)
  • Uncategorized (5)

WordPress

  • Log in
  • WordPress

Subscribe

  • Entries (RSS)
  • Comments (RSS)

Pages

  • 5 Points
  • Account
  • Agile Capitalization
  • Agile Capitalization Video: Greening and Rudd
  • Agile Training
  • Agility Language
  • Call for Papers: Agile/Lean at HICSS (Kauai, January 5-8, 2016)
  • Call for Papers: Agile/Lean at HICSS
    (due June 15, 2016)
  • Certified Enterprise Coaching
  • Clients
  • Contact Us
  • Courses: Agile Capitalization Workshop
  • Courses: Agile Development
  • Courses: Agile Product Management
  • Courses: Executive Introduction to Agile
  • Courses: [email protected] Practitioner
  • Dan R. Greening
  • Enterprise Scrum: Scaling Scrum to the Executive Level
  • Glossary
  • Home
  • Jeff McKenna
  • John Horton
  • Kay Lynn Gabaldon
  • Login
  • Logout
  • Members
  • Password Reset
  • Premium Content
  • Premium Content 2
  • Privacy Policy
  • Register
  • Release Duration and Enterprise Agility
  • Resources
  • Rob Myers
  • Senex Rex Team
  • Short Course: Agile Manager
  • Sign up for Premium Content
  • Software Moneyball
  • Subscribe
  • The First of Five Challenges to Large Organizations that Force Agility
  • Troy Magennis
  • User
  • Vincent T. Mills
  • Senex Rex Blog Posts
  • Rapid Agile Forecasting

Archives

  • August 2018
  • February 2018
  • February 2017
  • March 2016
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • February 2015
  • August 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • April 2012
  • March 2012
  • December 2011
  • July 2011
  • March 2011
  • February 2011
  • September 2010
  • August 2010
  • May 2010
  • April 2010
  • March 2010
  • January 2010
  • May 2009
  • March 2009

Categories

  • Advocacy (11)
  • Agility (10)
    • Agile Base Patterns (7)
  • Calls for Papers (4)
  • Enterprise (23)
  • Events (5)
  • Job Search (1)
  • Marketing (2)
  • Metrics (12)
  • Personal (7)
  • Personal Improvement (2)
  • Portfolio Management (11)
  • Product Management (9)
  • Quality (6)
  • Scrum (31)
  • Software (4)
  • Training (2)
  • Uncategorized (5)

WordPress

  • Log in
  • WordPress
Copyright ©2013-2015 Senex Rex LLC. All Rights Reserved.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT