{"id":1311,"date":"2020-07-05T14:45:23","date_gmt":"2020-07-05T14:45:23","guid":{"rendered":"https:\/\/tomgeraghty.co.uk\/?p=1311"},"modified":"2025-01-24T15:43:52","modified_gmt":"2025-01-24T15:43:52","slug":"the-history-and-evolution-of-devops","status":"publish","type":"post","link":"https:\/\/tomgeraghty.co.uk\/index.php\/the-history-and-evolution-of-devops\/","title":{"rendered":"The History of DevOps"},"content":{"rendered":"<p>[Updated June 2023]<\/p>\n<p>DevOps may be one of the most hyped concepts in the tech industry in recent times. Yet what it actually consists of is the subject of much debate: some describe DevOps as a culture of process improvement, whilst others describe it in purely technological terms of automation and cloud technologies.<\/p>\n<h3>The Origins of DevOps<\/h3>\n<p>What few disagree on though are its origins. In the tech industry, it has long been accepted that technologists are either \u201cdevs\u201d: those who \u201ccreate\u201d, or \u201cops\u201d: those who \u201cbuild and maintain\u201d. Developers write code while engineers build the system and keep it running. Conflict frequently emerges between these two camps and their seemingly incongruent goals \u2013 \u00a0whereas development teams are motivated and measured by their high change frequency and scale (deploying features, fixes, and improvements), operations teams are judged by reliability and consistency, qualities which are often seen as an outcome of low change frequency and scale (though we shall see later how this isn\u2019t necessarily true). This often results in an antagonistic relationship between the two teams.<\/p>\n<p>DevOps is or at least originated as, the effort to reconcile this fracture and improve business performance.<\/p>\n<blockquote><p>\u201c<i>\u2026all ideas are second-hand, consciously and unconsciously drawn from a million outside sources.<\/i>\u201d Mark Twain<\/p><\/blockquote>\n<p>At a high level, the practice of DevOps focuses on culture, process, velocity, feedback loops, repeatability via automation, responsiveness to change, and continuous improvement. (Also often condensed to CALMS &#8211; Culture, Automation, Lean, Measurement, Safety). These practices have accelerated the web-scale revolution behind high-performance tech giants such as Google, Netflix, Amazon, and Facebook.<\/p>\n<p>However, these concepts are not new. They have been used by industrialists, researchers, and technologists to improve the quality and efficiency of production since the dawn of the industrial revolution.<\/p>\n<h3>Industry and Scientific Management<\/h3>\n<p>In 1620 Francis Bacon codified what was to become the fundamental basis for empirical knowledge: the origin of the scientific method. Bacon\u2019s method described the conception of a theory based upon observation, and the use of experiments to test the theory. 400 years on, we still use Bacon\u2019s approach to create and test theories, monitor systems and check technological functionality.<\/p>\n<p>\u201c<i>In the past, the man has been first; in the future, the system must be first.<\/i>\u201d Frederick Taylor<\/p>\n<p>Frederick Taylor, in the 1880\u2019s, applied the scientific method to management and workflows to improve labour productivity. He was one of the first people to deem work itself worthy of systematic study, using the principles that Bacon derived 200 years before. Whilst Taylor\u2019s views on what makes a \u201cgood\u201d worker were somewhat disturbing \u2013 he defined the \u201cbest\u201d worker as \u201c<i>so stupid and so phlegmatic that he more nearly resembles in his mental make-up the ox than any other type.<\/i>\u201d \u2013 Taylorism had a huge impact on productivity across the industrialised world.<\/p>\n<p>Taylor summed up his efficiency strategies in the 1911 book \u201cThe Principles of Scientific Management.\u201d This was voted the most influential management book of the twentieth century by Fellows of the Academy of Management in 2011. Without Taylor, it\u2019s unlikely that Apple or Google would even exist as they do now.<\/p>\n<h3>20th Century Production<\/h3>\n<p>At the beginning of the 20th Century, most manufacturing utilised inefficient techniques \u2013 cars for instance were built the way you or I would go about the task, by assembling the all the parts in one place:\u00a0<i>craft production<\/i>. However when demand for cars increased, it became clear that a form of linear, or mass production was needed. One of the most well known examples of the production line is the one adopted by Henry Ford in 1913 for the Ford Model T, which was based on Taylor\u2019s principles. Through the use of time and motion studies, Ford refined his production line until he had reduced the production time for a car from over twelve hours to just 93 minutes. He also introduced to mainstream manufacturing the concept of\u00a0<i>repeatability<\/i>\u00a0and\u00a0<i>standardisation<\/i>. In contrast to Taylor, however, Ford always maintained his belief in the importance of the skill and craftsmanship of the worker.<\/p>\n<blockquote><p>\u201c<i>Without data, you\u2019re just another person with an opinion.<\/i>\u201d William Edwards Deming<\/p><\/blockquote>\n<p>In the 1950s, William Edwards Deming, a statistician, physicist, and management consultant, began to apply statistical analysis to manufacturing. Deming found that prioritising quality over throughput would actually\u00a0<i>decrease<\/i>\u00a0costs and\u00a0<i>improve<\/i>\u00a0productivity. Whilst Taylorism and scientific management had boosted productivity, quality had suffered. Defects were sent down the line and built into finished products because workers were incentivised to ignore flaws in order to meet quotas.<\/p>\n<p>He defined what is now known as the Deming Cycle:\u00a0<i>Plan \u2013 Do \u2013 Check \u2013 Act<\/i>. This is similar to the software development lifecycle most of the technology industry use today. <a href=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2025\/01\/IEX-White-Paper-foundations-7-7-17-v11.pdf\">Deming<\/a> championed continual analysis and improvement of processes \u2013 one of the key tenets of DevOps.<\/p>\n<p>He saw effective quality assurance as an essential function of high-performing organisations, the key message of the third of his \u201cFourteen Points\u201d; key principles of management for transforming business effectiveness:<\/p>\n<ol>\n<li>Constancy of purpose, with the aim to become competitive and stay in business, and to provide jobs.<\/li>\n<li>Adopt the new philosophy. Embrace change.<\/li>\n<li>Cease dependence on inspection to achieve quality. Build quality checks and feedback loops into the process.<\/li>\n<li>End the practice of awarding business on the basis of lowest bid. Build long term relationships with suppliers, and value loyalty and trust.<\/li>\n<li>Continuously improve processes, aim to improve quality and productivity, which in turn leads to cost reductions through less wastage and higher efficiencies.<\/li>\n<li>Institute training on the job and integrate development into employees\u2019 roles.<\/li>\n<li>Institute leadership. Leadership should help people and machines do a better job, remove barriers to working effectively, identify improvements, and develop teams.<\/li>\n<li>Drive out fear. Fear paralyses people and teams. Transparent communication, motivation, respect and care for each other and each other\u2019s work will contribute to this aim.<\/li>\n<li>Break down barriers between departments. Cross-functional teams can solve problems more easily and effectively than single-function teams or siloes.<\/li>\n<li>Eliminate slogans and exhortations for the workforce asking for zero defects.<\/li>\n<li>Defects (and quality) are a result of the system, not the individual.<\/li>\n<li>Eliminate targets or quotas. Substitute quantity for quality, and quantity will follow.<\/li>\n<li>Permit pride of workmanship. Eliminate management by objective or by numbers. Employees feel more satisfaction when they get a chance to execute their work well and professionally, rather than trying to meet a quota.<br \/>\nInstitute training and self-improvement. Encourage employees to study for themselves and to see their studies and training as a self-evident part of their jobs.<\/li>\n<li>The transformation is everyone\u2019s job. Transformation happens only when everyone in the organisation works to accomplish it.<\/li>\n<\/ol>\n<p>Deming\u2019s System of Profound Knowledge is the culmination of his work and ties together his seminal theories on quality, management and leadership into four interrelated areas:<\/p>\n<ol>\n<li>Appreciation for a system,<\/li>\n<li>Knowledge of variation,<\/li>\n<li>Theory of knowledge<\/li>\n<li>Psychology<\/li>\n<\/ol>\n<p>Each area corresponds to one or more of his fourteen points, and we can reflect on how these four areas correspond to fundamental DevOps tenets too.<\/p>\n<p>Appreciation for a system means that as a leader, engineer, developer or tester, you ought to understand the system that you are looking to work within \u2013 and that thoroughly understanding that system endows you with far greater capacity to improve it. This is systems thinking, a concept which will be revisited throughout this book.<\/p>\n<p>Knowledge of variation refers to two types of \u201ccause\u201d determined by Deming: \u201cCommon\u201d and \u201cSpecial\u201d. Common causes are those anticipated by, or inherent to, a system. An example of this would be scaling; for example, you might know that a particular system generates logs at a rate of 500GB per day, and as a result you build functions into your system to deal with this growing demand for storage. This growth (the \u201ccause\u201d) is understandable and predictable, and thus you are able to implement measures to manage the variation. Deming\u2019s second cause is \u201cSpecial\u201d, and refers to those aspects that are unknown or unpredictable, such as a change made that had unintended consequences, or a datacentre outage, or action by a malicious third party. Deming estimated that over 94% of quality issues (in his case, in manufacturing, but the same principle applies to modern software delivery) are catalysed by \u201ccommon\u201d causes, but human nature looks for the \u201cspecial\u201d cause: the one-off event, the human error, or bad actor at play. If someone accidentally shuts down a production server, Deming\u2019s solution is not to fire the human (thereby removing the unpredictable, unknown element), but to build improvements into the system to prevent a human making that mistake again, or preventing that mistake affecting the system.<\/p>\n<p>Deming\u2019s theory of knowledge concentrates on the importance of understanding our own knowledge. How do we discern what is true from what is false? How do we identify our own innate biases, and how can we make ourselves less susceptible to confirmation bias? Deming goes back to Bacon\u2019s scientific method with the Plan-Do-Check-Act cycle, reflecting the concept of creating a hypothesis and then testing those assumptions. People appear to learn more effectively when they make predictions. Making a prediction forces us to think ahead about the potential outcomes and also causes us to examine more deeply the system that we\u2019re working in or on.<\/p>\n<p>At around the same time, after studying consumer behaviour in supermarkets, the Toyota Motor Corporation began using Kanban (which means \u201csignboard\u201d in Japanese) to control and record work. Kanban boards have vertical columns with work packages in the form of cards to represent stages in a process. Each process is a \u201ccustomer\u201d of the preceding process to the left \u2013 that is, the work is \u201cpulled\u201d from left to right, rather than \u201cpushed\u201d. This concept reduces inventory pile-up, enabling a delivery system called\u00a0<i>just in time\u00a0<\/i>and minimising waste. It also aids the identification of bottlenecks in the process by highlighting Work In Progress (WIP). Kanban makes \u201cwork\u201d visible. And making work visible is crucial to further improvement, because \u201cyou can\u2019t manage what you don\u2019t measure\u201d.<\/p>\n<blockquote><p>\u201c<i>Any improvements made anywhere besides the bottleneck are an illusion.<\/i>\u201d Eliyahu M. Goldratt<\/p><\/blockquote>\n<p>The above constitutes Goldratt\u2019s Theory of Constraints. In his 1984 management novel \u201c<a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/0566086654\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=0566086654&amp;linkId=e21c72081e0ae411440115673f3e5c24\">The Goal<\/a>\u201d, Eli Goldratt built on Deming\u2019s ideas and codified Lean Production, a precursor of DevOps methodology. He described a failing manufacturing plant where Alex, the main character, is brought in to turn things around within three months. Through a series of telephone calls and meetings with an acquaintance called Jonah (another physicist, like Deming), Alex solves the organisation\u2019s problems by utilising pull rather than push processes, reducing WIP, and employing the Theory of Constraints. \u201cThe Goal\u201d itself, Goldratt demonstrates, is simply to make money for the business. Anything else, if it cannot be demonstrated to help make money, is likely to be vanity.<\/p>\n<p><a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/0566086654\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=0566086654&amp;linkId=e21c72081e0ae411440115673f3e5c24\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-1884\" src=\"https:\/\/tomgeraghtywordpress.s3-eu-west-1.amazonaws.com\/2022\/01\/the-goal-203x300.jpeg\" alt=\"the goal\" width=\"203\" height=\"300\" srcset=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/the-goal-203x300.jpeg 203w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/the-goal.jpeg 339w\" sizes=\"auto, (max-width: 203px) 100vw, 203px\" \/><\/a><\/p>\n<h3>People and Process<\/h3>\n<p>By the 1980s, the modern manufacturing revolution was in full swing, however, its often reductionist approach to workers wasn\u2019t helpful, and staff turnover was high. Among those to recognise this was Burrhus Frederic Skinner, a psychologist, author, inventor and the Edgar Pierce Professor of Psychology at Harvard University. In describing the nature of quality work and happiness, he said:<\/p>\n<p>\u201c<i>It\u2019s the difference between a craftsman who makes a complete chair and a person on an assembly line who makes only the legs. The craftsman\u2019s work is constantly reinforced by the process of seeing the chair take form, and finally of producing the finished chair. But the assembly-line worker sees only chair leg after chair leg \u2014 never the completed product.<\/i>\u201d<\/p>\n<p>This is a near-definitive example of \u201csystems thinking\u201d- another key tenet of DevOps.<\/p>\n<p>Being able to see the end result of the process is key to improving quality in the individual stages \u2013 how can someone build the perfect component if they don\u2019t understand in the final product? Systems thinking is a cultural practice, rather than a process or tool, and relies on believing in the capability of team members to make small but important decisions regarding their part in the process, and thus being more invested in the outcome.<\/p>\n<figure id=\"attachment_2132\" aria-describedby=\"caption-attachment-2132\" style=\"width: 300px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2132\" src=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2020\/07\/lenny-kuhne-jHZ70nRk7Ns-unsplash-300x200.jpg\" alt=\"Photo by &lt;a href=&quot;https:\/\/unsplash.com\/@lennykuhne?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText&quot;&gt;Lenny Kuhne&lt;\/a&gt; on &lt;a href=&quot;https:\/\/unsplash.com\/photos\/jHZ70nRk7Ns?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText&quot;&gt;Unsplash&lt;\/a&gt;   \" width=\"300\" height=\"200\" srcset=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2020\/07\/lenny-kuhne-jHZ70nRk7Ns-unsplash-300x200.jpg 300w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2020\/07\/lenny-kuhne-jHZ70nRk7Ns-unsplash.jpg 640w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption id=\"caption-attachment-2132\" class=\"wp-caption-text\">Photo by <a href=\"https:\/\/unsplash.com\/@lennykuhne?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\">Lenny Kuhne<\/a> on <a href=\"https:\/\/unsplash.com\/photos\/jHZ70nRk7Ns?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\">Unsplash<\/a><\/figcaption><\/figure>\n<p>Further developments in understanding of how to develop an aspirational working culture came once again from Toyota when in 2001 they defined their philosophy, values and manufacturing ideals in four key headlines, \u201cThe Toyota Way\u201d. These were:<\/p>\n<ol>\n<li><i>Long-Term Philosophy<\/i>\u00a0\u2013 Base your management decisions on a long-term philosophy, even at the expense of short-term goals.<\/li>\n<li><i>The Right Process Will Produce the Right Results\u00a0<\/i>\u2013 Focus on pull processes, managing WIP, and making work visible.<\/li>\n<li><i>Add Value to the Organization by Developing Your People<\/i>\u00a0\u2013 Provide effective training, highlight team success over individual success, and challenge your partners and suppliers.<\/li>\n<li><i>Continuously Solving Root Problems Drives Organizational Learning<\/i>\u00a0\u2013 Continuously improve (in Japanese,\u00a0<i>kaizen<\/i>), use the \u201c5 whys\u201d to get to the root cause of problems, standardise, decide slowly and act quickly, and encourage a knowledge sharing culture.<\/li>\n<\/ol>\n<p>Everything in The Toyota Way and Lean Production aligns with, and indeed comprises part of the DevOps principles.<\/p>\n<h3>The Agile Manifesto<\/h3>\n<p>Also that year, at Snowbird resort in Utah, seventeen developers, frustrated with traditional heavyweight project management methodologies, came up with the\u00a0<a href=\"https:\/\/agilemanifesto.org\/\"><i>Agile Manifesto<\/i><\/a>. At the time, industry experts estimated that the time between a validated business need and an actual application in production was around three years. There was a real desire to find more lightweight ways to deliver value from technology, faster. The Agile manifesto is as follows:<\/p>\n<blockquote><p><i>Individuals and interactions over processes and tools<\/i><\/p>\n<p><i>Working software over comprehensive documentation<\/i><\/p>\n<p><i>Customer collaboration over contract negotiation<\/i><\/p>\n<p><i>Responding to change over following a plan<\/i><\/p><\/blockquote>\n<p><img loading=\"lazy\" decoding=\"async\" class=\" alignright\" src=\"https:\/\/wb40podcast.files.wordpress.com\/2019\/02\/0bd72-16hzvheruysk0qxaftlxvew.jpeg?w=267&amp;h=200\" alt=\"Image result for agile manifesto\" width=\"267\" height=\"200\" \/>The Agile Manifesto gives a clear guide to what to prioritise. For example, whilst documentation is valuable, it is more important to the business that the software\u00a0<i>works<\/i>. The most well-known element of Agile is possibly the fourth line:\u00a0<i>Responding to change over following a plan<\/i>. Given how quickly customer requirements, finances, and technology can change, it is often unrealistic to believe that specifications created at the start of a project will remain 100% accurate and true throughout the lifetime of the project. Thus, responding to change is one of the ways that software teams can provide a competitive edge over teams that do not.<\/p>\n<p>Whilst Agile methodology is not fundamentally part of DevOps, the two usually go hand-in-hand. In technology teams, one is certainly easier to achieve in the presence of the other.<\/p>\n<h3>The First DevOps &#8220;Role&#8221;<\/h3>\n<p>Shortly after the Agile manifesto was written, Google was undergoing rapid expansion. As one of the few web-scale tech businesses at the time, they experienced the unprecedented challenge of trying to rapidly introduce new features whilst maintaining a highly complex, always-on, massive scale platform. The Site Reliability Engineering (SRE) team, led by Ben Traynor, was their solution.<\/p>\n<p>A Site Reliability Engineer (SRE) would typically spend up to half their time performing operations-related work such as troubleshooting system issues and performing maintenance. They would spend the other half of their time on development tasks such as new features, scaling challenges, or automation. An SRE is an example of one of the first true DevOps roles in technology.<\/p>\n<h3>DevOps Detractors<\/h3>\n<blockquote><p>\u201c<i>\u2026the opportunities for gaining IT-based advantages are already dwindling\u2026 And as for IT-spurred industry transformations, most of the ones that are going to happen have likely already happened or are in the process of happening.<\/i>\u201d Nicholas Carr<\/p><\/blockquote>\n<p>It\u2019s worth noting that not all in business recognised the potential of DevOps. In May 2003, Nicholas Carr published an article in the Harvard Business Review, titled \u201c<a href=\"https:\/\/hbr.org\/2003\/05\/it-doesnt-matter\">IT doesn\u2019t matter.<\/a>\u201d In this now infamous piece, Carr defines IT as a commodity, in the same category as electricity or water. He suggests that being the first to utilise a particular technology provides only a small competitive advantage, since your competitor can purchase the same system or replicate the same technology, but you incur the lion\u2019s share of the cost by doing it first. He stated:<\/p>\n<blockquote><p>\u201c<i>The key to success, for the vast majority of companies, is no longer to seek advantage aggressively but to manage costs and risks meticulously. If, like many executives, you\u2019ve begun to take a more defensive posture toward IT in the last two years, spending more frugally and thinking more pragmatically, you\u2019re already on the right course. The challenge will be to maintain that discipline when the business cycle strengthens and the chorus of hype about IT\u2019s strategic value rises anew.<\/i>\u201d<\/p><\/blockquote>\n<p>Carr\u2019s piece was taken very seriously at the time, and still is by many business leaders. Perhaps it is fortunate for organisations such as Salesforce and Google that they pursued technology as a competitive advantage, and disregarded Carr\u2019s advice.<\/p>\n<h3>Improving IT<\/h3>\n<p>It is not unsurprising however that technology had such a poor reputation at the time, since research suggests that at least 80% of outages were (and potentially still are) self-inflicted. A book by Kevin Behr, Gene Kim and George Spafford, The Visible Ops Handbook (2004), described a methodology to improve operational IT. This methodology of \u201cVisible Ops\u201d is described in four stages:<\/p>\n<ol>\n<li><i>Stabilize Patient, Modify First Response<\/i>\u00a0\u2013 This first step controls risky changes and reduces MTTR (Mean Time To Resolution).<\/li>\n<li><i>Catch and Release, Find Fragile Artifacts<\/i>\u00a0\u2013 Here assets, configurations and services are inventoried in order to identify those with the lowest change success rates, highest MTTR and highest downtime costs.<\/li>\n<li><i>Establish Repeatable Build Library<\/i>\u00a0\u2013 This creates repeatable builds for critical services, to make it \u201c<i>cheaper to rebuild than to repair.<\/i>\u201d<\/li>\n<li><i>Enable Continuous Improvement<\/i>\u00a0\u2013 This implements metrics to enable continuous improvement of processes.<\/li>\n<\/ol>\n<p>To some degree, these four stages are evolutions of elements of The Toyota Way. They formed an embryonic codification of what was to become the principles of DevOps.<\/p>\n<p>Over the next few years, the technology industry underwent a paradigm shift, where methods of working were analysed, and technology became far more fundamental to the success of organisations (possibly to the chagrin of Nicholas Carr).<\/p>\n<h3>#DevOps<\/h3>\n<p>In 2008, the term DevOps was used in the industry for the first time. There\u2019s some confusion and misinformation regarding how this came about, but I spoke to Andrew Clay Shafer and Patrick Debois, both widely credited with creating the term \u201cDevOps\u201d, to get the full story\u2026<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/d33wubrfki0l68.cloudfront.net\/32130b2d91121f55812538ce920ccbf34cdbd0f9\/75f0c\/events\/2019-ghent\/speakers\/andrew-clay-shafer.png\" alt=\"Andrew clay Shafer DevOps Ghent 2009\" width=\"600\" height=\"600\" \/><\/p>\n<p>In August 2008 at the Agile Conference in Toronto, software developer Andrew Clay Shafer posted notice of a discussion group session entitled \u201cAgile Infrastructure.\u201d Just one person, system administrator Patrick Debois attended. Debois had become frustrated by the now ubiquitous conflicts between developers and operations while working on a data centre migration for the Belgium government and was looking for solutions. Shafer actually skipped his own session because he didn\u2019t think anyone was interested, but Debois later tracked him down for a chat in the hallway. Inspired by that hallway discussion, they formed an \u201cAgile Systems Administration\u201d Google Group\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1949 size-large\" src=\"https:\/\/tomgeraghtywordpress.s3-eu-west-1.amazonaws.com\/2022\/07\/PatrickDebois-1583279978768-1024x538.jpeg\" alt=\"Patrick Debois\" width=\"1024\" height=\"538\" srcset=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/07\/PatrickDebois-1583279978768-1024x538.jpeg 1024w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/07\/PatrickDebois-1583279978768-300x158.jpeg 300w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/07\/PatrickDebois-1583279978768-768x403.jpeg 768w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/07\/PatrickDebois-1583279978768.jpeg 1200w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/p>\n<p>In November the following year, 2009, Patrick organised the first DevOpsDays conference in Belgium, though it was Shafer who (it\u2019s believed) coined the term DevOps by tweeting using the #DevOps hashtag at the Velocity conference in June 2009 whilst watching the now famous <a href=\"https:\/\/www.slideshare.net\/jallspaw\/10-deploys-per-day-dev-and-ops-cooperation-at-flickr\/8-Ops_stereotype_Because_the_site\">\u201c10 deploys a day\u201d talk by John Allspaw and Paul Hammond of Flickr<\/a>.<\/p>\n<h3>The Role of Cloud Technology<\/h3>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/www.hypergridbusiness.com\/wp-content\/uploads\/2013\/11\/Amazon-cloud.png\" alt=\"Image result for amazon cloud\" width=\"304\" height=\"160\" \/><\/p>\n<p>It wasn\u2019t long after the #DevOps hashtag was first used that adoption of cloud technology accelerated rapidly. The AWS EC2 service (virtual servers on-demand) only went out of beta in late 2008. It was (and still is) a fast evolving technology. Cloud technology tends to align well with DevOps practices, because its features lend themselves to elasticity and scaling, automation, measurement and repeatability, key fundamentals of DevOps.<\/p>\n<p>The tide had turned. Increasingly organisations began looking at ways of improving software deployments, moving away from large, disruptive (and frankly, stressful) deployments, towards a model of more frequent, smaller, low-risk deployments.<\/p>\n<p>Jez Humble and Dave Farley wrote what is still one of the definitive texts on this approach: \u201c<i>Continuous Delivery<\/i>\u201d in 2010. It describes in detail how to automate your build, deployment, and testing pipeline so that you can release changes in hours or even minutes. That might not seem that impressive today, but at the time, a release cycle of months or years was very common.<\/p>\n<p>Continuous delivery, according to Farley and Humble, requires:<\/p>\n<ul>\n<li><i>Comprehensive configuration management<\/i><\/li>\n<li><i>Continuous integration and short lived branches\u00a0(in reference to Trunk-Based Development)<\/i><\/li>\n<li>Continuous testing<\/li>\n<\/ul>\n<p>The automation of the build, deployment, and testing process, coupled with better collaboration between development, test, and ops teams, means that changes can be released rapidly. These smaller, low risk changes are more easily rolled back should something go wrong. \u201c<i>Continuous Delivery<\/i>\u201d showed how to increase velocity of change, whilst reducing risk and improving quality.<\/p>\n<p>With cloud technology becoming mainstream and a desire to release software more rapidly, automation technology and tools took off. Software firms such as Puppet and Chef grew fast as developers and engineers strove to streamline their build processes and manage ever-increasing scales of infrastructure in the cloud. These tools also provided a new ability to fire up duplicate environments, such as staging, QA, test and validation, within minutes rather than weeks or months. Organisations exploiting these automation tools and using native cloud technologies felt that they were gaining significant competitive advantage by doing so, and what evidence there was, was in their favour. Even Gartner, in a 2011 report, stated that:<\/p>\n<blockquote><p>\u201c<i>By 2015, DevOps will evolve from a niche strategy employed by large cloud providers into mainstream strategy employed by 20% of Global 2000 organisations.<\/i>\u201d Gartner, March 18, 2011.<\/p><\/blockquote>\n<p>In the same report, Gartner recognised that ITIL and other \u201ctop-down\u201d best practice frameworks had not delivered on their goals, and IT organisations were looking for something new. They understood that because DevOps was primarily a cultural shift, driven from the ground up, it could prove far easier for technology departments to adopt than ITIL or similar frameworks<\/p>\n<h2>The Codification of DevOps<\/h2>\n<p>Two years later, Gene Kim, Kevin Behr and George Spafford wrote\u00a0<i>The Phoenix Project<\/i>, a novel about a failing organisation struggling to meet the demands of modern technological complexity and competition. This novel inspired technology leaders and engineers alike, because it described with eerie familiarity what it was like to work in a technology organisation with poor change control, problematic \u201cOps vs Devs\u201d cultures and inadequate visibility and monitoring of work or performance.<\/p>\n<p><i><a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/1942788290\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=1942788290&amp;linkId=688537f2b22a8bf8b68b233dfd2f80aa\"><img loading=\"lazy\" decoding=\"async\" class=\" alignright\" src=\"https:\/\/pictures.abebooks.com\/isbn\/9780988262508-uk.jpg\" alt=\"The Phoenix Project: A Novel about IT, DevOps, and Helping Your Business Win: Gene Kim; Kevin Behr;...\" width=\"196\" height=\"293\" \/><\/a><a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/1942788290\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=1942788290&amp;linkId=688537f2b22a8bf8b68b233dfd2f80aa\">The Phoenix Project<\/a><\/i>\u00a0was inspired by\u00a0<i>The Goal<\/i>\u00a0by Eli Goldratt. It demonstrated a number of actionable ways to improve the performance of your IT organisation, such as effective (but lean) change control, effective (and again, lean, testing), reducing WIP and unplanned work, and avoiding letting anyone become the bottleneck for processes. The \u201cbottleneck person\u201d in the book is Brent, a character who knows everything but hasn\u2019t documented anything. A key message of the book? Don\u2019t be Brent.<\/p>\n<p>Gene also introduces in the Phoenix Project one of the first efforts to codify DevOps, using \u201cThe Three Ways\u201d:<\/p>\n<ul>\n<li><i>Flow\u00a0<\/i>(or\u00a0<i>Systems Thinking<\/i>)<\/li>\n<li><i>Feedback Loops<\/i><\/li>\n<li><i>Continuous Improvement<\/i><\/li>\n<\/ul>\n<p>These \u201cThree Ways\u201d are concepts that echo the Toyota Way, Deming\u2019s \u201cPlan-Do-Check-Act\u201d cycle, and other best practices, made specific to the DevOps context. \u00a0Gene\u2019s subsequent book, written with Jez Humble (of \u201cContinuous Delivery\u201d), Patrick Debois and <a href=\"https:\/\/twitter.com\/botchagalupe\">John Willis<\/a> in 2016, \u201c<a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/B09G2GS39R\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=B09G2GS39R&amp;linkId=691898cc2fff1fe7ed498101b4bdd207\"><i>The DevOps Handbook<\/i><\/a>\u201d, goes deeper into the technical application of The Three Ways. It explores how to measure what matters to the business, and how to implement technical processes such as Continuous Integration and Continuous Delivery.<\/p>\n<p><a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/B09G2GS39R\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=B09G2GS39R&amp;linkId=691898cc2fff1fe7ed498101b4bdd207\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1881 size-medium\" src=\"https:\/\/tomgeraghtywordpress.s3-eu-west-1.amazonaws.com\/2022\/01\/devops-handbook-196x300.jpeg\" alt=\"devops handbook\" width=\"196\" height=\"300\" srcset=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/devops-handbook-196x300.jpeg 196w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/devops-handbook-768x1176.jpeg 768w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/devops-handbook-669x1024.jpeg 669w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/devops-handbook.jpeg 1672w\" sizes=\"auto, (max-width: 196px) 100vw, 196px\" \/><\/a><\/p>\n<p>it didn\u2019t take long to realise that there was another functional silo with a somewhat different set of interests than Dev or Ops: Security. Security, the IT profession realised, should be built into code as it is developed rather than added later on by a different team. Predictably, the idea became known as DevSecOps.<\/p>\n<p>Gene also introduces the concept of \u201cDevSecOps\u201d &#8211; the integration of DevOps practices into the application of information security. If\u00a0<i>The Phoenix Project\u00a0<\/i>was the \u201cwhy\u201d to do DevOps,\u00a0<i>The DevOps Handbook<\/i>\u00a0provides the \u201chow\u201d.<\/p>\n<h2>Measuring DevOps<\/h2>\n<p>Given that DevOps is at least partly about effective measurement and continuous improvement, it\u2019s self-evident that we, as an industry, should measure the success of DevOps itself. In 2012, Puppet began surveying people working in technology to understand the adoption and development of DevOps practices. They published \u201cState of DevOps\u201d reports which focussed on twenty key capabilities.These fall along familiar categories:<\/p>\n<ul>\n<li>Technical (version control, test automation, deployment automation, trunk-based development)<\/li>\n<li>Process (WIP limits, visual management, visualisation of the value stream)<\/li>\n<li>Cultural (team culture, learning cultures, and job satisfaction).<\/li>\n<\/ul>\n<p>Now taken over by DORA (DevOps Research and Assessment), an organisation created by Nicole Forsgren, Gene Kim, Jez Humble and Soo Choi, the State of Devops Report is being improved every year. According to Alanna Brown at Puppet, they \u201chave built the deepest and most widely referenced body of DevOps research available, drawing on the experience of more than 30,000 technical professionals around the world.\u201d The data from these reports demonstrates that Carr\u2019s view of IT as a cost centre was misguided. It is clear that IT is a powerful driver of value to an organisation where velocity, security and stability are essential for success.<\/p>\n<blockquote><p><i>\u201c\u2026software delivery is an exercise in continuous improvement, and our research shows that year over year the best keep getting better, and those who fail to improve fall further and further behind.\u201d<\/i>\u00a0Nicole Forsgren<\/p><\/blockquote>\n<p>On the back of the last four years of State of DevOps reports, Nicole Forsgren wrote the illuminating book \u201c<a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/1942788339\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=1942788339&amp;linkId=24c9691b960ef864740e1745c170d46f\">Accelerate<\/a>\u201d. It explains which metrics correlate to organisational performance, and what you should measure in order to find out where and how to improve.<\/p>\n<p><a href=\"https:\/\/www.amazon.co.uk\/gp\/product\/1942788339\/ref=as_li_tl?ie=UTF8&amp;tag=tomgeraghty-21&amp;camp=1634&amp;creative=6738&amp;linkCode=as2&amp;creativeASIN=1942788339&amp;linkId=24c9691b960ef864740e1745c170d46f\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1846 size-medium\" src=\"https:\/\/tomgeraghtywordpress.s3-eu-west-1.amazonaws.com\/2022\/01\/accelerate-199x300.png\" alt=\"Accelerate Nicole Forsgren\" width=\"199\" height=\"300\" srcset=\"https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/accelerate-199x300.png 199w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/accelerate-768x1160.png 768w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/accelerate-678x1024.png 678w, https:\/\/tomgeraghty.co.uk\/wp-content\/uploads\/2022\/01\/accelerate.png 1000w\" sizes=\"auto, (max-width: 199px) 100vw, 199px\" \/><\/a><\/p>\n<p>Forsgen states that the key metrics separating high from low performers in tech organisations are:<\/p>\n<ul>\n<li>Deployment frequency (and pain!)<\/li>\n<li>Lead time for change (from code commit to code deploy)<\/li>\n<li>Mean Time To Restore (MTTR)<\/li>\n<li>Change failure rate<\/li>\n<\/ul>\n<p>Interestingly, the first two of these metrics are throughput (traditionally development-oriented) measures; the last two are stability (traditionally operations-oriented) measures.<\/p>\n<h2>The State of DevOps in 2019<\/h2>\n<p>As of the 2018 State of Devops report, the findings consistently show that:<\/p>\n<ul>\n<li>Software delivery and availability unlock competitive advantages.<\/li>\n<li>How you implement cloud infrastructure matters.<\/li>\n<li>Use of open source software improves performance.<\/li>\n<li>Outsourcing by function is rarely adopted by elite performers and hurts performance.<\/li>\n<li>Key technical practices drive high performance. (i.e monitoring, automated testing, security integration)<\/li>\n<li>Industry doesn\u2019t matter when it comes to achieving high performance for software delivery.<\/li>\n<\/ul>\n<p>The statistics show that the high performers exhibit 46 times more frequent code deployments than low performers. They have a 7 times lower change failure rate, over 2,500 times faster lead time from code commit to deployment, and are over 2,600 times faster to recover from incidents.<\/p>\n<p>When an organisation can deploy quickly, recover rapidly, and suffer few outages, it has the ability to reach the market before competitors and respond to customer demand quickly. It will also provide more stable and secure service. This results, ultimately, in Goldratt\u2019s \u201cGoal\u201d, making more money for the business.<\/p>\n<p>Such a state is not reached by simply automating, using cloud technology, or recruiting a \u201cDevOps Engineer\u201d \u2013 it is the culmination of great team culture, continuous improvement, feedback loops, systems thinking, and a rigorous approach to using the right technology. DevOps is not a framework (like ITIL), an industry standard, a suite of tools, or a job title.<\/p>\n<p>DevOps encompasses the culture, technologies, tools, skills and processes that enable organisations to go from idea to production as rapidly as possible, incurring low risk and cost, and providing high security and reliability at scale.<\/p>\n<p>The definition of DevOps itself is continually evolving and improving, and while I may offer a definition as above, it will be out of date within days of writing, because, like the technology and services we build, it is continuously in flux, and being improved by the same people practising it.<\/p>\n<p>Where does DevOps go next? I believe that the scope of DevOps needs to widen. As mentioned above, a large reason why DevOps is so successful is that it&#8217;s a ground-up movement, created and progressed by the actual people doing it (unlike ITIL, for example). However, this has meant that DevOps, naturally, focusses tightly on the technological functions of an organisation.<\/p>\n<p>The next phase of DevOps includes practices and approaches such as &#8220;<a href=\"https:\/\/tomgeraghty.co.uk\/index.php\/platform-as-a-product\/\">Platform as a Product<\/a>&#8221; and also\u00a0broadens the scope of DevOps to the wider organisation, evolving into &#8220;<a href=\"https:\/\/tomgeraghty.co.uk\/index.php\/digital-transformation-and-enterprise-agility\/\">digital transformation<\/a>&#8221; using A<a href=\"https:\/\/enterprisersproject.com\/article\/2020\/6\/5-categories-transformation-failure\">ndrew Clay Shafer&#8217;s 5 Elements<\/a>, <a href=\"http:\/\/blog.jabebloom.com\/2020\/03\/04\/the-three-economies-an-introduction\/\">Jabe Bloom&#8217;s Three Economies<\/a>, and the broader, cross-sectoral concepts of <a href=\"https:\/\/tomgeraghty.co.uk\/index.php\/resilience-engineering-and-devops\/\">resilience engineering<\/a> in sociotechnical systems.<\/p>\n<h2>2023 Update: Safety Cultures and Platform Engineering<\/h2>\n<p>Over the past two to three years, DevOps has seen further maturity and adaptation to new norms, driven by unprecedented global circumstances and evolving technological trends. A particularly noteworthy shift has been the focus on building robust &#8216;Safety Cultures&#8217;. This approach emphasizes the creation of an environment where experimentation is encouraged, failures are seen as opportunities for learning, and psychological safety is paramount. Teams are given the latitude to innovate while knowing that missteps are not only tolerated but expected as part of the process of continuous improvement. This aspect has greatly enhanced the resilience of DevOps, fostering a more transparent, responsive, and adaptive culture.<\/p>\n<p>Platform Engineering has also been a rising trend, presenting a shift in how organizations perceive their development infrastructure. Rather than treating platforms as a collection of tools and services, they are viewed as integrated products that evolve with the needs of the end-users, who are the developers. This perspective empowers developers, reduces overhead, and ultimately accelerates the delivery of value to the business.<\/p>\n<p>The COVID-19 pandemic brought its own set of challenges and lessons. The necessity of remote working underlined the importance of strong communication channels, reliable cloud-based tooling, and the autonomy of distributed teams. It revealed the strength of DevOps practices in enabling organizations to maintain their pace of innovation even in the face of major disruptions. Companies that had already embraced DevOps were better positioned to navigate the transition to a remote work environment, demonstrating the value of adaptability inherent in the DevOps philosophy.<\/p>\n<p>As we look to the future, the trajectory of DevOps and related methodologies appears more integrated and comprehensive. The focus will likely continue to expand beyond the technological realm, permeating deeper into business strategies and driving broader digital transformation initiatives. The trends of Safety Cultures and Platform Engineering are expected to solidify, with even greater emphasis on psychological safety, learning from failures, and treating internal platforms as products.<\/p>\n<p>Furthermore, the remote working lessons from the pandemic will likely catalyze a shift towards more distributed, asynchronous ways of working. We may see a rise in &#8216;RemoteOps&#8217;, an evolution of DevOps practices adapted for a world where remote and flexible work arrangements become the norm. In this era, principles of effective remote communication, time-zone friendly practices, and trust-based management will become critical. In essence, the future of DevOps is about expanding its boundaries, integrating more closely with business goals, and continually evolving to meet the demands of our ever-changing world.<\/p>\n<footer id=\"colophon\" class=\"site-footer\" role=\"contentinfo\">\n<div class=\"site-info\"><\/div>\n<\/footer>\n","protected":false},"excerpt":{"rendered":"<p>[Updated June 2023] DevOps may be one of the most hyped concepts in the tech industry in recent times. Yet what it actually consists of is the subject of much debate: some describe DevOps as a culture of process improvement, whilst others describe it in purely technological terms of automation and cloud technologies. The Origins &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/tomgeraghty.co.uk\/index.php\/the-history-and-evolution-of-devops\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;The History of DevOps&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":1498,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[103,94,22,102,41,44],"class_list":["post-1311","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","tag-aws","tag-cloud","tag-data","tag-devops","tag-it","tag-itil"],"_links":{"self":[{"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/posts\/1311","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/comments?post=1311"}],"version-history":[{"count":22,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/posts\/1311\/revisions"}],"predecessor-version":[{"id":2209,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/posts\/1311\/revisions\/2209"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/media\/1498"}],"wp:attachment":[{"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/media?parent=1311"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/categories?post=1311"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tomgeraghty.co.uk\/index.php\/wp-json\/wp\/v2\/tags?post=1311"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}