Software is eating the world, in all sectors. Marc Andreessen, the founder of Netscape, said it long back about how software is eating the world. He also summarised that every company is a software company these days, and software companies are poised to take over broad swathes of the economy. You’ll see DevOps clearly in 2020, where continuous updates transform the way software is delivered to a nearly-limitless marketplace. DevOps has become a must to thrive in this highly competitive technological world.
Introduction to DevOps
While firms have different meanings of DevOps, we can define DevOps as a mindset that a team adopts to gear its engineering momentum to newer heights. DevOps is mostly about eliminating the barriers in engineering and mainly the cultural obstacles that come in between the idea and execution, making the process of shipping software better, faster, cheaper and more secure.
Whatever you may call it, it should all come down to automation at the end of the day, which in turn should help firms with developing fast, shipping fast, fail fast, recovering fast, and learning fast.
From the SDLC model to today, things have changed tremendously. in 2009, DevOps was coined, and it advocated a cultural transformation and some tech principles where everything was treated as code. Then came over the principles like CI/CD, but still, the software used to be written as a big monolith & this had numerous challenges.
So in 2011, microservices architecture was introduced, this microservices architecture advocated the fine-grained and loosely coupled components with a specific task to be carried.
The applications written following this loosely coupled microservices-based architecture were termed, cloud-native. The firms are transitioning from VMs to Kubernetes to Serverless, depending on their business needs and goals.
According to a slide from Black Hat USA 2019 by Kelly Shortridge & Dr. Nicole Forsgren, Four factors are important while benchmarking yourself with the elite performers in the DevOps industry.
- Lead time for change
- Release frequency
- Time to recovery
- Change failure rate
Source Credits: Black Hat USA 2019 by Kelly Shortridge & Dr. Nicole Forsgren
In this article, we will see what the future holds for DevOps.
1. Cloud-Native will become a must:
The Diamanti survey of more than 500 IT leaders implies container technology, by all means, has grown far beyond and has matured dramatically in one year and moved from developer experimentation to production. Cloud-Native technologies will rise to new elevations, especially Kubernetes adoption. Cloud-Native technologies give a higher advantage for the firms in faster time to market
Why Cloud-Native?
Adopting to cloud-native practices means better innovation + advanced transformation + richer customer experience. As described in my other article, 'Cloud-Native DevOps.' - Cloud-Native fundamentally boosts cloud automation. It refers to automatically managing the installation, configuration, and supervision of cloud computing services. It is about using technology to make more reliable business decisions for your cloud computing resources at the right time. The Cloud-Native approach helps to release software faster with cloud automation.
According to Oracle's predictions about the future of cloud-native, it is estimated that 80% of enterprise IT will move to the cloud by 2025. The CNCF survey results showed that the use of cloud-native technologies in production has grown over 200%.
Source Credits: TheLinuxFoundation
Last year, Abby Kearns, executive director of the open-source platform as a service provider Cloud Foundry Foundation, delivered a keynote at LinuxCon + ContainerCon + CloudOpen China (known as LC3) in 2018 explained a more in-depth view of cloud-native and the future.
“Cloud-native technologies and cloud-native applications are growing,’’ Kearns said. Over the next 18 months, there will be a 100 percent increase in the number of cloud-native applications organizations are writing and using, she added. “This means you can no longer just invest in IT,” but need to in cloud and cloud technologies as well. (Quoted from Abby Kearns’s key note shaping the cloud native future)
U.S. Air Force is one of the most excellent examples she took in her talk on how agile they have become and using bleeding-edge technology & cloud-native principles. The U.S Air Force has implemented agile practices and is now taking advantage of cloud and developing apps to run on multiple clouds.
2. There will be a rise in the container registry services:
This point should have been included in the cloud-native part itself. Still, I think this needs special attention as most of the software companies now are indulging themselves with the container registries that help developers store and manage artifacts and all dependencies for the smooth flow of software development life cycle.
Just like managing application source code in a version-controlled repository such as GIT, managing Docker images is very crucial. Docker also provides similar capabilities of managing Docker images that can be managed locally on your development machine and even on a remote container registry, also known as Docker hub.
But, sometimes, these images are prone to many security-related issues and can be easily accessible by hackers. Hence, modern firms need a safe and secure way of managing and maintaining their container images through registries, container registries.
Container registry has become a must to have when it comes to DevOps teams working with containerized applications and microservices architecture. With the popularity of Docker and cloud-native applications increasing day by day, container image management has become a vital part of modern software development. Container registry is simply a collection of repositories that are primarily made to store container images.
In a recent KubeCon conference at San Diego, JFrog announced its own container registry that is impeccable and robust compared to any other in the market right now, the JFrog Container Registry. Based on the robustness of Artifactory, JFrog Container Registry is the most hardened, proven and robust free container registry on the market. It is scalable, hybrid, comes with the fine UI of Artifactory and powered by Artifactory.
The top notable container registries available in the market today include the following,
- Amazon Elastic Container Registry (ECR)
- Docker hub
- JFrog Container Registry
- Azure Container Registry
- Google Container Registry
The private container registries allow companies to apply policies, security, access controls, and more to how they manage containers. The container registry should have features that include fully hybrid, Docker registry, Helm registry, Generic repositories, Remote repositories, Virtual repositories, and rich metadata.
What is the need for container registry?
There are a few reasons
- As the cloud-native approaches are increasing, we see rapid digital transformations at enterprise level happening with tools like Kubernetes, Docker, Artifactory, Helm, Istio, etc. The whole world is rapidly moving to container registry technologies & that is the future of containerized applications to ship fast and securely.
- The Hybrid competition is heating up. Most of the cloud providers are providing registries for their services with a free tier since they know its importance.
- Docker containers tend to take up a lot of storage space and are moved around a lot. This means a high cost in storage and sometimes, security can be an issue. As a result, we see some firms using Artifactory for everything except Docker - and using other free tools to manage their containers. It is great to see that JFrog has its own container registry now:)
- Registries can act as remote and virtual container repositories, with rich metadata which are a useful factors in DevOps.
- To gain valuable insights about your artifacts.
3. Golang and DevOps will thrive together:
Golang as a programming language will create more impact on the DevOps community, it is already making an impact. Most of the DevOps tools like Kubernetes, helm, Docker, etcd, Istio, etc are written in Go. Joe Beda, the creator of Kubernetes, writes about why Kubernetes is written in Go.
Golang is excellent for working in environments where you can’t or don’t want to install dependencies since it compiles into a stand-alone binary. Without having to get the whole environment set up, you can get things done in a much faster way than other programming languages.
JFrog surveyed over a thousand developers at the most recent GopherCon conferences in London and San Diego, to better understand the Go community and general sentiment towards Go modules.
What did they find?
- Go Developers Are Highly Engaged
- Over 82% of Go developers use a Go version capable of using Go modules, and nearly the same total either use them now or expect to by mid-2020.
- Go Modules Adoption is High
- GoLang is Used Widely Across Industries
- Choosing Go Modules is Hard
Also, take a look at my article that talks about what makes Go so good for DevOps.
4. Security will become an even high-priority factor (DevSecOps):
Security gets more priority in the development life cycle than ever. Security becomes everybody’s responsibility rather than just the security experts.
Source Credits: Statsflash
Even though the word ‘DevSecOps’ seems like just another buzzword bingo, it is required, to give more importance to security. DevSecOps creates security awareness and a shared knowledge base within the organization to tighten the security in the software development process. Capital One breach, earlier this year, made cloud security a concerning factor and hence the focus is on securing data in the public cloud.
Samsung Note 7 disaster explains a lot about why security is so crucial at the beginning of the process and at each stage of the development life cycle. Specialists speculate that one of the problems with the Note 7 phones involved its battery management system. This system monitors the electric current and stops the charging process when the battery is full. A fault in this system led the battery cell to overcharge, become unstable, and eventually explode.
This bug fix cost Samsung nearly $17 billion. Had the company caught the issue earlier, they could have saved a lot of money and the brand reputation.
[Credit source of the above story: Synopsys]
Have some strategic approach to make security a must in the organization, here are some points to take care,
- Start small, have security checkpoints at each stage of the development life cycle from the beginning.
- For developers, make security part of their job and part of their performance review.
- Development & operation teams need to treat security as quality.
- Don't separate DevOps and Security; unite them thoroughly, make it your engineering team's mantra.
Chaos engineering principles will get adopted by many firms to check the stability and reliability of the systems and to see the extent of security concerns. Intentionally harming systems can help you find bigger bugs & will make sure the hackers don't find any loopholes in the system. This will also help organizations to find bugs before their customers do. The aim is to keep making your systems stronger than ever.
5. Open-Source will grow beyond boundaries:
Open-source gets more and more attention since the advantages & flexibility that it brings to the developers. Open source is on the move, a recent survey by Synopsys found that almost 70% of corporate organizations are either contributing to or have open-source projects.
Why Open source?
Open-source software is great for developers to improve their skills personally,
- Learn new techniques and efficient ways to solve the problem.
- Since very experienced developers also will be working on the project, you will get knowledge of working together on projects.
- Contributing to Open source software creates a sense of belongingness; it will make you a part of something big, a community with the same goals and mindset.
In a recent Open Source India 2019 conference, we surveyed almost 300 open source professionals and below is the result of responses when we asked them the reason to like Open source software.Customization is the fact that most people like open-source software.
A recent research study by CB Insights, it is estimated that the open-source services industry is set to exceed $17B in 2019, and expected to reach nearly $33B by 2022.
The big giants like Microsoft, Google, Intel, and Facebook — which are not open-source companies, are actively contributing to various projects on GitHub. Google employees have made 5,500 collective contributions in 2018. Many of these contributions have helped smaller, independent projects.
Majority support is for Google’s open-source software projects like Kubernetes, Istio, and Knative, which are in high demand. As corporate-sponsored projects become more popular, independent developers will continue to contribute. This shows that the giants should come forward and help the open-source community to grow.
For example, Microsoft’s Visual Studio Code project has over 19,000 contributors in total. With thousands of developers contributing, these tech giants benefit from the free developer input and direct user feedback. This allows organizations to build better software faster. Open Source technology has definitely gone mainstream & has a bright future.
[Source: CB Insights]
Cheryl Hung, Director of Ecosystem at Cloud Native Foundation, makes it clear in her recent talk at ‘The Linux Foundation Open Source Summit,’ Europe that large companies are now working on Open Source projects. Especially Kubernetes, has created a huge community.
Credit Source: The New Norms of Cloud Native - Cheryl Hung, Director of Ecosystem, Cloud Native Computing Foundation
6. Serverless is still new but has a bright future:
Deploying in milliseconds is the future & many firms are making use of serverless architecture to the fullest extent already. The Serverless market is expected to reach $7.7B by 2021. According to RightScale's 2018 State of the Cloud report, Serverless is the fastest-growing cloud service model today, the annual growth rate is 75% and is expected to go beyond expectations in 2020.
Current serverless computing options include:
Why future developers prefer serverless?
- Developer productivity
- Faster deployments
- Enhanced scalability
- Great user experience
- Lower costs and infrastructure things to worry about
Source Credits: Deloitte Consulting LLP
In May 2017, Microsoft CEO, Satya Nadella, acknowledged the potential of serverless and its ability to change the mechanics of cloud computing.
He said, “But one of the things that I think is going to change how we think about logic completely is 'serverless'… So the serverless computation is going to fundamentally not only change the economics of what is back-end computing, but it’s going to be the core of the future of distributed computing.” - Credits: CB Insights
Lego’s journey to Serverless
Lego's journey to Serverless will show you how your journey can start with a small step & end up with a big success. Black Friday Cyber Monday disaster made them move to Serverless. The Lego had a legacy system that includes Oracle ATG eight servers talking to the same database with SAP in the back that goes to a TAX system.
With the above legacy system, they went on for the Black Friday Cyber Monday event, which turned into a disaster while the system couldn't control the night vertical peak. As a result, the series of events took place where the TAX system went down first, and then that took the SAP down, and as a result, the whole Lego e-commerce platform was down for flat 2 hours. This made them go through a considerable loss.
Source Credits: Serverless Journey of shop.LEGO.com - Sheen Brisals
This event made them think about Serverless. How?
After the disaster, the Lego team decided to move to cloud, have a simple API, have a Lambda behind it, and just use it. This was the first step to move to Serverless at Lego. This made them also move to a microservices architecture and even DevOps and automation.
The Lego team started with a single Lambda to calculate sales tax, and now it makes use of n number of Lambda.
The whole talk is here ‘Serverless Journey of shop.LEGO.com - Sheen Brisals’
7. Digital transformations will set examples for others:
We will see many organizations getting out of their comfort zones and trying out new technologies and even the traditional sectors like healthcare, financial institutes, governments will see an overall drastic improvement with digital transformation by embracing cloud-native and DevOps practices. Let us see some interesting recent case studies.
See how FedEx, a courier delivery services company, found its way to Digital Transformation. FedEx didn't have enough IT professionals to work with the modern Cloud-Native and DevOps processes, but it didn't stop there. FedEx knew the problem of not having the right skills in its talent pool of engineers, and hence CIO Rob Carte found a solution. FedEx became a university, started teaching its own engineers the advanced computing skills & modern way of software development.
For this initiative, the team was created, and it was named 'The Cloud Dojo.' The Dojo comprises a cross-functional team of expert cloud developers, security professionals, and operations specialists, co-located in one location. The aim was to train the team to move the traditional engineering with modern cloud practices - DevOps, Cloud-Native, Rewriting legacy applications to run in the cloud, and automation. This homegrown team, called Cloud Dojo, has reskilled more than 2,500 software programmers.
To date, FedEx has rewritten more than 200 production applications for the cloud, with more than 300 apps on tap. FedEx's Cloud Dojo team won the 2019 CIO 100 Award in IT excellence. Read the whole story & FedEx's CIO, Carter's CIOs tips.
Box’s digital transformation Journey:
A few years ago at Box, it was taking up to six months to build a new microservice. Fast forward to today, it takes only a couple of days. How did they manage to speed up? Two key factors made it possible,
- Kubernetes technology
- DevOps practices
Founded in 2005, Box was a monolithic PHP application and had grown over time to millions of lines of code. The monolithic nature of their application led to them basically building very tightly coupled designs, and this tight coupling was coming in their way. It was resulting in them not being able to innovate as quickly as they wanted to. Bugs in one part of their application would require them to roll back the entire application.
So many engineers working on the same code base with millions of lines of code, bugs were not that uncommon. It was increasingly hard to ship features or even bug fixes on time. So they looked out for a solution and decided to go with the microservices approach. But then they started to face another set of problems, that's where Kubernetes came in:)
See the full video talk by Kunal Parmar, Senior Engineering Manager at Box.
8. Multi-Cloud will flourish to new heights:
The multi-cloud approach will flourish. The majority of enterprises have a hybrid cloud strategy. Many of the applications are written to run on-prem and off-prem and potentially on multiple public cloud environments. Google's cloud services platform Anthos is just an amazing validation that multi-cloud is going to be too flexible and cost-effective for software firms.
Azure and AWS being the leaders in this space are going to dictate the multi-cloud future.
According to recent RightScale 2019 State of the Cloud Report, it is seen that 84% of enterprises have a multi-cloud strategy.
Source Credits: 2019 State of the Cloud Report
Multi-cloud is highly relevant to today's growing market trends. According to a recent IDC survey named 'Cloud Repatriation Accelerates in a Multicloud World,' multi-cloud best describes today’s cloud reality.
While there is a lot of talk going on about cloud cost optimization and vendor lock-in, multi-cloud addresses some crucial facts here, this is the model used by companies to avoid vendor lock-in, cost optimization, security, data sovereignty, minimizing downtime, etc.
Embracing DevOps is just the conversation starter and there is a long way to go. The number of companies are increasing day by day and the dependency on the cloud is hence making the DevOps market a big one. Allied Market Research estimates the DevOps market to reach $9.40 Bn, globally, by 2023 at 18.7% CAGR. DevOps brings development and operations together and gives higher confidence and freedom to the teams to ship at a higher velocity and with quality.
DevOps isn't done growing yet; it is evolving day by day & has a bright future. We all know this, 2018 was the Year of Enterprise DevOps, according to Forrester. Businesses that practice DevOps practices recover 24 times faster from failures and spend 50% less time remediating security issues, DevOps is proven to produce happier and more engaged teams.
Hope these DevOps trends will give you an idea about where the market is going forward and how can you prepare yourself to be more agile and release fast.