A new era of data-driven operations is here. Latest CIO Research shows how leading organisations are navigating this shift:
Transforming IT Operations
Analytics and automation are fueling
an IT operations revolution that’s driving
business value. Are you ready?
For CIOs, A New Era Of Data-driven Operations
When IT operations is fueled by data and empowered by intelligent automation, amazing things happen.
IT leaders can look beyond the rear-view mirror of monthly reports, as their teams move on from manual operational tasks like patching and configuration.
Instead, they can harness the power of Artificial Intelligence (AI) to make decisions based on insight that’s realtime, even predictive. They can use automation to continuously optimise IT infrastructure: effortlessly provisioning and scaling services, assuring compliance, blocking security threats, and monitoring performance.
The end result? Operations is no longer a battle to maintain uptime in the face of growing infrastructure complexity. It becomes an opportunity to anticipate what the business and its customers need, to innovate and deliver faster. In other words, to create value at the speed of change.
It’s an exciting vision—particularly for Chief Information Officers (CIOs) who might feel that operations has traditionally distracted from efforts to innovate and partner with the business. But how do you make that vision real?
IT Operations Readiness Index
How real is the vision of data-driven, automated operations? Where are organisations today? And what does it take to get there?
These are questions Cisco set out to answer in the IT Operations Readiness Index, a global research study of more than 1,500 senior IT leaders.
The heart of the IT Operations Readiness Index is a four-step model for IT operations maturity, focused on how organisations handle events they face (see Figure 1).
As organisations advance along this continuum, they use data to look further into the future and continuously optimise their operations.
Data-Driven Operations in Action
Take a simple example: a network outage. A reactive organisation would have no warning before traffic stopped flowing. Teams of administrators would scramble to get systems back up and running.
A predictive or preemptive organisation would detect early indicators of the impending outage in real time (such as a cluster of error messages), diagnose the root cause, apply a fix, and reroute prioritised traffic to maintain service levels.
Potentially, this could occur with no human involvement, as AI finds the patterns and automation executes the responses.
Unlocking Operations Success
The IT Operations Readiness Index validates the four-step maturity model and identifies the behaviours that set more advanced organisations apart.
IT leaders can use the model to benchmark themselves against their peers and chart a course for change.
Let’s examine the findings.
Operations Is Becoming
A Strategic Focus
Plenty of initiatives are competing for attention— and budget. IT leaders are recognising that transforming operations is a priority.
IT operations infamously consumes the lion’s share of IT budget. According to ZK Research, 78 percent is spent on “running the business,” leaving little for innovation.
The accepted narrative is that operations budgets should be cut to free resources for transformation.
Instead, our data suggests the answer is to invest in transforming operations itself.
On average, respondents have allocated 28 percent of their current IT budget to operational initiatives focused on IT optimisation and issue remediation (see Figure 2).
That’s already a significant share—but more than two thirds expect to increase that spend in the next 12 months.
Where is this money going? Respondents told us they had big plans: to gather operations data from more areas of their infrastructure (which in many cases involves hardware refresh or implementing a collector service); to perform more analytics (with associated costs for tooling, AI training, services, and people), and to extend automation into more processes and infrastructure areas.
To Drive Customer Value,
Invest In Operations
Organisations at various levels of maturity reported benefits from investing in operations. These benefits go beyond traditional operations KPIs, right through to the customer.
If 28 percent of IT budgets (and growing) are going toward transforming operations, is this investment paying off? In short, yes.
Our data shows that the vast majority of organisations report a wide range of benefits as a direct result of their investment in operations throughout the past year.
Respondents see benefits (often “significant” benefits) in external customer experience, innovation, and responsiveness — outcomes that any transformational CIO would seek. Predictive and preemptive organisations reported even stronger benefits.
Operations data delivers value to the business
The positive impact of IT operations on the business goes beyond simply delivering infrastructure well (for example, better system availability would tend to make for happier customers).
It also comes from the business making direct use of IT operations data.
Already 40 percent of respondents say their organisations rely “heavily” on IT operations data to make business decisions.
The potential use cases for applying operational data to business decisions are endless, everything from optimising a retail store layout by analysing Wi-Fi traffic to improving team productivity by analysing the adoption and utilisation of collaboration tools.
Ambitious IT leaders will use operational data to forge closer relationships with their business stakeholders.
The Race To Preemptive
Is Just Beginning
Organisations are spread across the maturity spectrum. And relatively few have attained preemptive operations. But the opportunity is huge.
Only 14 percent of our respondents say they have achieved consistently preemptive operations today.
Looking ahead two years, we see a very different picture. Two-thirds of organisations expect to attain predictive or preemptive capabilities, with only 7 percent left at reactive.
As most IT leaders would admit, IT transformation does not always progress smoothly. And realising these ambitions may prove challenging. But there’s a clear message that the clock is ticking.
“Organisations can’t stay reactive. Very quickly, these businesses will fall behind and many will go out of business.”
Zeus Kerravala, ZK Research
“Preemptive” doesn’t mean “perfect”
Our survey looked in detail at the methods and capabilities our respondents use to run their infrastructures.
For example, do they collect infrastructure telemetry data periodically, or gain better insight by streaming it in real time?
While preemptive organisations are significantly ahead in adopting such cutting-edge capabilities as continuous analytics and process orchestration, Figure 5 shows that these practices are far from universal even in this elite group.
Even if an organisation has attained preemptive ability, they still have many opportunities to advance further.
All organisations should create a culture of continuous learning and improvement to stay ahead of the curve.
Artificial Intelligence Plus Talent
The combination of human talent and leadership with AI will shape the future of IT operations.
On the leadership front, 70 percent of respondents say they have a Chief Data Officer (CDO) in place.
The CDO often has a broad role encompassing privacy and compliance, customer data, and intellectual property.
But our research shows that CDOs can play a valuable role liaising between the business and IT to ensure that the organisation gets full value from operational data.
Organisations with a CDO say they have allocated a greater percentage of IT budget to operational initiatives (31 percent vs 15 percent for those who have no plans to appoint a CDO).
And they are more likely to “heavily” use IT data for business decision-making (46 percent vs 31 percent).
A CDO can also partner with the CIO to help bring new roles and disciplines to IT teams. For example, organisations with a CDO employed on average 55 data scientists; it fell to 36 in those with no plans to hire a CDO.
As new technologies continue to disrupt familiar ways of working, these evolving roles will be critical to the future of IT operations.
AI is critical for turning data into value
Forty-two percent of our respondents believe that artificial intelligence (AI) will be the biggest disruption to their automated operations in the future
(see Figure 6).
Already, 51 percent use AI for automation to some degree, with another 38 percent planning to do so in the next 12 months. Organisations with a CDO in place are more likely to use AI.
With the speed, complexity, and sheer size of the data sets being gathered from IT infrastructures, static business rules and manual data processing will be unworkable. AI is the answer. Cognitive systems see patterns in data that humans cannot, at speed, and economically at scale. The insights and recommendations from AI systems can inform human decision-making, or AI systems can be trusted to make autonomous decisions.
The use cases are innumerable. For example, service providers can use predictive models built on AI and machine learning (ML) not just to track customer churn rates on aggregate, but to monitor how micro-segments of customers use different services, and adapt everything from traffic prioritisation to marketing messages to maximise retention and lifetime value for each individual.
Vendors Are a Data Goldmine
More advanced organisations turn to vendors to assist with all stages of the operations lifecycle. But the real value lies in the data they hold.
As you’d expect, almost all organisations use outside vendors at some stage in their handling of operational data, to out-task particular processes such as data aggregation or alerts; or to provide analytics and automation tools, increasingly with AI/ML capabilities baked into the service.
Preemptive organisations make more extensive use of vendors across the board (see Figure 7), and all organisations say they plan to increase the range of activities they use vendors for.
Our data suggests that organisations will increasingly look to vendors as a source of data sets to supplement internal telemetry. The reason? AI and machine learning are as good as the data that feeds the algorithms, and vendors can offer access to data collected globally.
For instance, internal network monitoring will measure your network’s performance; but only a vendor with performance data on thousands of networks can place your own success in context. These vast data sets also enable powerful AI engines to build accurate, predictive models.
of our respondents said it’s imperative to have access to data beyond what is collected internally.
Security Is The Tip Of The Spear
For Data-driven Operations
Of all the infrastructure areas we looked at, security was the most data-driven across the board.
As Figure 8 shows, more organisations collect operational data from their security infrastructure, analyse that data, and automate security than any other infrastructure area.
Security’s lead is partly explained by the urgent need for investments in compliance. But it’s also due to the business impact that analytics and automation have in the security space. After decades of education, business leaders now fully appreciate that fast, accurate responses to security threats protect customer relations and the
Already, the use of AI is becoming common in security for analysis of risk and compliance exposure. Vendors play a central role as providers of threat intelligence, especially considering that specialist cybersecurity talent is in short supply.
In all these ways, security gives CIOs a glimpse into where their entire infrastructure is heading. Savvy CIOs can use security to prove the value of investing in preemptive operations in other infrastructure areas.
IoT Is The
Bridge To The Business
The Internet of Things gives CIOs an opportunity to show value and get closer to the business.
While traditional IT infrastructure, like servers and switches, are firmly in the “back room,” operations technologies (OT) like IoT pave the way to a tighter collaboration with the business.
In most cases, IoT devices, such as connected cars or smart meters, are considered business assets, and the operational data they produce is vital to business operations.
Preemptive organisations see this. Seventy-four percent gather operational data from IoT, compared to 59 percent of reactive organisations.
of preemptive organisations say that Internet of Things technologies are critical to running their IT infrastructure more efficiently.
The particular nature of IoT deployments clearly exposes the need for new approaches to infrastructure management:
► IoT devices may be deployed in the millions—automation is the only way to manage them effectively.
► In many IoT use cases, operational problems may have serious, even life- threatening consequences—there’s far greater demand for real-time monitoring.
► And in some cases there’s no guarantee of a constant connection between HQ and remote IoT devices—this is driving investment in edge and fog analytics (only 54 percent of respondents are using edge analytics at all today).
CIOs should view IoT as the bridge to the business, and use these operational realities to drive their businesses to invest in transforming operations.
Start Your Own
IT operations are a potential competitive differentiator.
With the right data, key insights mined from them, and the ability to automate operational tasks across your infrastructure, you can deliver a strategically superior service to your business.
The IT Operations Readiness Index outlines four stages of maturity that organisations pass through. We’ve created a five-minute online self-assessment tool that you can complete to map yourself against the model, and benchmark your maturity score against your peer groups.
Wherever you are today, getting to preemptive nirvana requires comprehensive approaches across policy, data, and automation. Here are four actions to focus on first:
Build comprehensive data-collection policies with real-time, event-based collection for training AI systems to accurately predict outages and manage systems security and health.
Supplement internal data with external data to enhance predictive power and to increase the accuracy of predictive algorithms. For example, use social media chatter about a sports event combined with geolocation data to better predict peak network traffic and preempt an outage.
Fully automate the low-risk, high-volume processes. However, for high-risk, high-impact decisions, let AI recommend the action and have a human operator make the final decision.
Finally, make diversity and inclusion a core value and design principle when recruiting the teams responsible for building AI systems. This ensures that systems and predictions are not biased.
The IT Operations Readiness Index survey was conducted in April–June 2018. Working with an independent research organisation, we surveyed 1,522 IT leaders about their IT operations via a web-based survey.
Thirty-eight percent of our respondents identified themselves as a C-level IT decision-maker, such as a CIO, CTO or CISO. Each had strategic responsibility for relevant areas of IT operations, across multiple infrastructure areas. Our respondents represented a balanced distribution of public- and private-sector industries.
We surveyed organisations ranging from 500 employees to 50,000+ employees.
Cisco’s Thought Leadership Team
Eran Levy, Project Director
Jessica Hill, Program Manager
Riley Mills, Marketing
Luisa Rebolini, Marketing
Ari Kapur, Research Manager
Stefanie McCann, Contributor
Kevin Delaney, Editor
Ant Newman, Analyst and Report Author
Jaishree Subramania, Strategic Direction
Rajat Mishra, Strategic Direction
Rahul Singh, Research Guidance
Joseph Bradley, Strategic Direction
Faryn Davis, Project Manager