Authored By: Thomas Kunnumpurath, Vice President, Systems Engineering – Solace
Over the next 12 months and beyond, there will be four data-driven technologies that will drive change in the business landscape, and they range from the macro to the micro level. These technologies will enable every business to make greater use of their data, improve business efficiency and serve their end customers better and faster than ever before. These four technologies are as follows:
Applied Observability—Getting Down to the Detail of What’s Happening across a Business
Observability has grown up, breaking out from its infant stages as a tech-focused term to something that organisations realise will provide the key to keeping track of key data events in an increasingly de-coupled business world spanning systems architecture to the business operations it supports.
Moving forward, we now have the next level, “Applied Observability,” recognised by Gartner as a key 2023 strategic tech trend at its most recent Orlando Symposium.
Applied Observability enables organisations to exploit their data artifacts for competitive advantage. That means being able to ensure that the right data is delivered at the right time for rapid action, based on confirmed stakeholder actions rather than intentions. “Observable” data include key digitised artifacts, such as logs, traces, API calls, dwell time, downloads and file transfers, which appear when any stakeholder takes any kind of action. Applied Observability feeds these observable artifacts back in a highly orchestrated and integrated approach to accelerate organisational decision making and allows the business owner to track how long an action took to fully process at every point in the workflow. By having this visibility into end-to-end workflows, businesses can gain better visibility into how long their systems took to process a workflow and get real-time insights into bottlenecks or areas for improvement to ensure their systems function optimally.
But unearthing these insights requires an event-driven approach to software architecture. Distributed tracing, for example, is a method of tracking application requests as they flow from front end devices to backend services and databases. By definition, and in contrast to traditional tracing, distributed tracing can be visualised to show a searchable, graphical picture of when, where, and how a single event flowed through an enterprise, regardless of the number of hops the workflow took to fully process.
“Applied Observability enables organisations to exploit their data artifacts for competitive advantage. That means being able to ensure that the right data is delivered at the right time for rapid action, based on confirmed stakeholder actions rather than intentions.”
Consider the potential traceability and end-to-end observability benefits across a payment ecosystem underpinned by event-driven architecture. Embedding distributed tracing into an event mesh emits trace events in OpenTelemetry format so banks can collect, visualise and analyse them using any compatible tool. This empowers them to not only confirm that a given message was published, but easily understand exactly when and by whom, where it went, down to individual hops, who received it and when . . . or why not.
When planned strategically and executed successfully, Applied Observability is arguably the most powerful source of data-driven decision making. And, since OpenTelemetry is a well-defined open standard, it can be implemented across both synchronous and asynchronous workflows.
Hyper-Automation and Intelligent Automation: Taking Automation to the Next Level
Gartner and IDC identify both hyper-automation and intelligent automation in their yearly technology trends for 2023. Hyper-automation moves automation up a level, adding more intelligence to automation and using a broader set of tools so that previously un-automatable tasks can be automated. Hyper-automation initiatives come in many different shapes and sizes and are being seen across a wide range of industries, from banking and insurance to manufacturing and healthcare.
Gartner points to U.S. healthcare company CVS Health as a prime example, having taken advantage of hyper-automation to simplify its unwieldy benefits administration processes to improve efficiency, accuracy and customer service. A new system was developed to streamline tasks from application receipts and payments to issue resolution. These were cross-functional, largely manual and time-consuming tasks beforehand, which involved analysing data in a wide range of formats and aligning with complex coding rules. However, using a combination of Artificial Intelligence (AI), RPA (robotic process automation), Machine Learning (ML), data analytics and natural language processes (NLP), the company was able to automate much of this work.
As consumers of goods and services continue to demand faster and better customer service, companies need to overlap development cycles and find ways to cost-reduce portions of what they deliver to stay ahead of the curve. Removing the friction that slows down implementation teams is key to success with end-customers.
But hyper-automation requires an organisation to be underpinned by an event-driven architecture (EDA) and—more specifically, an event mesh—to maximise success. An event mesh is an interconnected network of event brokers that allows data to be pushed in real time to parts of the organisation where the data is needed. It does this dynamically, meaning that new event types can be added any time, and interest in events can be registered allowing a seamless interchange of data for the applications that are interested in using it.
Take the aviation industry as an example. An event mesh streams information such as flight routes, delays, cancellations and mileage accruals between applications, connected devices and people anywhere in the world, instantly. With an event mesh, information about events can be continuously streamed to multiple systems, filtered so each system only receives the data it needs. This ultimately enhances the customer experience as passengers, pilots, and crews are notified in real time when something relevant occurs on each and every flight.
“Hyper-automation moves automation up a level, adding more intelligence to automation and using a broader set of tools so that previously un-automatable tasks can be automated. Hyper-automation initiatives come in many different shapes and sizes and are being seen across a wide range of industries, from banking and insurance to manufacturing and healthcare.”
Or take the working example of Heathrow Airport. After downsizing its IT department during the pandemic, it needed to reduce its dependency on IT to deliver solutions. The answer was to pivot the department to the role of orchestrator, building a low-code/no-code community of practice that enabled employees across the wider business to build in their own automation for health and safety apps to support a safe return to work or live audits. As of last August, Heathrow’s hyper-automation efforts had garnered huge savings in potential outsourcing costs, reduced paperwork by 120,000 pages and decreased manual data entry hours by more than 1,170.
Acceleration of the Event-Driven API Economy
The API economy has exploded with the proliferation of web applications and with the rise of digital businesses that need to expose and connect applications and assets using familiar architectural patterns and protocols such HTTP/ Representational State Transfer (REST). Research from MIT Initiative on the Digital Economy has shown that over a four-year period, businesses using APIs saw 12.7% more growth in market capitalisation compared to those that did not adopt APIs.
But the API economy is changing, as event-driven architecture and asynchronous event-driven APIs are becoming increasingly important to companies that are striving to make their business processes, customer interactions and supply chains more real-time. Using both synchronous and asynchronous methods can result in an application environment in which system resources are most effectively used.
AsyncAPI and RESTful APIs will be the next evolution of the API Economy. API Management Platforms will need to quickly adapt to this new reality. As a prime example, Forrester recently spotlighted a global biotech company that is blazing a trail in the API-driven area. As the case study demonstrates, the organisation understood that EDA is a complement to RESTful APIs—another tool in their digital business toolbox, filling in the gaps of a REST-only approach.
As a result, they planned a unified event + REST approach from the outset. Both APIs and events are managed as enabling digital products, with the governance and lifecycle of both unified as one process. A platform team builds a unified API + event platform for app dev teams rather than building each as a separate siloed platform. The results include faster speed to market and new business opportunities. The company also embraces FAIR data principles: data that is Findable, Accessible, Interoperable and Reusable. A digital marketplace consisting of both events and APIs makes the data findable and machine-readable via Open API Spec (OAS) and AsyncAPI metadata. Data can then be accessed on demand via APIs and events push data in real time.
“The API economy is changing, as event-driven architecture and asynchronous event-driven APIs are becoming increasingly important to companies that are striving to make their business processes, customer interactions and supply chains more real-time. Using both synchronous and asynchronous methods can result in an application environment in which system resources are most effectively used.”
From this example it can be clearly seen that modern enterprises realistically require a “one-stop shop” platform to best suit their unique application integration strategies—one that can deliver unified management to access, reuse and exposing both asynchronous event-driven and synchronous RESTful APIs.
The Metaverse Will Continue at Pace
Zooming out a bit, there is no getting away from the increasing prevalence of the metaverse. It is clear to see its potential to reshape everything from consumer habits to public services to health, welfare and education from an emerging digital universe where providers, creators and consumers can experience a parallel life to their real-world existence. Driven by technologies including digital twins, Augmented Reality and Virtual Reality, McKinsey estimates the metaverse will be worth USD $5 trillion by 2030.
Data in real time will be the vital common denominator to link the digital and physical divide and optimize the Metaverse. McKinsey lists real-time data as a vital element to facilitate the adoption of the Metaverse in several key industries. These include:
- Retail to enhance shopping/in-store/product experience, capture efficiencies and explore net-new revenue streams.
- Banking/financial services to support decentralised finance structures.
- Transportation to allow central coordination and project management (e.g., via IoT/digital twins), especially in logistics, with real-time data collection for optimization.
- Healthcare to enable fully personalised health consultations, with access to real-time data.
The metaverse by definition cannot be static. It needs to be in real time, in motion. It needs an event-driven architecture and a real-time event mesh to support it.
“There is no getting away from the increasing prevalence of the metaverse. It is clear to see its potential to reshape everything from consumer habits to public services to health, welfare and education from an emerging digital universe where providers, creators and consumers can experience a parallel life to their real-world existence.”
For example, if an avatar visits a retailer in the metaverse, the retailer will need to keep track of countless user actions such as how long someone spent looking at a particular product, which products got the most interest, etc. The metaverse will produce a significant amount of data that companies will be interested in analyzing in real time. This data can be used to make decisions from real time adjustments to inventory to incentivizing commerce through real time offers/discounts/coupons and even dynamically pricing products.
Data-Driven Developments shape 2023
The four trends discussed above collectively offer the potential to reshape the way we do business, interact with customers and partners and make data-driven decisions. The common thread across these trends is the need for better movement of data, in real time, in motion and all pointing to the need for an underlying event-driven architecture. To ensure success, organisations must adopt an event mesh underpinned by a proven strategy for designing, managing and governing events as they flow through their enterprise.
Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)