
There’s an immense amount of data out there, and lots of companies scaling the mountain are working with modern day picks and shovels trying to get value from this new form of economic resource. In fact forward-looking organizations have been leveraging insights from big data for years, and even decades.
It’s been a continual evolution, a journey driven by ever-larger volumes of data. The velocity and variation in data are also increasing. Whereas the highly structured clean, precise, and validated data that is generated by business transactions and the like sits in the more familiar data marts & data warehouses, companies are collecting raw data from a number of sources outside of the immediate corporate bounds, created by things, people or processes.
Examples abound of hugely successful enterprises such as Airbnb and Uber who extract their core business value from data and networks without owning physical assets. Not long ago, an activity like a cab ride meant you hailed one on the street, told the driver your destination, and paid in cash. No data. Today, you use your app, track the route via GPS, pay with a credit card, and then rate the driver on social media – and the driver can also rate you as a passenger. Four types of data are created by just that one activity. Large volumes of this raw unstructured data reside in data reservoirs or data lakes, and new methods of extracting meaning from these pools form a large part of the big data story.
As with any tech evolution, along with the pioneers who are a long way down the road, other companies find themselves at different stages of the journey. Some are just taking first steps. They know they need to start somewhere, and understand that data is a valuable corporate asset. It’s a bit like sorting through stacks of old newspapers and magazines stored away in the garage. Standing in front of a mound of unsorted stuff is always daunting. But the enormity of the challenge is a market perception, not a technical reality.
Other companies seem to meet roadblocks. With computing resources already at capacity, businesses believe they need to buy additional infrastructure, storage, and computing power, and find a data scientist to top up the existing IT specialists. Even with this high awareness, companies are still throwing data away because they don’t have the appropriate tools and technology.
The reality is that the tools and technologies are already available to support any big data journey if you know where to look.
Big Data & Cloud: A Perfect Marriage
What’s new is the broader accessibility of these tools in the cloud. Cloud computing means that infrastructure resources are immediately at hand, and when those cloud resources take the form of a big data lab then the ideal solution is already in place. Now, big data environments can be deployed in days to handle diverse types of data without lengthy configuration, available as pre-built environments that people can just go ahead and use. All that’s needed is to hand the keys over to the business user – not a data scientist.
With the best solutions, users do not have to worry about the detailed mechanics that happen behind the scenes, and have an elastic resource which expands and contracts based on immediate needs. The user can focus their attention on a single pane of glass that coordinates the analytics process, and on what matters most – the business at hand, as oppose to technology and infrastructure. All of this is essential to getting fast value from data.
The start of a journey
That’s what we call a Data Lab, and it’s available from Oracle in the Oracle Cloud. In a cloud environment, big data is not a single product but rather a portfolio of technologies that transparently correlates diverse data sets into business insights. The big data discovery journey is guided by integration of data sources allowing visualization in a way that makes sense to the business user. But above and beyond that, it’s an environment that lets you experiment and quickly work through process of elimination.
It’s a turning point very similar to Edison’s invention factory in 1876 where he vowed to turn out a minor evolution every six weeks and a major invention every six months.[1] He ultimately achieved his goal, producing many inventions that shaped the modern world, including the familiar light bulb which we now rely on in our daily lives.
A modern-day innovation lab encourages fun and creative analytics that scale and connect to your business. As the data is inherently correct, the final answer should be correct. But there’s no official start point, and no official finishing line. It’s OK to have just a rough compass bearing indicating the general direction. The first question might not be the right question, and you will discover more questions in the future. Trial and error is permitted. But the remit is to start the journey and just use it, to find the correlations and answers that are right for your business, and tell you where to go next.
Line of business managers join hands with data scientists
This approach to big data is very refreshing, because both line-of-business users as well as data scientists can use the Data Lab, bringing it into the mainstream and integrating it with corporate planning and business execution.
True, the data analyst has a valuable role in setting the enterprise strategy, but this now extends to facilitating big data experimentation at a departmental level such as finance and marketing. The data analyst and the line-of-business user team up as power players to find new ways to address challenges, innovate how the company does business, and find new revenue streams. In fact the true success metric is how many new Citizen Data Scientists get created.
Data projects contribute to the corporate competitive edge by adding value to existing products, improving processes, and helping invent new products. Use data collected from customer interactions can be leveraged to better engage with customer, increase revenue, and improve loyalty and customer satisfaction. And the right system must be able to scale up to support a large portfolio of data projects.
Secure and performant
With so much data being stored and actively processed, one additional concern is security. Organizations go to great lengths to secure their core data assets within on-premise IT, and wonder if cloud security matches those standards. However the reality is that for an organization primarily involved in finance or commerce, the focus is necessarily on their core business, not IT. Cloud providers such as Oracle have a long history of providing enterprise IT systems development and are specialists in security, with large teams dedicated to making sure the entire computing environment is secure, from the periphery of a data center through all three layers of the stack – software, middleware and hardware.
In addition, concerns about the physical location of data in the cloud can also be allayed. Big data analysis can take place over distributed stores of data, often close to the collection point, with processing done locally, depending on the data type.
According to Forrester, a leading independent research firm, enterprise data warehouses are now evolving beyond traditional data storage and delivery, with scale, performance, and innovation distinguishing the leaders. Oracle was the top-ranked vendor in the current offering category in The Forrester Wave™: Enterprise Data Warehouse, Q4 2015. Furthermore, Oracle was the top-ranked in the strategy category in the same report.[2]
A new form of capital
No matter the size of an organization, business sector or geographic location, making decisions without a comprehensive set of data is like shooting in the dark hoping to hit your mark, or at best making an educated guess. Data should be treated as a new form of capital, to be invested throughout the enterprise for competitive advantage. And the scope must encompass data outside of the traditional sources and formats.
Like it or not, every organization will be impacted by the big data revolution. The only question is whether you want to rely solely on your traditional data-warehouses to get partial answers to partial questions, or proactively extend it to harness the value of all your data.
Most likely your answer is the latter!


Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)