
The genesis of big data
October 27, 1994: The first ad to hit the web is published.
It was difficult to recognize the significance at the time, but that single, floating rectangle at the top of my computer screen would bring into being an entirely unique market.
Adtech was invented — designed for this emerging sector, and built to measure the return of the new media creators produced.
Finally, ads could be understood.
The science of productivity
Adtech has a reputation for being overcomplicated and overpriced; however, it is largely misunderstood. It is not only underappreciated, but undervalued. Adtech is to big data what the Big Bang is to the universe. The collective origin story of all productivity measuring data begins with adtech. From measuring the performance of ads, we can now measure the performance of most anything — even people.
It didn’t take long for those in the industry to realize how much potential their new data-measuring technology had. The applications are endless, as we continue to see today.
Big data software and services are predicted to grow to a $41.5 billion market in 2018. And as the appetite for data grows, so too will the demand for sophisticated tools to interpret and refine it.
Applied analytics
Following the example set by adtech, other sectors are leveraging big data and predictive technologies to drive efficiency and accuracy.
In 2014, Uber launched UberPool, which uses algorithms to match riders based on location and sets the price based on the likelihood of picking up another passenger.
The latest generation of finance management software learns from consumers’ transaction history and spending patterns, and provides intelligent recommendations and personalized advice.
Human resources departments are bringing analytics into the tasks of corporate hiring, retention and promotion, and the insurance sector is using data to influence customers into better driving habits.
Data-driven ecosystems
Similarly to the way the LUMAscape evolved for adtech, new ecosystems are poised to coalesce around other industries. Businesses that rely on data to make key decisions will want better, more granular insights. So the shift to predictive analytics in multiple sectors will form a virtuous cycle, driving demand for tools to further enrich and interpret all that data.
Enterprises are already embracing big data and predictive analytics to hire and retain talent, forecast staffing needs and improve employee satisfaction. In the next two years, 6,400 organizations with 100 employees or more plan to implement big data analytics, providing ample opportunities for a new crop of startups that collect, refine and interpret data to populate the HR analytics landscape.
Startups are leveraging Watson’s technology to deliver data-driven recommendations to consumers and healthcare providers; this pattern will soon extend to the health sector at large. People are generating more health-related data than ever before, and doctors, patients and researchers need tools to make sense of it. Physicians will be able to compare patients’ data with health trends in the general population and provide data-driven advice for treatment or prevention of illnesses.
Platforms and interoperability
Just as we’ve seen with adtech, social and now messaging, the dominant players will evolve their products into platforms as the spaces mature, forming the connective tissue of these new ecosystems. Salesforce, for example, started as a CRM database, but expanded to offer Platform as a Service, enabling customers to build their own applications on the Salesforce framework.
We’re witnessing a similar scenario unfold in the health sector, where Apple has created three new platforms for enabling data collection and analysis (HealthKit, ResearchKit and now CareKit). Medical studies built on the ResearchKit framework are enrolling greater numbers of participants, improving the quality of the data collected. CareKit, on the other hand, is intended for a broad spectrum of patients; any health app developer can make it easier for people to share health information with physicians and caregivers.
One example is OneDrop, a personal care app built on the CareKit framework that helps people with diabetes track their food intake, activity levels and glucose readings so they can better manage their blood sugar. Similarly, small, specialized data analytics companies will emerge and build off of larger platforms in verticals like finance, staffing and transportation.
Rapid growth and exponential cross-pollination
As more verticals embrace data-driven, predictive tech, we’ll see cross-pollination and interoperability between sectors, exponentially increasing the amount of data, and thus the need for more data mining and analysis.
We’re entering the AI Age — predictive modeling has already proven critical for solving a diverse set of challenges for both businesses and consumers, and it has the potential to transform every industry. As we approach a period of exponential growth, formerly siloed verticals are abandoning legacy systems and embracing analytics.
The combination of cloud computing and interoperable data providers and platforms will form the foundation that will allow data-driven ecosystems to thrive, unlocking an era of frictionless innovation.
With the applications of big data emerging as a new frontier, it is especially important now for us to remember how it all started — with a click.
This article was originally published on techcrunch.com and can be viewed in full


Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)