
Mesosphere today announced several partnerships with Big Data vendors to bring their wares to its open source DC/OS distributed operating system and advance the possibilities of container technology in the new era of “Container 2.0.”
Based on the Apache Mesos distributed systems kernel, Mesosphere’s DC/OS is described by the company as the easiest way to run Big Data and related technologies, such as Apache Spark, Apache Kafka, Apache Cassandra, microservices and containers. It was open sourced by the company in April.
Specifically, Mesosphere’s description of DC/OS reads: “It enables the management of multiple machines as if they were a single computer. It automates resource management, schedules process placement, facilitates inter-process communication, and simplifies the installation and management of distributed services. Its included Web interface and available command-line interface (CLI) facilitate remote management and monitoring of the cluster and its services.”
Today, the company announced agreements with Confluent, DataStax and Lightbend, which are all bringing their Big Data technologies to the DC/OS platform. Mesosphere framed the agreements within the larger context of advancing what’s possible in the world of container technology, heading toward its vision of “Container 2.0.”
“At its simplest, Container 2.0 is the ability to run (and orchestrate) both stateless and stateful services on the same set of resources,” Mesosphere exec Florian Leibert said in a blog post today. “This is how modern applications should be built and operated if we want to use them to their full potential for curing diseases, solving business problems or delivering the next great consumer experience. If we can’t finally — and completely — knock down the siloes between applications and infrastructure, then the core components of modern applications — efficient code deployment on containers and powerful data processing and analytics — will only be as good as the networks between them.”
That “powerful data processing and analytics” functionality is coming to DC/OS via the new partnerships.
The high-throughput distributed messaging system, Kafka, comes from the Confluent Platform, used for streaming data. “Built for scale and reliability, it solves the very real problem of running of building and running real time data applications,” said fellow Mesosphere exec Keith Chambers in his own blog post today.
The large-scale distributed database, Cassandra, comes with DataStax Enterprise (DSE). Chambers said it “builds on Apache Cassandra to enable developers to build innovative real time Web, mobile and Internet of Things [IoT] applications with unprecedented performance, scale and availability.”
Developers can now install those two Big Data offerings on DC/OS with a single click in the DC/OS Universe package repository, said Chambers, who also noted the inclusion of Spark, the popular data processing framework that’s shaking up the Hadoop ecosystem, with the Lightbend partnership.
“Today, we also expanded our support partnership with Lightbend around its Reactive Platform and Apache Spark, the data-processing and analytics power of which are a major part of modern, data-driven enterprise applications,” Chambers said. “In fact, Spark, Cassandra and Kafka are a common and powerful collection for real-time data pipelines. Commercial subscriptions for Confluent Platform, DataStax Enterprise and Lightbend Reactive Platform, as well as Enterprise DC/OS, are available from their respective companies.”
Along with the new Confluent, DataStax and Lightbend offerings available on DC/OS Universe, other technologies provided include Jenkins, Hadoop Distributed File System (HDFS), DataDog and many others.
“The support of partners like these — and the successes we’ve already had with them — is proof that the world is heading toward Container 2.0, and that DC/OS is already there,” Leibert said. “Innovative companies are well down the road toward modern containerized and data-driven applications, and now they’re looking for the right software to brings those apps from the lab and into production. They know the power of Mesos, Cassandra, Kafka and Spark, and now they’re taking it to the next level with Mesosphere, DataStax, Confluent and Lightbend.”
This article was originally published on adtmag.com and can be viewed in full


Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)