Databricks, the data and artificial intelligence (AI) company, has introduced Lakehouse Apps. It is a new way for developers to build native, secure applications for Databricks. Lakehouse Apps will enable over 10,000 Databricks customers to easily access a wide range of powerful applications that run entirely inside their Lakehouse instance, using their data with the full security and governance capabilities of Databricks.
The company also introduced new data-sharing providers and AI model-sharing capabilities to the Databricks Marketplace. It is the only marketplace for data, AI and applications and is set to be widely available at the Data + AI Summit.
Lakehouse Apps Simplifies Access to Data and AI
Data and AI applications are among the fastest-growing software categories, and the growth in generative AI and large language models (LLMs) has accelerated that trend. For customers, Lakehouse Apps will be the most secure way to run applications that unlock the full value of data in their Lakehouse, leverage Databricks-native services, and extend Databricks with new capabilities. Lakehouse Apps will give users safe and easy access to a wide range of innovative new applications and reduce the time and effort to adopt, integrate and manage data and AI applications.
Lakehouse Apps Offer Security Without Compromise for Developers
To get the next generation of innovative applications in the hands of users, software vendors must clear significant hurdles to securely access customer data, integrate with customers’ security and governance solutions and efficiently run close to customer data. To secure enterprise adoption, many developers have taken one of two approaches:
- Restrict the capabilities of their application and rebuild vital parts of their application in SQL or proprietary code from data platform vendors.
- Build versions of their products that customers have to install and operate themselves, which are fragile and hard to scale.
Lakehouse Apps helps developers overcome this dilemma with a native, secure, no-compromise solution. By running directly on a customer’s Databricks instance, these apps can easily and securely integrate with the customer’s data, use and extend Databricks services and enable users to interact with a single sign-on experience—all without data ever leaving the customer’s instance. Lakehouse Apps inherit the same security, privacy and compliance controls as Databricks. Developers can use any technology and language of their choice to build apps and aren’t limited to a proprietary framework.
Developers also benefit from easier distribution by listing their Lakehouse Apps in the Databricks Marketplace, enabling customers to quickly discover and deploy their software.
Collaborating with Partners
Early development partners for Lakehouse Apps include Retool, Posit, Kumo.ai, and Lamini:
- Retool enables customers to quickly build and deploy internal apps, powered by their data. Developers can assemble UIs with drag-and-drop building blocks like tables and forms and write queries to interact with data using SQL and JavaScript.
- Posit is an open-source data science company that empowers data professionals with cutting-edge tools for code-first data science.
- Kumo.ai is an AI-powered platform tackling predictive problems in business. Its platform works directly on relational data by using graph neural networks, a class of AI system for processing data that can be represented as a series of graphs.
- Lamini is an LLM platform for every developer to build customised, private models: easier, faster, and better-performing than any general-purpose LLM.
New AI Model-Sharing Capabilities and Data Providers
Databricks will also offer AI model sharing in the Databricks Marketplace, enabling data consumers and providers to discover and monetise AI models and integrate AI into all their data solutions. With AI model sharing, Databricks customers will have access to best-in-class models, which can be quickly and securely applied on top of their data. Databricks itself will curate and publish open source models across common use cases, such as instruction-following and text summarisation, and optimise tuning or deploying of these models on Databricks.
Databricks Marketplace also welcomes new data providers, including the following:
- Financial services leaders such as S&P Global, Experian, London Stock Exchange Group, Nasdaq, Corelogic and YipitData
- Healthcare innovators like Datavant and IQVIA
- Geospatial leaders like Divirod, Accuweather and Safegraph
- Data collaboration companies such as LiveRamp
- Business information services companies like LexisNexis and ZoomInfo
“With Lakehouse Apps, software providers can offer their rich, secure apps within the lakehouse, which is exciting both for Databricks customers and for software vendors, greatly reducing the friction for applications to reach new customers,” said Matei Zaharia, Co-Founder of and CTO at Databricks. “In addition, the expansion of Databricks Marketplace to cover AI models as well as apps satisfies a critical need in today’s business world, as collaboration between enterprises is evolving beyond the mere exchange of datasets to secure computations and AI modelling on joint data.”
New Partners to Accelerate Data Sharing
Databricks also announced new Delta Sharing partnerships with Cloudflare, Dell, Oracle and Twilio, expanding its data-sharing ecosystem. Delta Sharing provides an open solution to securely share live data from your lakehouse to any computing platform.
Availability
Databricks Marketplace will generally be available on 28 June 2023, coming out of a public preview. Lakehouse Apps and AI model sharing in Databricks Marketplace are expected in preview in the coming year.
To learn more about Databricks’ latest announcements, register to attend the Data + AI Summit virtually.
Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)