Databricks, the lakehouse company, has announced a new and powerful development experience for the Databricks Lakehouse Platform: the VS Code Extension for Databricks.
This new extension enables developers to write their code locally leveraging the powerful authoring capabilities of the IDE, connect to Databricks clusters and run code remotely, and use the software development best practices of source code control, unit testing, and CI/CD directly from their favourite IDE.
“This will be the first of many planned releases and updates for teams who rely on IDEs for their development process,” said Patrick Wendell, Co-Founder of and VP Engineering at Databricks. “We’ve invested in a new team focusing exclusively on the breadth of the developer ecosystem, and will be rolling out support for other IDEs and additional tools that enable full access to the lakehouse from third-party products.”
Develop Natively Inside VS Code
Organisations can now build all of their data and Artificial Intelligence (AI) applications while staying inside their IDE. Developers can author the code for their pipelines and jobs in VS Code, then deploy, test and run it in real-time on their Databricks cluster. This will enable teams to apply software development best practices and utilise VS Code’s native capabilities for editing, refactoring, testing and CI/CD for data and AI projects.
“My team wants to run their data workloads on the Databricks Lakehouse but develop their data apps from their IDE. Now they can write code, edit and test in their IDE and run their code on Databricks,” said Andrew Garrido, Head of Software Development for Data Processing at Kantar
The Full Power of the Databricks Lakehouse in Your IDE
Now that organisations can build on Databricks within VS Code, developers can perform all of their work in one location. Databricks objects can be managed inside VS Code natively with the new extension, allowing teams to stay in their IDEs and preventing context switching between applications. All of the Databricks components, such as clusters, pipelines and tasks, are integrated into VS Code workspaces and regular workflows. The Lakehouse’s scale can be utilised to process and analyse large data sets, use clusters for queries and visualisations, train Machine Learning models and deploy jobs to production so that anyone in an organisation can see and use data to make decisions, all within VS Code.
Uniquely Designed to Take Advantage of Full IDE Capabilities
Developer teams can enjoy all the comforts of VS Code they are used to while building applications on Databricks. Navigating to function definitions, refactoring, using advanced find-and-replace and utilising split windows can help drive team-wide efficiency. Teams can also receive code completion on functions and variables, including Databricks-specific objects, to speed up discovery and development.
With VS Code and Databricks, developers can now utilise the software development best practices already set up for the development process, and build and modularise different parts of their program across separate functions and files. Files are local, so teams can use VS Code’s Git tools and the Git CLI, while they can also modularise code into files and libraries to encourage code reuse and improve hygiene. VS Code enables developers to use their preferred testing framework to ensure software quality, while integrating with top CI/CD tools to deliver code into production faster.
“I find that the Databricks extension enables developers like me, who prefer an IDE, to be able to readily harness the power of VS Code with native and extensible functions while easily allowing me to run Databricks locally. It’s very helpful,” said Sam Walker, Data Engineer at Watco
A Fully Supported IDE Experience
The new VS Code extension is directly available through the Visual Studio marketplace to streamline the acquisition experience and to ensure that teams are getting an officially supported and trusted version from Databricks. We will be updating the extension regularly to provide experience and quality improvements for peace of mind, and CIOs can also be assured that their investment is future-proof with added support for new capabilities of the Databricks Lakehouse platform as they get released.
“We consider it a huge advance that will further boost our development process, and that is a milestone that certainly deserves to be celebrated and shared,” said Iago Brandão, MLOps at ViaHub.
Get Started with the VS Code Extension Today
The VS Code Extension is available today for download through the Visual Studio marketplace: Download the VS Code Extension.
Archive
- October 2024(22)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)