NVIDIA Fleet Command—a cloud service for deploying, managing and scaling Artificial Intelligence (AI) applications at the edge—now includes features that enhance the seamless management of edge AI deployments around the world.
With the scale of edge AI deployments, organisations can have up to thousands of independent edge locations that must be managed by IT teams—sometimes in far-flung locations like oil rigs, weather gauges, distributed retail stores or industrial facilities.
NVIDIA Fleet Command offers a simple, managed platform for container orchestration that makes it easy to provision and deploy AI applications and systems at thousands of distributed environments, all from a single cloud-based console.
But deployment is just the first step in managing AI applications at the edge. Optimising these applications is a continuous process that involves applying patches, deploying new applications and rebooting edge systems.
To make these workflows seamless in a managed environment, Fleet Command now offers advanced remote management, multi-instance GPU provisioning and additional integrations with tools from industry collaborators.
Advanced Remote Management
IT administrators now can access systems and applications with sophisticated security features. Remote management on Fleet Command offers access controls and timed sessions, eliminating vulnerabilities that come with traditional VPN connections. Administrators can securely monitor activity and troubleshoot issues at remote edge locations from the comfort of their offices.
Edge environments are extremely dynamic, which means administrators responsible for edge AI deployments need to be highly nimble to keep up with rapid changes and ensure little deployment downtime. This makes remote management a critical feature for every edge AI deployment.
Check out a complete walkthrough of the new remote management features and how they can be used to help administrators maintain and optimise even the largest edge deployments.
Multi-Instance GPU Provisioning
Multi-Instance GPU, or MIG, partitions an NVIDIA GPU into several independent instances. MIG is now available on Fleet Command, letting administrators easily assign applications to each instance from the Fleet Command user interface. By allowing organisations to run multiple AI applications on the same GPU, MIG lets organisations right-size their deployments and get the most out of their edge infrastructure.
Learn more about how administrators can use MIG in Fleet Command to better optimise edge resources to scale new workloads with ease.
Working Together to Expand AI
New Fleet Command collaborations are also helping enterprises create a seamless workflow, from development to deployment at the edge.
Domino Data Lab provides an enterprise MLOps platform that allows data scientists to collaboratively develop, deploy and monitor AI models at scale using their preferred tools, languages and infrastructure. The Domino platform’s integration with Fleet Command gives data science and IT teams a single system of record and consistent workflow with which to manage models deployed to edge locations.
Milestone Systems, a leading provider of video management systems and NVIDIA Metropolis elite partner, created AI Bridge, an application programming interface gateway that makes it easy to give AI applications access to consolidated video feeds from dozens of camera streams. Now integrated with Fleet Command, Milestone AI Bridge can be easily deployed to any edge location.
IronYun, an NVIDIA Metropolis elite partner and top-tier member of the NVIDIA Partner Network, with its Vaidio AI platform applies advanced AI, evolved over multiple generations, to security, safety and operational applications worldwide. Vaidio is an open platform that works with any IP camera and integrates out of the box with dozens of market-leading video management systems. Vaidio can be deployed on premises, in the cloud, at the edge and in hybrid environments. Vaidio scales from one to thousands of cameras. Fleet Command makes it easier to deploy Vaidio AI at the edge and simplifies management at scale.
With these new features and expanded collaborations, Fleet Command ensures that the day-to-day process of maintaining, monitoring and optimising edge deployments is straightforward and painless.
Test Drive Fleet Command
To try these features on Fleet Command, check out NVIDIA LaunchPad for free.
LaunchPad provides immediate, short-term access to a Fleet Command instance to easily deploy and monitor real applications on real servers using hands-on labs that walk users through the entire process—from infrastructure provisioning and optimisation to application deployment for use cases like deploying vision AI at the edge of a network.
Archive
- October 2024(27)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)