
Written by: Muhammad Zulhusni, Journalist, AOPG
Since Mark Zuckerberg announced the rebranding of Facebook and stated that the metaverse will be the successor to the mobile internet, the metaverse has become an increasingly popular concept in the tech world. Even NVIDIA is getting in on the act.
At a recent NVIDIA GTC press pre-briefing, Richard G. Kerris, Vice President, Omniverse Platform Development IGM of M&E at NVIDIA, delved into the topic of Omniverse, the metaverse, and digital twins, stating that the next era of innovation will help us visualise things that haven’t yet been built. Virtual worlds are really what make up this next generation of the next web, and they built NVIDIA Omniverse as the platform to do so.
What Can We Expect From NVIDIA’s Omniverse?
The Omniverse can be used for a variety of purposes by customers. Creators, designers, and engineers can connect major design tools, assets, and projects in a shared virtual space to collaborate and iterate. In addition, developers and software providers can easily create powerful tools on the modular platform to extend its functionality. During the briefing, NVIDIA announced some exciting new Omniverse platform features:
- Showroom: Showroom allows anyone with an RTX-based system to interact, play, and learn from various Omniverse demos.
- FARM: FARM is a systems layer that enables multi-GPU, multi-agent rendering, and simulation.
- AR: The ability to combine your media with what’s on your computer and what’s in the real world that you’re in.
- VR: The first VR experience with full fidelity, real-time full-frame ray tracing.
Aside from that, NVIDIA announced that Omniverse Enterprise will be available soon. “This is a big breakthrough, an enterprise subscription sold by our global system manufacturers means that an enterprise-ready, multi-GPU scalable 3D design collaboration platform will be available for companies worldwide. And what it brings you, is the ability to work alongside one another or across different locations as teams and be able to take your work as an enterprise customer into the next level,” Richard explained.
To go along with that, NVIDIA also announced:
- Modulus: A framework for creating physics-ML models for digital twins. This means they’ll be able to assist businesses in developing and maintaining a physically true-to-life simulation of a digital twin. This is extremely important because it allows them to complete their work more quickly.
- Omniverse Replicator: A powerful synthetic data-generation engine that generates physically simulated synthetic data for training deep neural networks. What makes this so significant is that synthetic data is critical for the future of AI. Replicator enables NVIDIA to generate diverse, massive, and accurate data sets from which to build high-quality, high-performing and safe AI.
- Omniverse Avatar: Omniverse Avatar is a platform for creating interactive AI avatars. Omniverse Avatar connects the company’s speech AI, computer vision, natural language understanding, recommendation engines, and simulation technologies. Avatars created in the platform are interactive characters with ray-traced 3D graphics who can see, speak, converse, and understand naturally spoken intent. A variety of factors come together to make this possible. NVIDIA connects core NVIDIA SDKs:
- Riva for speech AI.
- Metropolis for perception.
- Merlin for recommendations.
- Fleet Command for scaling.
- Omniverse for animation and rendering.
- Omniverse Avatar “Project Tokkio”: Project Tokkio is an AI-enabled customer service avatar platform. It is a reference application that allows us to demonstrate interactive customer support and leverages technologies such as Riva, Metropolis, Merlin, Fleet Command, and Omniverse for fully interactive, instant dialogue, and customer recognition. To interact with the physical world, Project Tokkio can be deployed with physical robots and talking kiosks.
- Omniverse Avatar “Project Maxine”: A platform for AI-powered video conferencing, live streaming, telepresence, virtual collaboration, and content creation. It is a set of highly optimised AI SDKs for video effects, audio effects, and Augmented Reality (AR). The AI modular features can be chained into existing pipelines or used to create new customised and scalable end-to-end pipelines.
Intelligent Robots to Become a Part of Everyday Life
The briefing did not just cover virtual innovations, but robots as well. Deepu Talla, Vice President and General Manager of Embedded and Edge Computing at NVIDIA, believes that they will play significant roles in our lives. However, he said that when most people think of robots, they think of the hardware, the computer that powers the robots. Although this is correct, he says it is not the end of the story. According to Deepu, there are many layers and software technologies that must come together to create a true robot.
“In order to build a robot, [it must] perceive the world, reason, and then perform the final action. To run these neural networks, Artificial Intelligence requires a lot of data. So, we use both real-world data and synthetic data to teach the robot, and we use Isaac Sim to do the synthetic data training. Then, while doing the AI training, you need a supercomputer or a lot of compute, and NVIDIA solutions are available,” said Deepu.
As part of the Omniverse, he also stated that simulation is a critical component of robotics. Experimenting with robots in simulation is safer than in the real world. As the importance of data quality grows, NVIDIA is releasing the new Omniverse Replicator for Isaac Sim application, which is based on the recently announced Omniverse Replicator synthetic data-generation engine. These new Isaac Sim features enable ML engineers to generate high-quality synthetic datasets for training robust deep-learning perception models.
NVIDIA also unveiled the NVIDIA Jetson AGX Orin™, the world’s smallest, most powerful, and energy-efficient AI supercomputer for robotics, autonomous machines, medical devices, and other types of embedded computing at the edge.
Jetson AGX Orin, based on the NVIDIA Ampere architecture, provides 6x the processing power while maintaining form factor and pin compatibility with its predecessor, Jetson AGX XavierTM. It can perform 200 trillion operations per second, similar to a GPU-enabled server but in the palm of your hand.
“As robotics and embedded computing transform manufacturing, healthcare, retail, transportation, smart cities and other essential sectors of the economy, the demand for processing continues to surge,” said Deepu. “Jetson AGX Orin addresses this need, enabling the 850,000 Jetson developers and over 6,000 companies building commercial products on it to create and deploy autonomous machines and edge AI applications that once seemed impossible.”


Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)