When using immersive systems such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) for design review, a key attribute of the system is a seamless interaction with at-scale, realistic digital models. VRED software is a well-accepted, manufacturing design-review application offering close-to-truth photorealism and a highly immersive extended reality (XR) interface. Using artificial intelligence (AI)-enabled speech control with VRED software can increase the level of immersion, allowing a user to have direct interaction with the digital model without the need for scene-occluding graphical user interfaces (GUIs)—and also allowing the user to naively interact with VRED, enabling more users to perform unassisted design reviews in XR. Project Mellon is NVIDIA's internal speech-enablement project that uses the innovative Riva automatic speech recognition (ASR) software with a prototype dialogue manager and 0-shot learning natural language processing (NLP) to achieve a developer-friendly integration of AI-enabled speech. In this session, we’ll show Mellon and VRED, and we’ll discuss how Mellon is used to easily update command lists without the need for extensive NLP training.

Digitization of creative design workflows has unleashed creators’ capabilities and allowed them to experience the designed product earlier. But it has some downsides. Back in the day, one could go down to the shop floor and walk around clay models having an instant update on the project progress and design evolution. Today, it can be challenging to find the right visualization file aggregating the latest modeling data, unless you know who’s working on the visualization data and you get over their shoulder to have a quick look on the latest evolution. What if the shop floor was digital too? What if anyone could go to a web site and walk through the latest design updates. Find out how you can serve visualization streams using a cluster of VRED Core instances managed through a simple web server.

Did you know that there are thousands of apps in the Autodesk App Store? For decades, developers have been augmenting Autodesk software to streamline and automate workflows. Now powered with Autodesk Forge APIs, they can do so much more. Come listen to a panel of developers who are in the App Developer Partner Program as they share the experiences they’ve had building with Autodesk APIs. You’ll learn all about the amazing outcomes they’ve had with customers who use their apps, and see why software customization is a game changer.