A unique immersive experience with Apple Vision Pro.
In this article we are going to explain a little about this latest development made in the XR area of Bravent, with Unity.
The application consists of a user, after putting on the viewer, being immersed in a virtual modernist space with curved lines and some vegetation in which he can view a series of videos about the history of Qatar.
At any point in the experience, the user can start talking to the virtual assistant to ask a question and continue watching videos after the consultation. One thing to note about these consultations is that both the questions and the answer is in natural language using voice, not in writing, and therefore hands-free. This facilitates the simultaneity of processes.
This demo is developed in an immersive environment, but it could be in Mixed Reality, visualizing your own real environment, which is very useful for some use cases that we will see later.
In this demo, the requests directly attack ChatGPT 4o, but depending on the needs of the project it can be done with a previously trained assistant, using a specific data set (about the history of Qatar), as we have already done in other developments.
The device for which we have developed it is the Apple Vision Pro viewer, but another device capable of working with this technology, and with which we are also working is the Meta Quest 3 viewer.
What is AI?
As we all know today, artificial intelligence is, broadly speaking, a system capable of performing tasks that normally require human intelligence.
These tasks include voice recognition, decision making, language translation, and much more. The inclusion of this technology has allowed us to add an assistant to the immersive experiences we have been creating for some time.
This opens up a world of possibilities, since this assistant can be a generic AI such as ChatGPT (as in the case of the demo created for Qatar), which can respond to an infinite number of questions on many topics, but which may lack information on a topic that we would like to address very specifically; Or on the other hand a specifically trained AI (as in the case we did with CATAI), which with good training can respond to any query on the topic that occupies us in that development.
What does this type of experience consist of?
This type of experience is based on XR (eXtended Reality) and AI to jointly create a Mixed or Virtual environment, within which the assistant and the various features to be incorporated are activated.
In the latest of these developments, the possibility of placing videos in the environment has been incorporated, so in addition to being able to consult the AI assistant, different contents and information can be viewed. As well as videos, the possibility of viewing images could be added.
Possible use cases
As with everything, the use cases for these technologies depend largely on the imagination of those who decide to use them, so in this case we will only give a few examples:
- Workplace assistance: employees can use these devices to receive instructions, access company information or perform administrative tasks without using their hands. This is especially useful in industrial or manufacturing environments.
- Education and training: Students can interact with a virtual assistant to get detailed explanations, resolve questions in real time, and access additional educational resources. Augmented and virtual reality devices can make learning more immersive and engaging.
- Customer service: Companies can deploy virtual assistants to provide technical support, answer frequently asked questions and guide customers through complex processes. This improves the customer experience and reduces the workload on human staff.
- Health and wellness: Virtual assistants can help users follow exercise routines, remind them to take medications, and provide health and wellness information.
- Entertainment and leisure: Users can ask for movie, music or game recommendations and receive personalized responses based on their preferences. In addition, they can interact with augmented and virtual reality content for a more immersive entertainment experience.
- Personal assistance: Virtual assistants can provide information on weather, traffic and other data relevant to the user’s day-to-day life.
- Travel agencies: Being able to ask for specific information about your trip, excursions, hotels, or necessary documentation, while you are immersed in a virtual environment. We put this demo into operation for CATAI at FITUR. It starts in mixed reality, without losing sight of the real environment and after choosing the destination to travel to, the user enters the specific environment, where he/she can ask the assistant with natural language.
- Real Estate Agencies: Another example could be that of an agency that shows its homes or premises with immersive environments, within which this assistant could be incorporated to clarify all kinds of questions about the property.
- Builders focused on the end customer: This possibility leads us to the construction company itself that instead of showing the residences on plan or with a render, decides to do it with virtual spaces, as in the previous example, the inclusion of this AI could open a world of possibilities for the user to interact with the environment, being able to ask questions about qualities, or any other topic.
- Builders focused on the design and construction of the property itself: Virtual assistants can help architects and builders to visualize projects in 3D, make adjustments in real time and coordinate with work teams. In addition, they can provide information on materials, costs and schedules, improving efficiency and communication in the construction process while visualizing it in virtual, or mixed, reality.
- Libraries or other government buildings: Virtual assistants can guide users to find books, articles and other resources. They can also offer recommendations based on the user’s interests, manage loans and returns, and provide information about events and activities in the library. All of this can be done in mixed reality, while still seeing the real environment and adding visual information about it, or in an immersive virtual environment. In addition, interactive educational experiences can be created in virtual reality to encourage learning. All this enhances the visitor experience.
- Retail: In retail, virtual assistants can help customers find products, compare prices and receive personalized recommendations. In addition, they can assist in the checkout process, manage inventory and provide information on promotions and discounts.
Interactive virtual storefronts can also be created to attract more customers and offer personalized promotions.
Devices such as Meta Quest 3 and Apple Vision Pro offer the ability to create augmented reality or immersive experiences to make any of these activities more interactive.
For more details, you can contact us at Info@bravent.net
