Mixed Reality in Power Apps

Mixed Reality in Power Apps has just been released in Public Preview last month (May 2020) during the Microsoft Business Application Summit.

I wanted to share the news about this release and its feature and I had the privilege to do so in the ASEAN Microsoft BizApps UG – Women in Tech online meetup where women across the globe connect and share inspiring stories and industry experiences.

87% of businesses are currently exploring, piloting, and deploying Mixed Reality improving their productivity and customer satisfaction (Source: Harvard Business Review Analytic Services Survey, March 2018).

With Mixed Reality in Power Apps, we can take measurements, view 3D/2D objects, view shapes, and of course, mixed reality.

In using Mixed Reality in Power Apps, we need to enable the features in each of the apps that you need first and then you can add Mixed Reality components in the canvas app after.

Requirements

  1. To test your application you need to have an AR-enabled device on iOS and Android
  2. The supported 3D file format is .GLB file

Enable Mixed Reality:

  • 1. Create Canvas App or Edit an app.
  • 2. Select the File tab
File Tab
  • 3. From Settings, select Advanced Settings. Scroll down until Under Experimental Features then enable the Mixed Reality features.
Mixed Reality Features

4. Then select Return to continue editing your app. If you are going to select the Insert tab in the left navigation or the ribbon, you will see the Mixed Reality components.

Mixed Reality Component

View 3D object

If you have a 3D object that you want to view in your Power Apps, here are the steps:

  • 1. From the Insert Tab, select Media, scroll down and select View 3D object
View in 3D component
  • 2. In Source (Src) properties, change it to the location of your 3D object. It could be from Github, SharePoint, or in OneDrive for Business.
Src

This will then your 3D object using this component.

View 3D object in Power Apps

Getting measurement using Measure in MR Component

Measure in MR helps you take measurements by Area, Volume, and Distance of the location where you will put the 3D objects like a piece of furniture or an industrial machine. This helps you visualize the imaginary object in that location through the measurements that you based upon in your application.

To add the Measure in Mixed Reality component:

  • 1. From the Insert tab or in the left navigation, select Mixed Reality >> Measure in MR
Mixed Reality Components
Mixed Reality Component from the ribbon
Mixed Reality Components
Mixed Reality Component in the left navigation
  • 2. Select the “Measure in MR” button, and from the properties, you can choose the display type of the button, unit of measurements, and measurement type. For this blog we are going to use the following properties:
  • Display type: Icon
  • Unit of measurement: Centimetres
  • Measurement type: Area
Measure in MR properties
Measure in MR properties
  • 3. From the Advanced Properties, under OnChange, add this code:

Create shapes using View Shape in MR components

We can place a cube or certain types of shape by using the View Shape in MR. The properties of the shape’s length, width, and depth can be used to measure the shape of an object which we can visualize in the real world.

  1. 1. From the Insert tab or in the left navigation, select Mixed Reality >> View shape in MR
Mixed Reality Component
Mixed Reality Component in the ribbon
Mixed Reality Component
Mixed Reality Component in the left navigation
  • 2. Select the ViewShapeInMR3 button and from the properties, you will see the display type, shape width, shape height, shape depth, and unit of the measurements.
View Shape in MR Component
View Shape in MR Component

3. In the Shape width, height, and depth properties, we are going to use a variable to store the value that we get from the input text field. Insert three input text fields and rename it to the following: txtDepthtxtHeighttxtWidth.

4. Select the “Place a cube button”, and then in the properties, change the Shape width, Shape height and Shape depth with txtWidth, txtHeight and txtDepth respectively.

Save your application, publish it and view your app in an AR-enabled capability device.

Getting screenshot from the Mixed Reality

You can take a screenshot with your 3D Model in Mixed Reality with the real world by clicking the camera button. You can use this image for your approval process to check if the measurement is correct or the visualization of the product is okay.

To take a screenshot and save it to the Gallery:

  1. 1. Insert a Gallery in your app. In the property of the Gallery, select the 2 columns Gallery in the Layout properties.
  2. 2. In the Place a cube button, under Advanced Properties, type in this code under OnChange
If(
!IsBlankOrError(ViewShapeInMR3.Photos),
 Collect(
photos,
 ViewShapeInMR3.Photos
)
)
  1. 3. Select the Gallery and change the Items properties to photos
  1. 4. Under the Image in the Gallery, change the Image property to ThisItem.ImageURI

Reference:

If you want to learn more, you can read these links below for your reference.
• Power Apps Canvas Mixed Reality

If you have some ideas that you want to add in Mixed Reality in Power Apps, add your ideas here below: