DEV Community: Kazuhiro Hara™

Upgrading to NRSDK 1.8.0 - MR Tutorial

Kazuhiro Hara™ — Tue, 26 Apr 2022 08:36:53 +0000

Until now, the tutorials have been based on NRSDK 1.7.0. Currently, the latest NRSDK version is 1.8.0. This section explains what you need to do to upgrade an old SDK.

I also upgraded HelloWorld tutorial while writing this explanation. I will be upgrading the other samples soon.

NRSDK version 1.8.0 and later have different documentation URLs. Check the following documents as well.

Learn Nreal Glasses - NRSDK

First, download NRSDK 1.8.0 from the following link.

Download | Nreal

How to Upgrade

Display Project > Assets, right click on NRSDK to show the context menu.
Select Delete for deleting Old NRSDK.
Right-click on Assets to display the context menu, then select Import Package > Custom Package....
Select the NRSDKForUnityAndroid_1.8.0.unitypackage you have downloaded from the file dialog.
Please follow the usual dialog instructions.

After performing this upgrade, you can build your project to build an executable .apk on Nreal Air.

If it does not work on your Nreal Air device, select NRCameraRig, open the Inspector panel and go to NR Session Behaviour > Session Config.

Check that Target Devices is checked for both Nreal Light and Nreal Air.

Enjoy the new version of the NRSDK!

Images and words (Image detection sample) - MR Tutorial for Nreal Light

Kazuhiro Hara™ — Sun, 03 Apr 2022 11:43:16 +0000

This sample displays the message "Detected" when the prepared image comes into view. Learn how to detect images by creating a very simple sample.

Sample Repository

mr-tutorials-for-nreal-light/ImagesAndWords at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone sample repository, Change current directory to ImagesAndWords. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.

2. Prepare tracking images

Prepare a sample image for image detection. Multiple images can be set for image detection. The sample is provided as an image named “ImageDetect.png”.

Put it to Assets > Scene .

3. Create TrackingImageDatabase

Image detection requires a database with registered images for image detection.

Select yout tracking Images, and display context menu with right click.
Select Create > NRSDK > TrackingImageDatabase . Then a TrackingImageDatabase will be created.

4. Create SessionConfig

Move to Assets > Scene , and select Create > NRSDK > SessionConfig then create SessionConfig.
Select the NRKernalSessionConfig you just created and open Inspector .
Enable Image Tracking Mode .
Drag TrackingImageDatabase to Tracking Image Database

5. Set SessionConfig to NRCameraRig

The place to register SessionConfig is in NRCameraRig.

Select Hierarchy > NRCameraRig
Drag NRKernalSessionConfig to Session Config on Inspector > NR Session Behaviour

6. Create C# Script for image detection

Create C# Script in the asset with the file name "IconDetect.cs". Write the code as follows.

using NRKernal;
using NRKernal.NRExamples;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.UI;

/// <summary>
/// Icon Detect class using Trackable Images
/// </summary>
public class IconDetect : MonoBehaviour
{
    /// <summary>
    /// Trackable image list
    /// </summary>
    private List<NRTrackableImage> m_NewMarkers = new List<NRTrackableImage>();

    /// <summary>
    /// Display trackable status
    /// </summary>
    public Text text;

    // Start is called before the first frame update
    void Start()
    {
        text.text = "Searching";
    }

    // Update is called once per frame
    void Update()
    {
        NRFrame.GetTrackables<NRTrackableImage>(m_NewMarkers, NRTrackableQueryFilter.New);

        if(m_NewMarkers.Count > 0)
        {
            NRTrackableImage image = m_NewMarkers[0];
            Debug.Log(image.GetCenterPose().ToString());
            // If you use NRAnchor, uncomment the following
            // NRAnchor anchor = image.CreateAnchor();
            text.text = "Detected";
        }
    }
}

7. Put Canvas and Text on the scene

Put Text object for displaying the cube rotation value.

Put Canvas from Create > UI
Put Text as a child of Canvas
Change Text to “Info” on Inspector panel.
Attach IconDetect.cs on Inspector panel of Canvas.
Set Text to Text Text Object.

8. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

9. Test your application by displaying images for image detection

Display the image for image detection on your own smartphone or PC and view the image in Nreal Light. Make sure the text displayed in Nreal Light goes from Searching to Detected.

Rotator (Sample of grabbing an object and rotating it) - MR Tutorial for Nreal Light

Kazuhiro Hara™ — Tue, 15 Mar 2022 11:46:32 +0000

Next, let's rotate the GameObject touched around the palm of your right hand. This tutorial is a continuation of the "Hold Me Tight" tutorial. If you have not yet comple "Hold Me Tight", please proceed with the following tutorial first.

mr-tutorials-for-nreal-light/HoldMeTight

Sample Repository

mr-tutorials-for-nreal-light/Rotator at main · karad/mr-tutorials-for-nreal-light https://github.com/karad/mr-tutorials-for-nreal-light/tree/main/Rotator

Run the sample

Clone Sample Repository, Change current directory to Rotator. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Place the TargetCube a little closer

Select TargetCube1 from Hierarchy > Target
Change Pos z to 0.6

2. Change C# script TargetCube.cs

Modify the C# script to reflect the right hand rotation on the TargetCube. Change the TargetCube.cs code as follows.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;
using UnityEngine.UI;

/// <summary>
/// Target Cube Script
/// </summary>
public class TargetCube : MonoBehaviour
{
    private MeshRenderer meshRender;

    void Awake()
    {
        // Get mesh renderer
        meshRender = transform.GetComponent<MeshRenderer>();
    }

    // Start is called before the first frame update
    void Start()
    {
    }

    // Update is called once per frame
    void Update()
    {

    }

    /// <summary>
    /// Trigger Enter Event Handler
    /// </summary>
    /// <param name="other"></param>
    private void OnTriggerEnter(Collider other)
    {
        Debug.Log("Enter!");
        meshRender.material.color = new Color(0f, 1f, 0f);
    }

    /// <summary>
    /// Trigger Stay Event Handler
    /// </summary>
    /// <param name="other"></param>
    private void OnTriggerStay(Collider other)
    {
        // Get right hand rotation value
        HandState handState = NRInput.Hands.GetHandState(HandEnum.RightHand);
        Quaternion handStateThumbTipRotation = handState.GetJointPose(HandJointID.Palm).rotation;
        Quaternion targetRotation = transform.rotation;
        targetRotation.z = handStateThumbTipRotation.z;
        transform.rotation = targetRotation;
    }

    /// <summary>
    /// Trigger Exit Event Handler
    /// </summary>
    /// <param name="other"></param>
    private void OnTriggerExit(Collider other)
    {
        Debug.Log("Exit!");
        meshRender.material.color = new Color(1f, 1f, 1f);
    }
}

3. Change C# script HandController.cs

Next, let's also modify the right hand controller. Change the touch point from index finger to palm. Change the HandController.cs code as follows.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;

/// <summary>
/// Hand Controller for Tip
/// </summary>
public class HandController : MonoBehaviour
{
    /// <summary>
    /// IndexTip GameObject
    /// </summary>
    public GameObject hand_R_IndexTip;

    // Start is called before the first frame update
    void Start()
    {

    }

    // Update is called once per frame
    void Update()
    {
        // Get Right Hand
        HandState handState = NRInput.Hands.GetHandState(HandEnum.RightHand);
        // Get Index Tip Position of right hand
        Vector3 handStatePalmPosition = handState.GetJointPose(HandJointID.Palm).position;
        // Set Hand R IndexTip Sphere position
        hand_R_IndexTip.transform.position = handStatePalmPosition;
    }
}

4. Create a display area for rotation value

Let's also create a display area to get a numerical value for the right hand rotation value. Create C# Script in the asset with the file name "DisplayInfo.cs". Write the code as follows.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.UI;

/// <summary>
/// Display about user actions
/// </summary>
public class DisplayInfo : MonoBehaviour
{
    /// <summary>
    /// 
    /// </summary>
    public Text info;

    // Start is called before the first frame update
    void Start()
    {

    }

    // Update is called once per frame
    void Update()
    {
        // Numeric display of right hand palm rotation value
        HandState handState = NRInput.Hands.GetHandState(HandEnum.RightHand);
        if (handState != null)
        {
            info.text = handState.GetJointPose(HandJointID.Palm).rotation.z.ToString();
        };
    }
}

5. Put Text on the scene

Put Text object for displaying the cube rotation value.

Put Canvas from Create > UI
Put Text as a child of Canvas
Change Text to “Info” on Inspector panel.
Attach DisplayInfo.cs on Inspector panel of Canvas.
Set info to Info Text Object.

6. Run the tutorial

Press Play button and run the tutorial.

7. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Hold Me Tight (Sample of using Grab to grab and move an object) - MR Tutorial for Nreal Light

Kazuhiro Hara™ — Fri, 11 Mar 2022 22:25:13 +0000

Now let's try to grab the touched GameObject and move it. This tutorial is a continuation of the "U Can Touch This" tutorial. If you have not yet comple "U Can Touch This", please proceed with the following tutorial first.

U Can Touch This - MR Tutorial for Nreal Light

Sample Repository

mr-tutorials-for-nreal-light/HoldMeTight at main · karad/mr-tutorials-for-nreal-light https://github.com/karad/mr-tutorials-for-nreal-light/tree/main/HoldMeTight

Run the sample

Clone Sample Repository, Change current directory to HoldMeTight. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. First, complete "U Can Touch This"

First, complete "U Can Touch This". This tutorial will continue with "U Can Touch This". You can also start by cloning the sample repository.

2. Check “Is Trigger” on “TargetCube1”

Select TargetCube1 from Target on the Scene.
Check Is Trigger from Inspector Panel. By checking this box, you can trigger events when you touch game objects.

3. Chenge C# Script

Open C# Script “TargetCube.cs” on Assets panel.
Change the code as follows.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;
using UnityEngine.UI;

/// <summary>
/// Target Cube Script
/// </summary>
public class TargetCube: MonoBehaviour
{
    private MeshRenderer meshRender;

    void Awake()
    {
        meshRender = transform.GetComponent<MeshRenderer>();
    }

    // Start is called before the first frame update
    void Start()
    {
    }

    // Update is called once per frame
    void Update()
    {

    }

    /// <summary>
    /// Display event log using console
    /// </summary>
    /// <param name="collision"></param>
    private void OnCollisionEnter(Collision other)
    {
        Debug.Log("Hit!");
    }

    /// <summary>
    /// Trigger Enter Event Handler
    /// </summary>
    /// <param name="other"></param>
    private void OnTriggerEnter(Collider other)
    {
        Debug.Log("Enter!");
        meshRender.material.color = new Color(1f, 0f, 0f);
    }

    /// <summary>
    /// Trigger Stay Event Handler
    /// </summary>
    /// <param name="other"></param>
    private void OnTriggerStay(Collider other)
    {
        // Get Right Hand
        HandState handState = NRInput.Hands.GetHandState(HandEnum.RightHand);
        if(handState.currentGesture == HandGesture.Grab)
        {
            // Get Index Tip Position of right hand
            Vector3 handStateThumbTipPosition = handState.GetJointPose(HandJointID.IndexTip).position;
            // Set Hand R IndexTip Sphere position
            transform.position = handStateThumbTipPosition;
        }
    }

    /// <summary>
    /// Trigger Exit Event Handler
    /// </summary>
    /// <param name="other"></param>
    private void OnTriggerExit(Collider other)
    {
        Debug.Log("Exit!");
        meshRender.material.color = new Color(1f, 1f, 1f);
    }
}

4. Run the tutorial

Press Play button and run the tutorial.

5. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

U Can Touch This (Sample of Touch a cube object with your hand) - MR Tutorial for Nreal light

Kazuhiro Hara™ — Fri, 25 Feb 2022 08:11:10 +0000

Touch the object with the index finger of your right hand.

Sample Repository

mr-tutorials-for-nreal-light/UCanTouchThis at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone Sample Repository, Change current directory to UCanTouchThis. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.

2. Setting for HandTracking to NRInput

Select NRInput , and change Input Source Type to Hands
Put NRHand_R from Assets > NRSDK > Prefabs > Hands to NRInput > Right on the Scene.
Put NRHand_L from Assets > NRSDK > Prefabs > Hands to NRInput > Left on the Scene.

3. Disable NRHandPointer_R

Select NRHandPointer_R from NRInput > Right > NRHand_R on the Scene.
Disable NRHandPointer_R from Inspector Panel.
Do the same settings for the Left hand (NRHandPointer_L) .

4. Create empty game objects

Create an empty game object in the Scene with the name "HandController".
Also, create an empty game object in the Scene with the name "Target".
Set each GameObject's positions to 0.
1. Pos X : 0, Pos Y : 0, Pos Z : 0

5. Make Alpha material

Create Material on Assets
Change name to “AlphaMaterial”
Change Rendering Mode item to Fade.

6. Create Sphere for hand tracking

Put Sphere in HandController.
1. Change name to “Hand_R_IndexTip”
2. Pos X : 0, Pos Y : 0, Pos Z : 0
3. Scale
  1. X : 0.03 , Y : 0.03 , Z : 0.03
4. Add component Ridgitbody .
  1. Uncheck Use Gravity
5. Set a material “AlphaMaterial” to Materials from Assets.

7. Create C# script for hand tracking extension

Create C# Script in the asset with the file name "HandController.cs".
Write the code as follows.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;

/// <summary>
/// Hand Controller for Tip
/// </summary>
public class HandController : MonoBehaviour
{
    /// <summary>
    /// IndexTip GameObject
    /// </summary>
    public GameObject hand_R_IndexTip;

    // Start is called before the first frame update
    void Start()
    {
    }

    // Update is called once per frame
    void Update()
    {
        // Get Right Hand
        HandState handState = NRInput.Hands.GetHandState(HandEnum.RightHand);
        // Get Index Tip Position of right hand
        Vector3 handStateThumbTipPosition = handState.GetJointPose(HandJointID.IndexTip).position;
        // Set Hand R IndexTip Sphere position
        hand_R_IndexTip.transform.position = handStateThumbTipPosition;
    }
}

8. Attach the C# script on “HandController”

Attach "HandController.cs" to “HandController” game object
1. Set hand_R_IndexTip on Inspector panel to “Hand_R_IndexTip” game object from the scene.

9. Create Cube as a target object

Put Cube in Target.
1. Change name to “TargetCube1”
2. Pos X : 0.1, Pos Y : -0.05, Pos Z : 0.8
3. Scale
  1. X : 0.1 , Y : 0.1 , Z : 0.1
4. Add component Ridgitbody .
  1. Uncheck Use Gravity

10. Create C# script for target game object

Create C# Script in the asset with the file name "TargetCube.cs".
Write the code as follows.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;
using UnityEngine.UI;

/// <summary>
/// Target Cube Script
/// </summary>
public class TargetCube: MonoBehaviour
{
    // Start is called before the first frame update
    void Start()
    {
    }

    // Update is called once per frame
    void Update()
    {
    }

    /// <summary>
    /// Display event log using console
    /// </summary>
    /// <param name="collision"></param>
    void OnCollisionEnter(Collision collision)
    {
        Debug.Log("Hit!");
    }
}

11. Attach the C# script on “Target”

Attach "TargetCube.cs" to “TargetCube1” game object.

12. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Pinch Strength using HandTracking - MR Tutorial for Nreal light

Kazuhiro Hara™ — Tue, 15 Feb 2022 09:39:39 +0000

Measure the strength of your left and right hand hand tracking.

Sample Repository

mr-tutorials-for-nreal-light/PinchStrength at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone Sample Repository, Change current directory to PinchStrength. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.

2. Setting for HandTracking to NRInput

Select NRInput , and change Input Source Type to Hands
Put NRHand_R from Assets > NRSDK > Prefabs > Hands to NRInput > Right on the Scene.
Put NRHand_L from Assets > NRSDK > Prefabs > Hands to NRInput > Left on the Scene.

3. Put a Canvas in the scene

Put Canvas from Create > UI
Set property on Inspector panel
1. Render Mode : World Space
2. Pos X : 0 , Pos Y : -0.35 Pos Z : 3
3. Scale
  1. X : 0.005 , Y : 0.005 , Z : 0.005

4. Put Slider in Canvas

Put Slider as a child of Canvas with the name "PinchStrengthBarRight”.
1. Set Pos X : 100, Pos Y : 50, Pos Z : 0
2. Change the Background Color of the child of PinchStrengthBarRight to "#FF0000".
3. Change the Fill Area > Fill Color of the child of PinchStrengthBarRight to "#00FF44".
4. Change the Rect Transform of Fill Area , Set Left of Rect Transform to "0", and set Right to "0" as well.
5. disable Handle Slide Area
Duplicate PinchStrengthBarRight
1. Change name to “PinchStrengthBarLeft”
2. Set Pos X : -100, Pos Y : 50, Pos Z : 0

5. Create an empty GameObject and attach C# script to it.

Create an empty GameObject on Hierarchy with the name BaseGameObject .
Create the following C# script named PinchStrength and attach it to the empty GameObject you just created.
1. Set Pinch Strength Right Hand on Inspector panel to PinchStrengthBarRight on the scene.
2. Set Pinch Strength Left Hand on Inspector panel to PinchStrengthBarLeft on the scene.

using NRKernal;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;
using UnityEngine.UI;

public class PinchStrength : MonoBehaviour
{
    /// <summary>
    /// Pinch Strength Bar for Left Hand
    /// </summary>
    public Slider pinchStrengthLeftHand;

    /// <summary>
    /// Pinch Strength Bar for Right Hand
    /// </summary>
    public Slider pinchStrengthRightHand;

    // Start is called before the first frame update
    void Start()
    {
    }

    // Update is called once per frame
    void Update()
    {
        HandState handStateRight = NRInput.Hands.GetHandState(HandEnum.RightHand);
        float pinchStrengthRight = handStateRight.pinchStrength;
        pinchStrengthRightHand.value = pinchStrengthRight;

        HandState handStateLeft = NRInput.Hands.GetHandState(HandEnum.LeftHand);
        float pinchStrengthLeft = handStateLeft.pinchStrength;
        pinchStrengthLeftHand.value = pinchStrengthLeft;
    }
}

6. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

HandTracking - MR Tutorial for Nreal light

Kazuhiro Hara™ — Mon, 14 Feb 2022 07:48:12 +0000

Simple HandTracking tutorial. Use hand tracking to pinch to increase the count!

Sample Repository

mr-tutorials-for-nreal-light/HandTracking at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone Sample Repository, Change current directory to HandTracking . And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.8.0 from Download | Nreal
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.8.0.unitypackage.

2. Setting for HandTracking to NRInput

Select NRInput , and change Input Source Type to Hands
Put NRHand_R from Assets > NRSDK > Prefabs > Hands to NRInput > Right
Put NRHand_L from Assets > NRSDK > Prefabs > Hands to NRInput > Left

3. Create Material

Open Project, select Assets
Create Material on Assets
1. Change name to “TouchCubeMaterial”
2. Change Albedo to “CC0000”

4. Put Cube in the Scene

Put Cube in the Scene
1. Change name to “TouchCube”
2. Pos X : 0, Pos Y : 0, Pos Z : 8

5. Put a Canvas in the scene

Put Canvas from Create > UI
Set property on Inspector panel
1. Render Mode : World Space
2. Pos X : 0 , Pos Y : -0.35 Pos Z : 3
3. Scale
  1. X : 0.005 , Y : 0.005 , Z : 0.005

6. Put Text in Canvas

Put Text as a child of Canvas with the name "Counter”.
1. Pos X : 0, Pos Y : -30, Pos Z : 3
2. Change Text to “0”
3. Change Color to “FFCC00”
4. Change Font size to 30

7. Create C# Script in Assets

Create C# Script in the asset with the file name "HandTrack.cs".
Write the code as follows

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;
using UnityEngine.UI;

public class HandTrack : MonoBehaviour, IPointerClickHandler
{
    /// <summary>
    /// Counter Text GameObject
    /// </summary>
    public Text targetText;

    /// <summary>
    /// Counter value
    /// </summary>
    private int counter = 0;

    /// <summary>
    /// HandTracking Click Handler
    /// </summary>
    /// <param name="eventData"></param>
    public void OnPointerClick(PointerEventData eventData)
    {
        counter++;
        targetText.text = counter.ToString();
        //throw new System.NotImplementedException();
    }

    // Start is called before the first frame update
    void Start()
    {

    }

    // Update is called once per frame
    void Update()
    {

    }
}

8. Attach the C# script on “TouchCube”

Attach "HandTrack.cs" to “TouchCube”
1. Set Target Text on Inspector panel to Counter on the scene.

9. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Check size of a lot of cubes on Nreal light - MR Tutorial for Nreal light

Kazuhiro Hara™ — Sat, 12 Feb 2022 09:18:45 +0000

This sample is to see what size you can actually feel by placing many 1x1x1 cubes in the space.

Sample Repository

mr-tutorials-for-nreal-light/CubeSize at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone Sample Repository, Change current directory to CubeSize . And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.7.0 from https://nreal-public.nreal.ai/download/NRSDKForUnityAndroid_1.7.0.unitypackage
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.7.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.7.0 from https://nreal-public.nreal.ai/download/NRSDKForUnityAndroid_1.7.0.unitypackage
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.7.0.unitypackage.

2. Put a Cube in the scene and convert it to Prefab

Open Project , create Resource folder in Assets > Scenes
Create Cube on current scene, change name to MyCube .
Drag MyCube to Assets > Scenes > Resource folder.
Delete MyCube from Hierarchy .

3. Create an empty GameObject and attach C# script to it.

Create an empty GameObject on Hierarchy with the name BaseCubeSize .
Create the following C# script named CubeSize and attach it to the empty GameObject you just created.

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;

public class CubeSize : MonoBehaviour
{
    /// <summary>
    /// Cube PreFab
    /// </summary>
    GameObject spherePrefab;

    /// <summary>
    /// Initial Position for cube layout
    /// </summary>
    static readonly Vector3 INITIAL_POSITION = new Vector3(0.0f, -0.35f, 3f);

    /// <summary>
    /// Number of Cubes list per axis
    /// </summary>
    static readonly float DEPTH = 20f;

    /// <summary>
    /// Space for each Cubes
    /// </summary>
    static readonly float SPAN = 2f;

    // Start is called before the first frame update
    void Start()
    {
        spherePrefab = Resources.Load<GameObject>("MyCube");
        LayoutCubes(DEPTH, SPAN);
    }

    /// <summary>
    /// Layout Cubes
    /// </summary>
    /// <param name="depth"></param>
    /// <param name="span"></param>
    void LayoutCubes(float depth, float span)
    {
        for (float x = -depth; x <= depth; x = x += span)
        {
            for (float y = -depth; y <= depth; y += span)
            {
                for (float z = -depth; z <= depth; z += span)
                {
                    // Exclude own position
                    if (!(x == 0 && y == 0 && z == -2f))
                    {
                        CreateCube(x, y, z);
                    }
                }
            }
        }
    }

    /// <summary>
    /// Put a cube  in the current scene
    /// </summary>
    /// <param name="x"></param>
    /// <param name="y"></param>
    /// <param name="z"></param>
    void CreateCube(float x, float y, float z)
    {
        GameObject sphere = Instantiate(spherePrefab);
        sphere.transform.position = new Vector3(INITIAL_POSITION.x + x, INITIAL_POSITION.y + y, INITIAL_POSITION.z + z);
    }
}

4. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Cube Rotation - MR Tutorial for Nreal light

Kazuhiro Hara™ — Wed, 09 Feb 2022 23:35:01 +0000

Sample Repository

mr-tutorials-for-nreal-light/CubeRotation at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone Sample Repository, Change current directory to CubeRotation. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.7.0 from https://nreal-public.nreal.ai/download/NRSDKForUnityAndroid_1.7.0.unitypackage
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.7.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.7.0 from https://nreal-public.nreal.ai/download/NRSDKForUnityAndroid_1.7.0.unitypackage
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.7.0.unitypackage.

2. Put a Canvas in the scene

Put Canvas from Create > UI
Set property on Inspector panel
1. Render Mode : World Space
2. Pos X : 0 , Pos Y : -0.35 Pos Z : 3
3. Scale
  1. X : 0.005 , Y : 0.005 , Z : 0.005

3. Put Text in Canvas

Put Text as a child of Canvas
1. Pos X : 0, Pos Y : -30, Pos Z : 3
Change Text to “Rotate Cube” on Inspector panel.
Change Color to “FFFFFF” on Inspector panel.

4. Create C# Script in Assets

Create C# Script in the asset with the file name "RotateButton.cs".
Write the code as follows

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.EventSystems;

public class RotateButton : MonoBehaviour, IPointerUpHandler, IPointerDownHandler
{
    /// <summary>
    /// Target Object
    /// </summary>
    public GameObject TargetCube;

    /// <summary>
    /// Rotation Type
    /// </summary>
    public RotationTypeEnum RotationType;

    /// <summary>
    /// Number of rotations at a time
    /// </summary>
    private static readonly int ROTATE = 1;

    /// <summary>
    /// Press flag
    /// </summary>
    private bool isPressed = false;

    /// <summary>
    /// Rotation Type Enum
    /// </summary>
    public enum RotationTypeEnum
    {
        LEFT,
        RIGHT
    }

    // Start is called before the first frame update
    void Start()
    {

    }

    // Update is called once per frame
    void Update()
    {
        if (isPressed)
        {
            if (RotationType == RotationTypeEnum.RIGHT)
            {
                TargetCube.transform.Rotate(new Vector3(0, ROTATE, 0));
            }
            else if (RotationType == RotationTypeEnum.LEFT)
            {
                TargetCube.transform.Rotate(new Vector3(0, -ROTATE, 0));
            }
        }
    }

    /// <summary>
    /// Pointer up event handler
    /// </summary>
    /// <param name="eventData"></param>
    public void OnPointerUp(PointerEventData eventData)
    {
        isPressed = false;
    }

    /// <summary>
    ///  Pointer down event handler
    /// </summary>
    /// <param name="eventData"></param>
    public void OnPointerDown(PointerEventData eventData)
    {
        isPressed = true;
    }
}

5. Put Cube in the Scene

Put Cube in the Scene
1. Change name to “RotatableCube”
2. Pos X : 0, Pos Y : 0, Pos Z : 8

6. Put “Rotate Right” Button in Canvas

Put Button as a child of Canvas
1. Pos X : 60, Pos Y : 0, Pos Z : 0
2. Width : 100
Change Text to “Rotate Right” from nested Text.
Attach the RotateButton.cs on Inspector panel.
1. Set Target Cube to RotatableCube you just created.
2. Set Rotation Type to RIGHT.

7. Put “Rotate Left” Button in Canvas

Put Button as a child of Canvas
1. Pos X : -60, Pos Y : 0, Pos Z : 0
2. Width : 100
Change Text to “Rotate Left” from nested Text.
Attach the RotateButton.cs on Inspector panel.
1. Set Target Cube to RotatableCube you just created.
2. Set Rotation Type to LEFT.

8. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Hello World - MR Tutorials for Nreal light

Kazuhiro Hara™ — Tue, 08 Feb 2022 06:40:10 +0000

Sample Repository

mr-tutorials-for-nreal-light/HelloWorld at main · karad/mr-tutorials-for-nreal-light

Run the sample

Clone Sample Repository, Change current directory to HelloWorld. And Open with Unity.
(If you don't have NRSDK) Download NRSDK 1.7.0 from https://nreal-public.nreal.ai/download/NRSDKForUnityAndroid_1.7.0.unitypackage
Open Build Setting, change Platform to Android
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.7.0.unitypackage.
Check Build Settings > Player Settings by referring to Configure Build Settings
Press Build form Build Settings panel
Install *.apk on Android or DevKit.

Tutorial

1. Setting up the project for Nreal development

See Quickstart for Android - NRSDK Documentation and configure the build settings.
(If you don't have NRSDK) Download NRSDK 1.7.0 from https://nreal-public.nreal.ai/download/NRSDKForUnityAndroid_1.7.0.unitypackage
Open Project, select Assets > import package > Custom Package and import NRSDKForUnityAndroid_1.7.0.unitypackage.

2. Put a Canvas in the scene

Put Canvas from Create > UI
Set property on Inspector panel
1. Render Mode : World Space
2. Pos X : 0 , Pos Y : -0.35 Pos Z : 3
3. Scale
  1. X : 0.005 , Y : 0.005 , Z : 0.005

3. Put Text in Canvas

Put Text as a child of Canvas
1. Pos X : 0, Pos Y : 50, Pos Z : 3
Change Text to "Hello World!" on Inspector panel.
Change color of Text to #fff.

4. Build

Press Build form Build Settings panel
Install *.apk on Android or DevKit.