DEV Community: Akira Game

Local LLM Memo

Akira Game — Fri, 14 Feb 2025 20:02:09 +0000

Table of contents

Tool
How to run LLM localy
How to use LLM for personal research agent
Create API Server

Tool

Ollama

It can run with large language models (LLMs).
Although each models has different interface, it has unified interface to use lcoal LLM, so you can run LLMs easily.

LangChain

LangChain is a composable framework to build with LLMs.
Langchain

LangGraph

LangGraph is the orchestration framework for controllable agentic workflows.
It defines state and create complex workflow.

Duckdockgo-search

This is a search engine that protects user privacy.

DuckdockGo

How to run LLM locally

I used Ollama to run LLMs locally.

Download Ollama

Download Ollama from the official website.
Ollama

Install

Install Ollama following the installer.

Download LLM

Download the LLM you want to download.

ollama pull <model_name>

Run LLM

Run the LLM

ollama run <model_name>

How to use LLM for personal research agent

I referred the below technical article.
How to build a Interactive Personal AI Research Agent with Llama 3.2 : A Step-by-Step Guide using LangChain and Ollama

Create API Server

I built API server using render and Flask.

AR Game Dev 1 / 10( Contents )

Akira Game — Thu, 26 Sep 2024 13:04:47 +0000

Table of contents

Background
What I want to develop
Architecture
Next Step

Background

I am a postgraduate student at Kingston University in the UK. I am studying games, AR, VR and AI. I have researched AR development through the previous posts. Based on that, I have been implementing an AR game. In the upcoming posts, I will introduce the process of AR game development in them.

If you are interested in any posts, I would appreciate your reactions.
If there are any companies involved in game or AR development, please feel free to get in touch.

What I want to develop

In these days, AR is used in many different fields. It is not only in the entertainment industry, but also various industries such as education and tourism. The AR game I have been implementing is primarily designed for use in the tourism industry. By making effort of AR, the game offers a more immersive experience compared to traditional games. Additionally, it enables users to have experience that would be physically challenging, by using digital objects.

Objective

The objective of the game is to enable players to learn about Kingston University while enjoying to play through an AR.

This game will be available exclusively at Kingston University.

Story

The story of the game sets users as a new student arriving at Kingston University for the first time. When they arrive, they discover a book. In this book, it is written that there are seven mysteries hidden at Kingston University. If someone solve them, he/she will get a treasure. Additionally, when the user touched the book, they get a mysterious power. ( It is inspired by Death Note... )

Game Flow

Below is the flow of the game.
It has three main phases, which consist of the 2D section for game progression, the map scene, and the AR scene.

Game Progression

The game progression will be based on a 2D character.

Map Scene

As I mentioned early, this app is available at Kingston University and requires that users are guided to specific locations. To achieve this, I have created a map scene using the Google Maps API. Like Pokemon Go, the character's movements depend on the user's location. I used the following book as a reference.

https://amzn.asia/d/jctLB7T

AR Scene

As the game progresses, there is an AR scene for each mystery. They are from simple puzzles to mini-games. Users can collect and use items during AR scene. These items will help users to progress the game.

By solving all the mysteries, players will get the final treasure.
The details of each mystery and the scenes will be shown in the upcoming posts.

Architecture

This image shows the general architecture of this game.

All process run in Unity. In terms of AR, AR Foundation is used. Also, various APIs like Google Static API are called in Unity.

Map Scene

In this scene, the user's consent to data acquisition is assumed. Based on the user location data, the Google Static API is used to display a map of the user's surroundings.

AR Scene

AR objects are displayed by using AR Foundation.

No require location

If location data is not required to solve the mystery, only AR Foundation is sufficient for implementation.

Require location

Since this game aims to create an AR experience within the campus, location data is necessary. Therefore, AR objects are placed at specific locations using the Geospatial API. Additionally, to improve user experience, the Streetscape Geometry API is utilised by using of surrounding's buildings and terrain.

Next Step

In this post, I introduced simply the game content and the architecture. In next post, I will show the 2D section for game progression.

AR Game ~ Geospatial Creator ~

Akira Game — Thu, 25 Jul 2024 09:52:47 +0000

Table of contents

Background
What is Geospatial Creator
How to use Geospatial Creator

Background

I am develop AR Game with Unity, AR foundation and so on. To learn AR development, I am researching about AR and the software related it. This blog shows the research and the process of developing AR game. If you have a question, I am happy to answer it.

When you are implementing AR Game, you need to go out to verify AR scene because you need to check whether AR contents are placed nicely in person, which can lead to wasting a lot time. To avoid the task, you can use Geospatial creator. It helps you place anchors without code in Unity. This post will show what is Geospatial Creator and how to use it.

What is Geospatial Creator

Before this was available, it had been necessary to go to the actual location to check if the AR content was displayed. A lot of programming was also required, which made the implementation time-consuming. However,by using it, you can visualize, build, and launch 3D digital content in real world location through Photorealistic 3D Tiles.

How to use Geospatial Creator in Unity

Reference

API Authorization

You need to enable these below API in Google Cloud Platform.

Google Map Tiles API
ARCore Geospatial API

Configure in Unity

You mush enable ARCore and ARKit in your Unity project.

Edit > Project Settings > XR Plug-in Management

Add Cesium

The Geospatial Creator uses a third party Unity package called Cesium to render Google Map Tiles in the Unity Editor's Scene window.

You need to download it from the below link.

Releases

Install the downloaded package in Unity

Enable Geospatial Creator

You need to set up API key and enable Geospatial Creator.

Add a Geospatial Creator Origin with Map Tiles

Add a Geospatial Creator Origin component with Map Tiles in your project.

You need to set API key too. Also, you can put the position's latitude, longitude, and altitude where you want to create.

Add and place a Geospatial Creator Anchor

Add a Geospatial Creator Anchor component in your project.

You can place any objects in your porject.

AR Game ~ Geospatial API Sample ~

Akira Game — Wed, 24 Jul 2024 20:59:14 +0000

Table of contents

Background
Sample
Code
Unity
Next Step

Background

I researched Geospatial API before. This post will show the sample of the game with geospatial API. Therefore, it will be my note. If you use it, please do not miss it.

Sample

If you use ARCore Extensions, you can import Geospatial Sample and try it easily.

In sample scene, you can test Geospatial API and put AR object anywhere unless localising area.

UI

Origin

This is basement of AR content and user viewpoint (camera). It used to be called AR Session origin.

In real world, it can adjust the scale of virtual objects. Also, according user movement, it can update the position and rotation of AR objects.

Session

This object is used to manage the whole lifecycle of AR experience and setting.

It can start, pose, and restart AR experience.

ARCore Extensions

This is the package that merge AR Foundation and Google ARCore extension. By using it, you can use the specific AR Core functions.

For example, it offer the AR experience based on GPS location. By using it, you can put virtual objects on the specific location.

UI Information panel

It shows the information like Latitude and Longitude at runtime.

Debug Text

It shows the information from API for debug.

Privacy Prompt

This is the prompt to get the user agreement.

Code

In sample scene, there is Geospatial controller, which manage the API and UI. I believe it is basement, therefore if you understand it, you can use it for your own game.

Awake

In Awake function, this app lock the user screen to portrait.

Screen.autorotateToLandscapeLeft = false;
Screen.autorotateToLandscapeRight = false;
Screen.autorotateToPortraitUpsideDown = false;
Screen.orientation = ScreenOrientation.Portrait;

OnEnable

This function starts location service like below code.

_startLocationService = StartLocationService();
StartCoroutine(_startLocationService);

Location Service

When it starts, you can get user location.

Input.location.Start();

while (Input.location.status == LocationServiceStatus.Initializing)
{
  yield return null;
}

_waitingForLocationService = false;
if (Input.location.status != LocationServiceStatus.Running)
{
  Debug.LogWarning($"Location service ended with {Input.location.status} status.");
  Input.location.Stop();
}

Start

When the app starts, the start screen will be displayed. Then when you click the start button, the location service starts.

In this code, when clicked, what user confirmed a privacy prompt will be saved while proceed next screen.

public void OnGetStartedClicked()
{
  PlayerPrefs.SetInt(_hasDisplayedPrivacyPromptKey, 1);
  PlayerPrefs.Save();
  SwitchToARView(true);
}

Additionally, it will change UI status.

_isReturning = false;
_enablingGeospatial = false;
InfoPanel.SetActive(false);
GeometryToggle.gameObject.SetActive(false);
AnchorSettingButton.gameObject.SetActive(false);
AnchorSettingPanel.gameObject.SetActive(false);
GeospatialAnchorToggle.gameObject.SetActive(false);
TerrainAnchorToggle.gameObject.SetActive(false);
RooftopAnchorToggle.gameObject.SetActive(false);
ClearAllButton.gameObject.SetActive(false);
DebugText.gameObject.SetActive(Debug.isDebugBuild && EarthManager != null);

Finally, it will switch from the privacy prompt screen to AR view screen.

SwitchToARView(PlayerPrefs.HasKey(_hasDisplayedPrivacyPromptKey));

Update

Update debug text

update debug text

$"IsReturning: {_isReturning}\n" +
$"IsLocalizing: {_isLocalizing}\n" +
$"SessionState: {ARSession.state}\n" +
$"LocationServiceStatus: {Input.location.status}\n" +
$"FeatureSupported: {supported}\n" +
$"EarthState: {EarthManager.EarthState}\n" +
$"EarthTrackingState: {EarthManager.EarthTrackingState}\n" +
$"  LAT/LNG: {pose.Latitude:F6}, {pose.Longitude:F6}\n" +
$"  HorizontalAcc: {pose.HorizontalAccuracy:F6}\n" +
$"  ALT: {pose.Altitude:F2}\n" +
$"  VerticalAcc: {pose.VerticalAccuracy:F2}\n" +
$". EunRotation: {pose.EunRotation:F2}\n" +
$"  OrientationYawAcc: {pose.OrientationYawAccuracy:F2}";

Check application status

If user leave the app, the app ends.

Example (When user click escape button, the app ends)

if (Input.GetKeyUp(KeyCode.Escape))
{
  Application.Quit();
}

Check localizing status

Check the AR session state
Check earth tracking state
Check earth pose

bool isSessionReady = ARSession.state == ARSessionState.SessionTracking &&
            Input.location.status == LocationServiceStatus.Running;
var earthTrackingState = EarthManager.EarthTrackingState;
var pose = earthTrackingState == TrackingState.Tracking ?
            EarthManager.CameraGeospatialPose : new GeospatialPose();

If the localizing is lost, error message will be displayed.
While if the localizing success, all anchor will be displayed.

foreach (var go in _anchorObjects)
{
  go.SetActive(true);
}

Anchor Type

To place 3D contents in the real world, the API use Anchor, which eusure these contents appear to stay at the same position and orientation in space. it helps to maintain the illusion of virtual objects placed in the real world.

Working with Anchors

There are three types of Geospatial anchors, which can handle altitude differently.

WGS84 anchors

This type can place 3D contents at any latitude, longitude, and altitude.

Terrain anchors

This type can place 3D contents using only latitude and longitude with a height relative to the terrain at that position. The altitude is determined relative to the ground or floor by using VPS.

Rooftop anchors

This type can place content using only latitude and longitude with a height relative to a building's rooftop at that position. The altitude is determined relative to the top of a building by using Streetscape Geometry.

Streetscape Geometry

This function can provide the geometry of terrain , buildings, or other structures in a scene. The geometry can be used for occlusion, rendering, or placing AR content.

AR Game ~ ChatGPT API ~

Akira Game — Tue, 11 Jun 2024 20:15:02 +0000

Table of contents

Background
What is ChatGPT API
Implementation of ChatGPT API
Execution of ChatGPT API
Next Step

Background

I will develop AR Game with Unity, AR foundation and so on. To learn AR development, I am researching about AR and the software related it. This blog shows the research and the process of developing AR game. If you have a question, I am happy to answer it.

In my AR game, Chat GPT will be used to create automatically character dialog. Therefore, this post will show how to implement ChatGPT API on Unity.

What is ChatGPT API

These days, everyone probably knows ChatGPT. Chat GPT API is a feature that allows you to use ChatGPT via an API. Also, it is available on Unity.

Implementation of ChatGPT API

Obtain API key from Open AI

To use ChatGPT API, it is necessary to get API KEY from Open AI.

Access Open AI platform
Open AI
Click DashBoard > API keys
Click "Create new secret key"

Request

To confirm the dialog, I implemented two text filed and the button. When the button was clicked, it requests Chat GPT API.

Sample



// Open API Endpoint

var apiUrl = "https://api.openai.com/v1/chat/completions";

// Add message into list

_messageList.Add(new ChatGPTMessageModel {role = "user", content = userMessage});

// Header Information 

var headers = new Dictionary<string, string>

{

  {

    "Authorization", "Bearer " + _apiKey

  },

  {

     "Content-type", "application/json"

  }

};

// Request Opiton 

var options = new ChatGPTCompletionRequestModel()

{

  model = "gpt-3.5-turbo",

  messages = _messageList

};

var jsonOptions = JsonUtility.ToJson(options);

using var request = new UnityWebRequest(apiUrl, 

"POST")

{

  uploadHandler = new UploadHandlerRaw(

    Encoding.UTF8.GetBytes(jsonOptions)),

            downloadHandler = new DownloadHandlerBuffer()

};

// Set Request Header

foreach (var header in headers)

{

  request.SetRequestHeader(header.Key, header.Value);

}

// Request 

await request.SendWebRequest();

// Process Request

if (request.result == UnityWebRequest.Result.ConnectionError || request.result == UnityWebRequest.Result.ProtocolError)

{

  Debug.LogError(request.error);

  throw new Exception();

}

else

{

  var responseString = request.downloadHandler.text;

  var responseObject = JsonUtility.FromJson<ChatGPTResponseModel>(responseString);

_messageList.Add(responseObject.choices[0].message);

            return responseObject;

}

Set initial message

Dialog can be changed by setting initial message. At this time, I changed it to speak more like a German.



new ChatGPTMessageModel() {role = "system", content = "You are German. Please reply like German in English"});

Execution of ChatGPT API on Unity

This video shows the dialog that used Chat GPT API.

Next Step

AR Game ~ Geospatial API ~

Akira Game — Tue, 11 Jun 2024 13:54:38 +0000

Table of contents

Background
What is Geospatial API
Implementation of Geospatial API
Execution of the Geospatial API
Next Step

Background

What is Geospatial API

I will develop AR game with Geospatial API. Currently, there are several types of AR. I have written the article about these types. If you want, please see it.

What is Augmented Reality (AR)

Previous AR technology made it difficult to place AR objects in specific locations, and objects could only be placed around the device.
The Geospatial API uses not only your smartphone's GPS information but also Google Street View data and images from your smartphone's camera to perform precise positioning, allowing you to place AR objects anywhere in the world.
Additionally, this API allows nearby buildings to create an AR world, which can provide a more immersive experience.

Geospatial API

Implementation of Geospatial API

This post will show how to implement AR using Geospatial API.

Prerequisites

Installed Unity
Installed AR Foundation
Installed AR core or AR Kit

Enable the ARCore API

It is necessary to enable the ARCore API in a GCP project to use Geospatial API.

Add required libraries to your app

Install ARCore Extension

To use the ARCore Geospatial API, your project must support AR Foundation and the ARCore Extensions for AR Foundation.

Access Package manager
Click "Add package from git URL"

URL



https://github.com/google-ar/arcore-unity-extensions.git

Add required libraries to your app

You must add libraries to enable Geospatial features in your app.

Enable Geospatial capabilities in the session configuration

Create "ARCore Extensions Config"
Change Geospatial Mode from disabled to enabled

Create ARCore Extensions

Create ARCore Extensions object and attach ARCore Extensions Config on it.

Create XR Origin

Create XR Origin (AR) object, which manage user' movement and input.

Add Component

Add these below components

AR Earth Manger for location
AR Anchor Manager for putting objects in a specific place
AR Streetscape Geometry Manager for getting Geometry information for buildings and other urban environments
AR Plane Manager for tracking and managing a plane

Set AR Camera Manager on Main Camera Object

This component can estimate the light in an AR scene based on light information obtained from camera images.

Add AR Occlusion Manager onto Main Camera Object

This component can occlude virtual objects with real world exists like buildings and trees.

Get started with Code

Start location Service

You can start the location service with "Input.location.Start()". Once started, the service can get the user's location information etc.



example 

_waitingForLocationService = true;
if (!Input.location.isEnabledByUser)
{
  _waitingForLocationService = false;
  yield break;
}
Debug.Log("Starting location service.");
Input.location.Start();

while (Input.location.status == LocationServiceStatus.Initializing)
{
  yield return null;
}

Get location information

You can get location information with AR Earth Manger as above.



var pose = earthTrackingState == TrackingState.Tracking 
EarthManager.CameraGeospatialPose : new GeospatialPose();

InfoText.text = string.Format(
                "Latitude/Longitude: {1}°, {2}°{0}" +
                "Horizontal Accuracy: {3}m{0}" +
                "Altitude: {4}m{0}" +
                "Vertical Accuracy: {5}m{0}" +
                "Eun Rotation: {6}{0}" +
                "Orientation Yaw Accuracy: {7}°",
                Environment.NewLine,
                pose.Latitude.ToString("F6"),
                pose.Longitude.ToString("F6"),
                pose.HorizontalAccuracy.ToString("F6"),
                pose.Altitude.ToString("F2"),
                pose.VerticalAccuracy.ToString("F2"),
                pose.EunRotation.ToString("F1"),
                pose.OrientationYawAccuracy.ToString("F1"));

Set AR Contents

AR contents can be put by specifying the latitude, longtude, and altitude.



anchor = anchorManager.AddAnchor(latitude, longitude, altitude, rotation);
instance = Instantiate(prefab, anchor.transform);

Execution of the Geospatial API

This video shows the sample game that used Geospatial API.

Next step

As next step, I will research ChatGPT API for the automated creation of character dialog.

AR Game ~ Location Information ~

Akira Game — Sun, 09 Jun 2024 11:25:57 +0000

Table of contents

Background
Creation of AR game with location information
Execution of the game

Background

Creation of AR game with location information

In our game, users' location information will be utilized for showing user on real map. When players move in real move, their characters on the map move. This post will show how to develop the AR game with location information.

Technology

These below technologies will be used in this game.

Google Maps API
CUDLR

Google Maps API

At this time, Google Maps API will be utilized to show users' character on the map. In google map apps, the map is showed by using still image tile.
In addition to this map information, the Google Maps API can dynamically change the way it is displayed, so you can view the map from the view point of a TPS user. The map display can also be changed to make it look more like a game.

API Key

It is necessary to get API keys to use Google Maps API.

You can get it referencing the below URL.

https://developers.google.com/maps/documentation/maps-static/get-api-key

Sample Request

If you get API Key, you can get static image tile by requesting Map Static API like the below URL.

https://maps.googleapis.com/maps/api/staticmap?center=Berkeley,CA&zoom=14&size=400x400&key={Your API Key}

{Your API key} can be changed to your API key.

Request from Unity

Also, you can request from Unity project. If you request, you can see the map tile like below image.

CUDLR

CUDLR is one of the debug tool. Log can be seen on web while the game is running on your devices.

Important Points

CUDLR is for debug or test, so do not use for production.
Please make sure to delete CUDLR objects before release.

Get users' location

This game requires synchronisation of the user's actual position with the player position in the game. For this purpose, the actual position of the user needs to be acquired.

Permission for getting user location

This game requires user permission for location data to be acquired, which can be set on PlayerSettings.

Code sample

You can get user location information on Unity.

// check if the program has the user permission
if (!Input.location.isEnabledByUser)
{
  Debug.Log("Location services are not available");
  yield break;
}

// start location service
Input.location.Start();

// wait for the Initializing services 
int maxWait = 20;
while (Input.location.status == LocationServiceStatus.Initializing && maxWait > 0)
{
   yield return new WaitForSeconds(1);
   maxWait--;
}


// get location information 
Debug.Log(
   "Location: " + Input.location.lastData.latitude + " " + Input.location.lastData.longitude
);


// stop location service
Input.location.Stop();

Get users rotation

For a better user experience, the orientation of the player is also changed depending on the orientation of the device.

Code sample

// enable compass 
Input.compass.enabled = true;

// change the rotation of the player depending on the rotation of the device
var heading = 180 + Input.compass.magneticHeading;
var rotation = Quaternion.AngleAxis(heading, Vector3.up);
transform.rotation = Quaternion.Slerp(transform.rotation, rotation, Time.fixedTime * .001f);

Execution of the game

Merging these above implementation, players can see the map around the actual user position. Also, they can see around while changing the rotation of devices.

Next Step

As next step, I will research Geospatial API for the development using outdoor buildings.

AR Game ~ Applied AR to practice ~

Akira Game — Sun, 09 Jun 2024 11:17:36 +0000

Table of contents

Background
Creation of applied AR
Execution of the game
Next Step

Background

Creation of applied AR

This post will show the implement of AR game, which is named memorial world. I referenced the below course to learn how to create the AR game.

https://www.udemy.com/course/build-augmented-reality-ar-apps-with-arfoundation-unity/

If you want to create the similar game, you should check it out.

Game Mechanics

In this game, your memories are displayed in an AR space. You can see photos that remind you of your memories in the AR space, and seeing them in places that remind you of your memories will bring back even more memories.

Technology

In this game, while players can see pictures when they enter the AR entrance, player can not see them when they are out of the AR entrance. Therefore, it is necessary to change how to draw objects depending on the player's position. To change it, these below functions will be used in this game.

Shader
Stencil Buffer
Stencil Test
Culling

Shader

This is the program that writes the way to draw. This allows objects to show on scenes. It can shows various expressions on objects such as shade.

Stencil Buffer

Shader and Stencil are similar and determine how objects are displayed. Stencil makes it possible to change the visibility of objects from certain areas and show pictures only at the entrance of the AR, which is what we want to do this time.

Stencil Test

Each pixel on the screen has a Stencil buffer value and the object has a Reference value. The stencil test uses these values to determine whether the object is allowed to be drawn.

Culling

The process that prevents Unity from performing rendering calculations for GameObjects that are completely obscured (occluded) by other GameObjects. In this game, it is used for being able to see real world from the inside of AR room.

https://docs.unity3d.com/Manual/SL-Cull.html

Execution of the game

At this time, I displayed free images related anime OnePiece in the AR space for the purpose of introduction. You can actually your memory images. Also, I deployed it to my iOS device and confirmed to display AR objects. Please watch the video below.

If you have any questions about Unity and AR, I'm happy to answer them.

Next step

I will research APIs related AR and location information to use them for my game.

AR Game ~ Initial AR to practice ~

Akira Game — Tue, 04 Jun 2024 10:07:11 +0000

Table of contents

Background
Creation an AR object on Unity for the first time
Execution AR
Next Step

Background

Creation an AR object on Unity for the first time

In this post, I will implement the AR experiment that player put an AR red cube on Unity and show the process.

Precondition

Unity is installed
AR foundation package is installed

How to implement an AR object

Create Scene
Delete "Main Camera"
Add "AR Session" ( XR -> AR Session )
Add "XR Origin (AR)" (XR -> XR Origin (AR))

It has "Main Camera", which synchronize the position and direction of user's device in real world.
Put cube under the XR Origin objects

Execution AR

This part will show how to execute the game on iOS and Android.

Execution the game on iOS

Click Build Setting
Select iOS on Platform
Click Switch Platform
Add the package Apple ARKit XR Plugin from package manager
Check Apple ARKit from XR Plug-in Management of Project Settings
Build

Execution the game on Android

Click Build Setting
Select Android on Platform
Click Switch Platform
Add the package Google ARCore XR Plugin from package manager
Check Google ARCore from XR Plug-in Management of Project Settings
Build

Finished Product

Next Step

As next step, I will develop the applied AR game using these above products.

AR Game ~Research of AR Foundation~

Akira Game — Fri, 31 May 2024 13:25:06 +0000

Table of contents

Background
What is AR foundation
Supported device versions
Installation of AR foundation
Functions of AR foundation
Next Step

Background

What is AR foundation

There are many platforms for developing AR. In 2017, Apple released ARKit, which allows AR development on iOS devices.

Ref: https://testgrid.io/blog/automation-testing-an-arkit-application/

In the same year, Google released ARCore, which allows AR development on Android devices.

Ref: https://developers.googleblog.com/en/announcing-arcore-10-and-new-updates-to-google-lens/

Each platform relies on the device's OS. Therefore, if you wanted to develop an AR application for both iOS and Android devices, you would need to use both platforms (ARKit and ARCore).

To solve this problem, we can use AR Foundation. It was released by Unity in 2013. By using it, developers can create AR in a single project.

Supported device versions

A complete list of ARCore supported android smartphone can be found on the link.

https://developers.google.com/ar/devices

A complete list of ARKit supported android smartphone can be found on the link.

https://www.apple.com/in/augmented-reality/

Installation of AR foundation

You can install AR foundation referencing the below link.

https://docs.unity3d.com/Packages/com.unity.xr.arfoundation@5.0/manual/project-setup/install-arfoundation.html

https://developers.google.com/ar/develop/unity-arf/getting-started-ar-foundation

In May of 2024, AR Foundation 5.0 is compatible with Unity 2021.2 and up.

How to install AR foundation Unity package.

How to install AR foundation from package manager on Unity.

Open Unity project
Window > Package Manager
Select Unity Registry
Search "AR Foundation"
Click Install

Or
When you create a Unity project, you can choose the AR Mobile project template on Unity Hub, which sets up the necessary AR packages. You do not need to import AR foundation package individually.

Functions of AR foundation

The below list is the function of AR foundation.

Basic

Device Tracking
- Track the device's position and rotation in physical space
Manage Session
- Enable, disable, and configure AR on the target platform
Camera
- Render images from device cameras and perform light estimation
Occlusion
- Occlude AR content with physical objects

Detection and Tracking

Plane detection
- Detect and track surfaces
Point clouds
- Detect and track feature points
Anchors
- Track arbitrary points in space
Image
- Detect and track 2D images
Object
- Detect and track 3D objects
Face
- Detect and track human faces
Body
- Detect and track a human body
Participants
- Track other devices in a shared AR session.

Others

Raycasts
- Cast rays against tracked items
Meshing
- Generate meshes of the environment
Environment probes
- Generate cubemaps of the environment

Next Step

I was going to display a sample AR object in Unity, but it will take a little more time. Therefore, I will show how to implement AR objects in Unity in the next post.

AR Game ~ What is Augmented Reality (AR) ~

Akira Game — Fri, 31 May 2024 10:49:07 +0000

Table of contents

Background
What is Augmented Reality
Types of Augmented Reality
Next Step

Background

What is Augmented Reality

The term "augment" means to add something. Augmented Reality (AR) is a technology that enhances the real world by overlaying digital information throungh devices such as smartphones and AR glasses. A well-known application of AR in gaming is Pokemon GO. In Pokemon GO, players use their smartphone cameras to display Pokemon in the real world. When displaying AR on a smartphone, various functionalities such as the camera, GPS, accelerometer, and compass are utiliized to create the augmented experience.

Types of Augmented Reality

AR primarily has two types. One of them is Marker-based AR. Another type is Markerless AR.

Marker-based AR

This type displays 3D objects on a marker by reading the marker, such as a QR code or an image.

Example

Markerless AR

This type can display 3D objects without markers. Instead, it uses the sensors or camera of smartphones, relying on these functions.
It is used in Pokemon GO.

This type is further divided into three subtypes, which are location based AR, projection based, and superimpostion AR.

Location based

Due to the availability of smartphone feature that provide location detection, it shows AR to a specific place by getting data from a device’s camera, GPS, digital compass, and accelerometer.

Example

Projection based

This type uses a small projecter.It focuses on rendering virtual objects within or on a user’s physical space. Since virtual objects are projected on user's physical space directly, the change of the environment reclects the virtual objects.

Example

Superimpostion (Object Tracking)

This type is also called object tracking AR. It literally tracks objects. It can replace an original view of an object with a scaled version of the same object.

Example

Next step

This post showed what is AR and the types of AR. I will use some of them to create AR Game.
Next post will show the research of AR foundation.

Future my game development

Akira Game — Wed, 29 May 2024 11:23:30 +0000

Current

I'm post graduate student in the UK and study game development.
I'm going to create below games in the future.

Kick The Can
The Sunlight
AR Game

Kick The Can

This game is inspired by the traditional game of kick-the-can that everyone played during their childhood. I will start by developing a simple 2D version of the game and work towards its release.

The Sunlight

This game is inspired by the idea of everyone in the UK seeking sunlight. I will also start by developing a simple 2D version of the game and work towards its release.

AR Game

This game is planned to be developed using AR. It will be designed for use in the tourism industry. Details will be updated regularly in this blog.

To be continued...