Skip to content

LoganLxb/HoloLensWithOpenCVForUnityExample

 
 

Repository files navigation

HoloLens With OpenCVForUnity Example

What's new

  • Changed the HoloLensCameraStream plugin to the camnewnham's repository. (Improve camera update FPS, hide recording icon, extract camera intrinsic)

Demo Video (old version)

Demo Hololens App

Environment

Setup

  1. Download the latest release unitypackage. HoloLensWithOpenCVForUnityExample.unitypackage
  2. Create a new project. (HoloLensWithOpenCVForUnityExample)
  3. Import the OpenCVForUnity.
    • Setup the OpenCVForUnity. (Tools > OpenCV for Unity > Set Plugin Import Settings)
    • Move the "OpenCVForUnity/StreamingAssets/haarcascade_frontalface_alt.xml" and "OpenCVForUnity/StreamingAssets/lbpcascade_frontalface.xml" to the "Assets/StreamingAssets/" folder.
  4. Clone HoloLensCameraStream repository.
    • Copy the "HoloLensCameraStream/HoloLensVideoCaptureExample/Assets/CamStream/" folder to the "Assets/" folder.
    • Set the scripting backend of the plugin inspector to "Any Script Backend". (IL2CPP support)
  5. Import the Microsoft.MixedReality.Toolkit.Unity.Foundation.2.2.0.unitypackage.
    • Setup the MRTKv2. (Mixed Reality ToolKit > Utilities > Configure Unity Project)
  6. Import the HoloLensWithOpenCVForUnityExample.unitypackage.
  7. Add the "Assets/HoloLensWithOpenCVForUnityExample/*.unity" files to the "Scenes In Build" list in the "Build Settings" window.
  8. Setup a performance environment suitable for Holorens. (See https://docs.microsoft.com/en-us/windows/mixed-reality/develop/unity/recommended-settings-for-unity)
  9. Build and Deploy to HoloLens. (See https://developer.microsoft.com/en-us/windows/holographic/holograms_100)
    • (Print the AR marker "CanonicalMarker-d10-i1-sp500-bb1.pdf" and "ChArUcoBoard-mx5-my7-d10-os1000-bb1.pdf" on an A4 size paper)
Project Assets MRTK Project Configurator
ProjectAssets.jpg MRTKProjectConfigurator.jpg
Build Settings Player Settings
BuildSettings.jpg PlayerSettings.jpg

ScreenShot (old version)

screenshot01.jpg

screenshot02.jpg

screenshot03.jpg

screenshot04.jpg

screenshot05.jpg

About

HoloLens With OpenCVforUnity Example

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C# 96.3%
  • ShaderLab 3.7%