Items with no label
3335 Discussions

Unity wrapper limited support for RS SDK 2.0 (DSO-8666)

Ji_Y_Intel
Employee
2,628 Views

Hi team,

One of my major gaming developer and SI customer is working on gesture tracking system I/O.

The customer using language as below.

- Known Issue: The white paper of RS SDK 2.0 says "Support till Unity 5.0" however this one is going to EOL and Unity have a new version from 2017 onward.

- Issue: There is limitation for developing in code with Unity 5.0 as this is not a new version.

- Help needed (Solution options):

a. Need RS SDK 2.0 version which works well with Unity 2017.4.4F1 above.

b. Any dll. file for supporting this issue is needed

c. Any other way can you propose to develop without the issue

Best, Roy

0 Kudos
1 Solution
MartyG
Honored Contributor III
629 Views

The sample programs from the old RealSense Unity Toolkit, such as the object tracking one you quoted, will unfortunately not work in SDK 2.0, as that new SDK and the old SDKs have completely different architectures that have no compatibility with each other.

To use those programs, your customer would need to use an older RealSense SDK program called '2016 R2'. If they have not got it already, a 1.8 GB direct download link for it can be launched in the browser with the link below:

http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe

If your customer wishes to use the latest SDK 2.0 with the latest camera models such as RealSense D415 or D435 then Unity is supported in that too and it should work with Unity 2017 and 2018. It currently has limited functionality though compared to the older SDK's Unity support (it can stream a texture into Unity or generate a point-cloud type depth scan). D415 and D435 will not work with the previous SDKs, so using them with those older sample programs is not an option.

Unity support in SDK 2.0 is provided via a Unity 'wrapper'.

https://github.com/IntelRealSense/librealsense/tree/master/wrappers/unity librealsense/wrappers/unity at master · IntelRealSense/librealsense · GitHub

Since SDK 2.0 Unity does not have built-in gesture support, the best way your customer may be able to do it is to integrate the OpenCV camera software into their application. There is a pre-made system for doing so that can be purchased in Unity's online Asset Store.

https://assetstore.unity.com/packages/tools/integration/opencv-plus-unity-85928 OpenCV plus Unity - Asset Store

RealSense SDK 2.0 fully supports OpenCV outside of Unity. I would speculate (though do not have certain knowledge) that the SDK's functions may be able to be accessed in Unity through C# code, since Unity for SDK 2.0 works through the SDK's C# wrapper. I do not know the programming protocols for doing so though.

View solution in original post

4 Replies
Ji_Y_Intel
Employee
629 Views

Error image is attached for your perusal.

0 Kudos
MartyG
Honored Contributor III
630 Views

The sample programs from the old RealSense Unity Toolkit, such as the object tracking one you quoted, will unfortunately not work in SDK 2.0, as that new SDK and the old SDKs have completely different architectures that have no compatibility with each other.

To use those programs, your customer would need to use an older RealSense SDK program called '2016 R2'. If they have not got it already, a 1.8 GB direct download link for it can be launched in the browser with the link below:

http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe

If your customer wishes to use the latest SDK 2.0 with the latest camera models such as RealSense D415 or D435 then Unity is supported in that too and it should work with Unity 2017 and 2018. It currently has limited functionality though compared to the older SDK's Unity support (it can stream a texture into Unity or generate a point-cloud type depth scan). D415 and D435 will not work with the previous SDKs, so using them with those older sample programs is not an option.

Unity support in SDK 2.0 is provided via a Unity 'wrapper'.

https://github.com/IntelRealSense/librealsense/tree/master/wrappers/unity librealsense/wrappers/unity at master · IntelRealSense/librealsense · GitHub

Since SDK 2.0 Unity does not have built-in gesture support, the best way your customer may be able to do it is to integrate the OpenCV camera software into their application. There is a pre-made system for doing so that can be purchased in Unity's online Asset Store.

https://assetstore.unity.com/packages/tools/integration/opencv-plus-unity-85928 OpenCV plus Unity - Asset Store

RealSense SDK 2.0 fully supports OpenCV outside of Unity. I would speculate (though do not have certain knowledge) that the SDK's functions may be able to be accessed in Unity through C# code, since Unity for SDK 2.0 works through the SDK's C# wrapper. I do not know the programming protocols for doing so though.

Ji_Y_Intel
Employee
629 Views

Thanks for you guidance and I will work further and will give a feedback if have more. Best, Roy@

0 Kudos
MartyG
Honored Contributor III
629 Views

You are very welcome. Please feel free to return here any time you need to. Good luck!

0 Kudos
Reply