Items with no label
3335 Discussions

Using custom cameras with D4 processor board

MPrat3
Beginner
1,597 Views

Because we have a unique operating environment for our depth cameras, we are considering using a D4 processor board and integrating two custom MIPI cameras. While this seems theoretically possible and the documentation (https://www.intel.com/content/dam/support/us/en/documents/emerging-technologies/intel-realsense-technology/Intel-RealSense-D400-Series-Datasheet.pdf https://www.intel.com/content/dam/support/us/en/documents/emerging-technologies/intel-realsense-technology/Intel-RealSen… ) gives details about the physical specifications and the pinouts, there is no detail on the D4 firmware side of the integration. Do we have to write our own firmware? Can we use the firmware that is already on the D4 camera (if so, where can we find more documentation about what kinds of cameras we need to source)? I know the firmware is not open-sourced and Intel does not plan to open-source it, but some details about it that are required for integration would be great to have so we can more effectively do our own integration.

I see through the forums that there is a way to sign an NDA with Intel so they can share some of this information with us - what is the process for doing so?

0 Kudos
1 Solution
idata
Employee
297 Views

Hello mprat,

 

 

The RealSense firmware for the D4 processor is Intel IP and details are not shared with anyone, even under NDA. If you want to use the D4 processor with your own custom cameras then you will have to write your own firmware.

 

 

Regards,

 

Alexandra

View solution in original post

0 Kudos
3 Replies
MartyG
Honored Contributor III
297 Views

The 400 Series was originally going to permit custom RGB sensors or tracking modules on the D4 board, connected via the 50-pin 'Tracking Module' connector on the board. Intel decided eventually not to support customizations on this connector though.

I believe the starting process for arranging an NDA is to open a support ticket at support.intel.com

With most hardware that has a storage space for firmware, you could likely write your own custom firmware. The D4 has 16 mb of serial flash for firmware storage. The problem would be knowing where to even begin without open-source firmware code as a reference.

0 Kudos
MartyG
Honored Contributor III
297 Views

Prior to March 2018, the D4's tracking module connector and MIPI details were documented in the 400 Series data sheet. Although custom sensors are not supported in the current official firmware, it will give you a lot of details about how this aspect of the D4 is designed.

In case there was future interest in this connector, like your inquiry today, earlier in the year I created a PDF extract of the tracking module section of the data sheet to save it for future reference.

The MIPI details can be found on page 90 onwards of the January 2018 edition of the data sheet.

https://www.rutronik.com/fileadmin/Micropages/Intel/Intel_RealSense_D400_Series_Datasheet.pdf https://www.rutronik.com/fileadmin/Micropages/Intel/Intel_RealSense_D400_Series_Datasheet.pdf

Up until the point where tracking module connector support was discontinued, it was stated that once a custom sensor was connected (probably via via a custom-built flexible cable so the pins on the other end of the cable match up to the custom sensor's pin-out) then the camera should be re-calibrated. The custom sensor should have functioned after that.

0 Kudos
idata
Employee
298 Views

Hello mprat,

 

 

The RealSense firmware for the D4 processor is Intel IP and details are not shared with anyone, even under NDA. If you want to use the D4 processor with your own custom cameras then you will have to write your own firmware.

 

 

Regards,

 

Alexandra
0 Kudos
Reply