Items with no label
3335 Discussions

3D Scan live stream

TDiaz
Beginner
1,511 Views

Hi,

I am currently on a project where we have a server which starts the scan process but we need to stream back the preview images being generated. I'm a bit lost on how to encode the video and send it back to the client. I know it's possible to get preview images (Intel.RealSense.Image objects) but I'm not sure how to proceed from there.

The communication between client-server is currently via HTTP and is to be displayed on an html page. I was thinking on using DASH but then I guess I should encode the Image objects and send them somehow?

I'm a bit lost with this (I've never worked with video encoding/streaming). Any help would be appreciated !

Tomás

0 Kudos
6 Replies
MartyG
Honored Contributor III
243 Views

Have you seen this page of the documentation, which provides scripts for each aspect of raw stream processing?

SDK R2 documentation

https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_essential_raw_stream_capture_and_process.html Intel® RealSense™ SDK 2016 R2 Documentation

SDK R3 documentation

https://software.intel.com/en-us/node/724623 Raw Stream Capturing and Processing | Intel® Software

0 Kudos
TDiaz
Beginner
243 Views

Is this the same/does it work when working with the 3D module? I'm looking for something similar to the 3DScan sample, but in there they don't use raw stream, they get the image directly from the Scan object... Is there a big difference on the result obtained?

/* Get preview image from the 3D Scan video module */

Image preview_image = scan.PreviewImage;

And from there you can get the byte array.

I think I'm actually a bit confused with what comes after... Sending this byte array to be displayed somewhere else (I'm not sure on the methodology of streaming.. I'm guessing you send frame by frame and that's all)

Thank you

0 Kudos
idata
Employee
243 Views

Hello Tomás,

 

 

I'll be needing more time to investigate if the Raw Stream Capturing and Processing can be used with the 3D module.

 

 

As soon as I have relevant information I'll contact you through this post.

 

 

Thank you for your patience.

 

 

Regards,

 

Andres V.
0 Kudos
jb455
Valued Contributor II
243 Views

Once you have the preview image RGB data (the image from the 3DScan preview is the same basic structure as the images you get from raw streams), your problem is the same as any other live video streaming solution. You'll probably have better luck looking/asking elsewhere for the actual network streaming part (ie, everything after you have the RGB array) of it as it isn't RealSense specific.

0 Kudos
idata
Employee
243 Views

Hello Tomás,

 

 

As jb455 kindly mentioned, the data you want to stream shouldn't be treated any different than any other data.

 

 

That makes the issue more oriented to client-server multimedia streaming, something that is out of the scope of this technical support team.

 

 

I'm not familiar with the client-server multimedia streaming subject, but you may want to check this link:

 

 

https://developer.mozilla.org/en-US/docs/Web/HTML/DASH_Adaptive_Streaming_for_HTML_5_Video

 

 

If you have any other question related to RealSense Technology, don't hesitate to contact us.

 

 

Have a nice day.

 

 

Regards,

 

Andres V.
0 Kudos
TDiaz
Beginner
243 Views

Ooohh okay, thank you both! I was really wondering if there was anything particular to it or I could just treat it directly.

Thanks

0 Kudos
Reply