# MultiStreamHandler can't handle cvb.ImageStreams from Multispectral Camera **URL:** \ **Category:** Python API\ **Created:** [June 22, 2022, 10:26am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719 "2022-06-22T10:26:26Z")\ **Posts on this page:** 14\ **Page:** 1
**Author:** ![JRo85](https://avatars.discourse-cdn.com/v4/letter/j/7993a0/32.png) [@JRo85](https://forum.commonvisionblox.com/u/JRo85)\ **Post date:** [June 22, 2022, 10:26am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/1 "2022-06-22T10:26:26Z")
Hi, I’m trying to follow the QmlStreamDisplay Example ([https://help.commonvisionblox.com/NextGen/14.0/cvbpy/da/d26/cvb\_2\_qml\_stream\_display-example.html](https://help.commonvisionblox.com/NextGen/14.0/cvbpy/da/d26/cvb_2_qml_stream_display-example.html)) to get a stream from an Multispectral Camera (jai Fusion with 3 Sensors), which works as long as I just capture one single stream(cvb.Stream). However, it is not possible to capture all the streams of the camera in parrallel, so I followed the way described here [https://help.commonvisionblox.com/NextGen/14.0/md\_theory\_of\_operation\_image\_manager\_\_migration\_guide\_\_acquisition\_stack.html#cpp-multiple-streams](https://help.commonvisionblox.com/NextGen/14.0/md_theory_of_operation_image_manager __migration_guide__ acquisition_stack.html#cpp-multiple-streams) for Multistream using the GenTL acquisition stack, which demands opening the device streams as ImageStream object. ```auto discover = cvb.DeviceFactory.discover_from_root(flags=cvb.DiscoverFlags.IgnoreVins) device_info = discover[0] self.dev = cvb.DeviceFactory.open(device_info.access_token, cvb.AcquisitionStack.GenTL) self.dev_node_map = self.dev.node_maps["Device"] self.stream = [[],[],[]] self.img = [[], [], []] for n_stream in range(self.dev.stream_count): self.stream[n_stream] = self.dev.stream(cvb.ImageStream, n_stream) handler = cvb.MultiStreamHandler(self.stream) ``` Unfortunatly, the MultiStreamHandler seems not to be able to handle ImageStream and throws an error: ```auto ValueError: type miss match - cannot convert object to cvb.Stream ``` Is it possible to make the ImageStream work with the Single/MultiStreamHandler or do I need another approach to display a real time image from the multispectral camera on the screen? Using the .wait()-method on the ImageStream objects works and I can get all the Streams from the camera but the display (using PySide2, Qlabel and Qtimer for repetitively calling the wait()-method) seems rather slow and delayed and yields erros in the images, at least in my implementation. Help would be very much appreciated. Thank you very much! I’m using: cvb: ‘v13.04.005’ Windows 10 Python 3.8.3 and a jai Fusion Camera with 3 CMOS Sensors ---
**Author:** ![c.hartmann](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/c.hartmann/32/247_2.png) [@c.hartmann](https://forum.commonvisionblox.com/u/c.hartmann)\ **Post date:** [June 22, 2022, 12:44pm UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/2 "2022-06-22T12:44:14Z")
Ahoi, can you show an image of the errors? (I am suspecting missing lines in the images). This might be related to “normal” transmission parameters. Cheers. ---
**Author:** ![c.hartmann](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/c.hartmann/32/247_2.png) [@c.hartmann](https://forum.commonvisionblox.com/u/c.hartmann)\ **Post date:** [June 22, 2022, 12:44pm UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/3 "2022-06-22T12:44:39Z")
@JRo85 forgot to tag you. ---
**Author:** ![JRo85](https://avatars.discourse-cdn.com/v4/letter/j/7993a0/32.png) [@JRo85](https://forum.commonvisionblox.com/u/JRo85)\ **Post date:** [June 24, 2022, 9:05am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/4 "2022-06-24T09:05:19Z")
![image](https://canada1.discourse-cdn.com/flex027/uploads/commonvisionblox/original/2X/f/fe4a90bd2cc674505551c7e7650f6945344d295a.png) Hi, yes! It’s just the common missing lines but annyoing anyway and doesn’t seem to appear in the QMLStream example. Do you have tips to make the lines disappear and how to display the frames in real time with small delay and in a frequency \>20 Hz on the screen using Python? As said, the QMLStreamDisplay seems like a good start if it would work for the cvb.ImageStream objects from the jai Camera. ---
**Author:** ![c.hartmann](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/c.hartmann/32/247_2.png) [@c.hartmann](https://forum.commonvisionblox.com/u/c.hartmann)\ **Post date:** [June 24, 2022, 10:24am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/5 "2022-06-24T10:24:53Z")
I’m not 100% convinced that it’s just packet loss. But this should be fixed first. 1. Test with “Genicambrowser”. 2. Follow these instructions: [https://help.commonvisionblox.com/NextGen/14.0/md\_theory\_of\_operation\_hardware\_\_gen\_i\_cam\_\_c\_v\_b\_\_user\_guide.html](https://help.commonvisionblox.com/NextGen/14.0/md_theory_of_operation_hardware __gen_i_cam__ c_v_b__user_guide.html) Do you see these stripes with Genicambrowser? (And a minimal qml gui with python can be found in: %CVB%\Tutorial\ImageManager\CvbPy\QmlStreamDisplay/) Hope this helps. ---
**Author:** ![JRo85](https://avatars.discourse-cdn.com/v4/letter/j/7993a0/32.png) [@JRo85](https://forum.commonvisionblox.com/u/JRo85)\ **Post date:** [June 24, 2022, 11:41am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/6 "2022-06-24T11:41:20Z")
Hi c.hartmann, thanks for your help! The stripes only appear right after starting the stream and disappear after one to a couple of frames. It seems that following the setup of the network card and the camera have improved the issue with the stripes. Thanks a lot! In the GeniCamBrowser I’ve not recognized the stripes. The logging however states once “Corrupt frames were delivered due to lost packets. Packet resend is already activated. Please optimize network card settings (e.g. receive descriptors)” right after clicking “grab all”. My initial question was mostly related to the QmlStreamDisplay - Example because I cannot use the cvb.ImageStream objects with the Single/Multistreamhandler used for displaying the stream. The example works fine for me without any visible stripes using the GenICam.vin, but here I can only see one stream and not 3. Cheers ---
**Author:** ![c.hartmann](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/c.hartmann/32/247_2.png) [@c.hartmann](https://forum.commonvisionblox.com/u/c.hartmann)\ **Post date:** [June 24, 2022, 11:46am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/7 "2022-06-24T11:46:08Z")
@JRo85 forgot to tag again -.- And if you want to change the the packetSize via python (you only need this if you use discover): cvb.DiscoveryInformation.set\_parameter(“PacketSize”, “8960”) With PacketSize it is best to use of 8960 or 8192 (depends on camera, but usually PacketSize % X == 0, where X might be 16, 256, 512). Higher is better. ---
**Author:** ![c.hartmann](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/c.hartmann/32/247_2.png) [@c.hartmann](https://forum.commonvisionblox.com/u/c.hartmann)\ **Post date:** [June 24, 2022, 11:48am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/8 "2022-06-24T11:48:22Z")
@JRo85 Oh in that case, you have to modify the example to have multiple displays. We don’t have a codesnippet or example showcasing (with UI) multiple image/stream/devices as far as i recall. ---
**Author:** ![JRo85](https://avatars.discourse-cdn.com/v4/letter/j/7993a0/32.png) [@JRo85](https://forum.commonvisionblox.com/u/JRo85)\ **Post date:** [June 24, 2022, 12:36pm UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/9 "2022-06-24T12:36:31Z")
This was exactly my question from the beginning how to do this because the cvb-class that is used in the example (Single- and Multistreamhandler) doesn’t work with the GenTL Acquistionstack required for acquisition of multiple streams from one camera. Do I have to write my own handler-function or is there some other workaround? ---
**Author:** ![c.hartmann](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/c.hartmann/32/247_2.png) [@c.hartmann](https://forum.commonvisionblox.com/u/c.hartmann)\ **Post date:** [June 24, 2022, 1:24pm UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/10 "2022-06-24T13:24:42Z")
> [@JRo85](#): > > Do I have to write my own handler-function Pretty much yes. I would just rewrite the handler to work with the new stack. > [@JRo85](#): > > is there some other workaround Sadly the stack works quite differently (especially in regards of pulling the data out of the buffer). Hmmm … maybe there is a way … does the camera offer a mode, where the data is transmitted via a sindle stream (but not Multipart data)? Then you could just work with the old “Vin” stack. ---
**Author:** ![JRo85](https://avatars.discourse-cdn.com/v4/letter/j/7993a0/32.png) [@JRo85](https://forum.commonvisionblox.com/u/JRo85)\ **Post date:** [June 27, 2022, 3:26pm UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/11 "2022-06-27T15:26:26Z")
> Pretty much yes. I would just rewrite the handler to work with the new stack. Ok. I guess that will take a while… Can you give me a hint on how to rewrite the handler to work with the new stack. Looking at the implementation of the MultiStreamHandler in the **init**.pyi wasn’t very helpful for my current level of understanding. > does the camera offer a mode, where the data is transmitted via a sindle stream (but not Multipart data) I think it doesn’t. It’s a jai FS-3200T-10GE-NNC and I didn’t find anything in the manual about this. ---
**Author:** ![Arnaud](https://avatars.discourse-cdn.com/v4/letter/a/e8c25b/32.png) [@Arnaud](https://forum.commonvisionblox.com/u/Arnaud)\ **Post date:** [October 24, 2022, 8:39am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/12 "2022-10-24T08:39:29Z")
Hi JRo85, What a coincidence, I’m trying to read the same multispectral camera (jai FS-3200T) with python. I already manage to read the RGB image, but now I would like to read out the NIR image from the second or third sensor? Do you have any tips or tricks for this? Thank you very much. ---
**Author:** ![s-woe](https://yyz1.discourse-cdn.com/flex027/user_avatar/forum.commonvisionblox.com/s-woe/32/572_2.png) [@s-woe](https://forum.commonvisionblox.com/u/s-woe)\ **Post date:** [October 24, 2022, 9:09am UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/13 "2022-10-24T09:09:37Z")
Hi @Arnaud , in our latest releases you are provided with a sample program in python: If you are on CVB 13.04.005 or higher: > **Linux** > > - Go to $CVB/tutorial/ImageManager/CvbPy/StreamingSimple/ > - An example is shown in multi\_stream.py > **Windows** > > - Go to %CVB%Tutorial\Image Manager\CVBpy\StreamingSimple > - An example is shown in multi\_stream.py If you cannot find any example, here’s one simple: ```auto # CVBpy Example Script for multistream # # 1. Open the device with 3rd generation acq stack. # 2. Get multiple streams # 3. Acquire images with separate engine and device start / abort # # Requires: A connected and configured GenICam device which has multiple streams import cvb devices = cvb.DeviceFactory.discover_from_root(cvb.DiscoverFlags.IgnoreVins) with cvb.DeviceFactory.open(devices[0].access_token, cvb.AcquisitionStack.GenTL) as device: streams = [device.stream(cvb.ImageStream, i) for i in range(device.stream_count)] for stream in streams: stream.engine_start() for stream in streams: stream.device_start() for i in range(10): images = [stream.wait() for stream in streams] try: pass finally: for image, status, nodes in images: with image: print("Acquired image: " + str(i) + " | Timestamp: " + str(image.raw_timestamp)) for stream in streams: stream.device_abort() for stream in streams: stream.engine_abort() ``` Feel free to look at [this guide](https://help.commonvisionblox.com/NextGen/14.1/md __c___ j_workspace __next_gen_docume___ fa12bcb2_theory_of_operation_image_manager __migration_guide__ acquisition_stack.html#py-multiple-streams), for further information. ---
**Author:** ![Arnaud](https://avatars.discourse-cdn.com/v4/letter/a/e8c25b/32.png) [@Arnaud](https://forum.commonvisionblox.com/u/Arnaud)\ **Post date:** [October 24, 2022, 1:55pm UTC](https://forum.commonvisionblox.com/t/multistreamhandler-cant-handle-cvb-imagestreams-from-multispectral-camera/1719/14 "2022-10-24T13:55:35Z")
Hi @s-woe It works. Thank you very much for helping! Kind regards.