GENX320 in event mode

OpenMV Boards
1

Hi,
I’m using a GENX320 event camera sensor and a RT1062 board. I modified the firmware to fetch the event raw data by setting "OMV_GENX320_EHC_ENABLE " to be “0”. I want to get the (x,y,t) values for each event from the IDE, but I don’t know how to modify the code.
Many thanks,
Dec

2

Hi, the camera driver post-processes the event data in this case. It’s already going through x/y to create an image, but, the t is thrown away.

Given a lot of folks have been asking about this… I’ll just add a feature in the firmware so you can use this mode. It’s really not a great mode. But, folks seem to want it so I’ll see what I can do to support it.

…

EDIT: I’ll think about this, but, it’s probably a no. The camera can generate about 2M+ events per second. If you try to process this in python your FPS will be like sub 1 frame a second given all the mallocing and etc. you have to do to get frames.

Maybe I can return an ndarray instead of an image object of the pixels and their times. But, this is still a large number of mallocs per second for the event buffer.

3

Thanks for the reply. I’m wondering if it is possible to only record (x,y,t) in a txt file or a raw format without showing the image in the IDE. Then, I can do post processing on my PC after recording or real-time image reconstruction using my PC’s CPU.
I think if the threshold is setting properly, only a few pixels will generate events, so the event number may not be quite large.

4

Hi, I’m going to get a meeting setup with Prophesee to see how to make this feature work. I’m the meantime, please use historgram mode and just set the frame rate. The integration time per pixel is then 1/framerate.

5

Many thanks. Hoping to see the code update.

6

I would also like to know how to get the event data (x, y, t, polarity) of the GENX320 event camera on openmv, and I am very much looking forward to OpenMV supporting the output of event data

7

I’m focused on an IDE release right now for this weekend.

Prophesee has been alerted to the request and they are thinking of the best API. Once I get feedback I will try to work on this one upcoming weekend.

8

Hi,

I’m wondering if there is any progress on this. Many thanks.

9

Hi, we’ve come to a spec agreement with Prophesee, I will start work on it later next month.