I would like to read two separate windows simultaneously at maximum FPS. For example, I’d like to read the box (0,0,640,480) and (500,500,640,480) into two separate VGA frames. Currently, the ioctl method only supports reading one window into one frame. Would it be possible for me to edit the firmware to achieve this functionality?
Nope, you could modulate this back and forth but the camera will go crazy on you. The best you can do is to take the union of these two areas and then read that out and then discard the areas you don’t want. I.e. readout a 0, 0, 1140, 950 frame and then grab the two regions you wanted.