Maximum N6 Image quality

[kwagyeman]

Hi all,

We’re still in the process of merging PRs and getting ready for the v5.0.0 release. However, to commercial customers evaluating the N6, this post shares how the PS5520 image quality will look after PRs

• ports/stm32: Add image scaler support. by kwagyeman · Pull Request #3132 · openmv/openmv · GitHub
• sensors/drivers: Improve PS5520 AEC convergence time. by kwagyeman · Pull Request #3122 · openmv/openmv · GitHub
• drvers/sensors: Apply pag7936 denoise settings. by kwagyeman · Pull Request #3178 · openmv/openmv · GitHub

are merged. Color Matrix correction support is still a work in progress.

• ports/stm32: Add ccm support. by kwagyeman · Pull Request #3161 · openmv/openmv · GitHub

It may not be ready for a while. It is not planned for the V5.0.0 release. Please see the firmware below with the above 3 PRs (not CCM support) applied.

firmware.zip (1.2 MB)

And the PAG7936 image quality

[kwagyeman]

The following firmware adds the VENC being enabled ontop of the above PRs for the N6 JPEG compression speedup. H.264 is not enabled yet.

• ports/stm32: Add VENC jpeg compressor. by kwagyeman · Pull Request #3114 · openmv/openmv · GitHub

Note, however, that there’s a bug related to the USB crashing on script stop that needs to be debugged before this PR is ready when the NPU is operating. But, test this firmware to get an idea of JPEG performance.

PAG7936 QVGA → Works at 120 FPS
PAG7936 VGA → Works at 60 FPS
PAG7936 HD → Works at 25 FPS

PS5520 VGA → Works at 30 FPS
PS5520 HD → Works at 30 FPS
PS5520 FHD → Works at 15 FPS
PS5520 WQXGA2 → Works at 5 FPS

firmware.zip (1.2 MB)

walk-through.mp4

walk-through-2.mp4

Note that H.264 performance will be the same as MJPEG performance, but with the H.264 encoding and byte rate reductions. The max frame rate will be the same. The H.264 encoder does feature image stabilization support though so the expected video smoothness will be better.

Final note, the above videos were captured a while ago, before a few PRs were merged and #3122 was updated. AEC/AGC/AWB performance has improved since they were captured.