Haar Face Counting with Lepton 3.1R/Infrared Camera

Besides the obvious change from HQVGA to QQVGA, any other suggestions for changes to the code below that worked well for the standard camera to make it work effectively with the Lepton 3.1R?

Reset sensor

sensor.reset()
sensor.set_contrast(3)
sensor.set_gainceiling(32)

sensor.set_framesize(sensor.HQVGA)
sensor.set_pixformat(sensor.GRAYSCALE)
sensor.set_framebuffers(1)

The haar cascade needs greyscale images of people’s faces. If you want to do this in thermal you need to train a new CNN using FOMO with edge impulse.

OK. I was confused by this statement on this page:

Pure Thermal OpenMV | OpenMV

" * Face Detection

  • You can detect Faces with your Pure Thermal OpenMV (or any generic object). Your Pure Thermal OpenMV can process Haar Cascades to do generic object detection and comes with a built-in Frontal Face Cascade and Eye Haar Cascade to detect faces and eyes. Video demo here."

Yes, it has a color camera at the same time for that purpose which can do the face detection. You can then combine the IR data and map that to where the face is.

Ah, OK. Makes sense. Didn’t know that it had both cameras.

Thanks for the info Kwabena, and thanks for making great stuff!