Hi All, I can’t find the schematic or design files for the Multispectral Thermal Camera (Lepton + PAG7936/OV5640) or the GENX320 boards in the GitHub repo. Are they available anywhere?
I’m trying to get both a GENX320 and a Lepton working at the same time using a combo of the GENX320 camera board and a Lepton breakout from GroupGets connected to the extra SPI interface. If that’s successful I’ll ultimately design a camera board with the two sensors on it. Having the current schematics would be useful!
Hi, we no longer share the design files for our hardware. You can view the schematics of released products through the Altium viewer on our product web pages. The multispectral cameras haven’t been released yet, so the design is not posted. If you are interested in licensing the design for commercial use, please email us.
Once we get our latest release out… you can technically support both of those sensors at the same time, however, the current driver stack associates both of those sensors as aux sensors and not primary and will complain without modifications. You’ll need a color camera in there too to have no issues.
Thanks for the insight. The fact the multispectral cam isn’t released yet would make sense as to why I can’t find any mention of it anywhere except the website!
That’s disappointing to hear that the hardware is no longer open source, but it’s not too complex so I think the appropriate connections can be figured out from component datasheets. This is just a personal project so I can’t license anything.
I’m open to firmware changes to get the two sensors running at the same time, but it sounds like the new release is days away. It’s probably worth waiting for that before getting too deep in C code. I’d appreciate any guidance on where to look within the firmware to make these changes though. I assume somewhere it’s probing I2C/SPI to find the sensors and initializing the appropriate drivers.
The goal is to make a more robust object detector/tracker that can survive periods of high motion/vibration (hence the GENX320 being added). The thermal just has a high SNR for people and vehicle detection but could easily be replaced with a standard image sensor, especially with the better AI performance of the N6 allowing more robust detector models to be used.
BTW, it’s worth mentioning I have my order in for the N6 and am just trying to get started using the H7 Plus while waiting for that.
That’s disappointing to hear that the hardware is no longer open source, but it’s not too complex so I think the appropriate connections can be figured out from component datasheets. This is just a personal project so I can’t license anything.
Hi, we plan to release the schematics for the multi-spectral camera and hardware layout via the Altirum viewer on the product page once the product is shipping. You’ll be able to design your own variant based on the information. So you won’t have to reverse-engineer anything from datasheets.
The design for the PAG7936+LEPTON is complete. The OV5640+LEPTON is still under development.
I’m open to firmware changes to get the two sensors running at the same time, but it sounds like the new release is days away. It’s probably worth waiting for that before getting too deep in C code. I’d appreciate any guidance on where to look within the firmware to make these changes though. I assume somewhere it’s probing I2C/SPI to find the sensors and initializing the appropriate drivers.
Oh, it’s simple to fix, our firmware just assumes there’s always one main color camera, so, you just have to change a flag from 1 to 0 to specify the gexn320 as a main camera.
Thanks again for the clarification! I’m looking forward to the release of the multi-sensor boards and will check on Altium Viewer when they are available.
I haven’t experimented yet with the firmware, but would it be possible to have the Lepton connect to SPI 2/I2C 4 on pins P0-P3 and P8/P7? Will the firmware scan those buses or is more modification needed to make it look there than just a simple 0/1 change in the firmware config?
We used to support that via the old FIR module. However, this has been removed for the new dual sensors. If you use an older firmware version you can do this.
I just paid for manufacturing 100 of the OV5640+FLIR Lepton modules. We’ve finished prototyping and they work. So, we’ll have them in stock soon. We have 250 of the PAG7936+FLIR Lepton modules for the N6 also on their way.
If you want a multi-sensor board right now, I have some units for sale at “prototype” prices (e.g. expensive). Let me know via email if you are interested in one immediately.