Hi, we are about to release TensorFlow for the system in firmware v3.5.0. The firmware is complete and on GitHub. I just have to finish the documentation and then get it into OpenMV IDE to be sent to all customers.
With TensorFlow on board you just train a TensorFlow lite model, quanitize it, and then it will run on the camera. The model can’t be too big… But, otherwise you can classify images easily.
We also will just image segmentation so that you can determine what parts of the image are what and then you can use our blob finder to track the classified blobs.
I don’t think we will support object tracking for a while until Google releases an example on how to do that using less RAM. Large nets like SSD don’t work at all on our system. So, just classification and segmentation. Even segmentation is a stretch a little bit too.
…
The out of the box example on firmware 3.5.0 is a person detector. But, you can basically run any TensorFlow classifier model. So, literally, whatever training data you have can be used to map to a list of float outputs representing class scores.
So, just collect training data and train robust models. Note that the camera color may be different from the training data so you need to make your model robust to that…