How to deploy a model.h5 from keras to OpenMV? Any example from TensorFlow to OpenMV?

OpenMV Boards
1

I have trained an image multi classification model based on MobileNet-V2(Only the Dense layer has been added), and have carried out full integer quantization(INT8), and then exported model.tflite file, using TF Class () to call this model.

The accuracy of this model is quite good in the test while training. However, when tested on openmv, the same label is output for all objects (although the probability is slightly different).

I looked up some materials, one of them mentioned TF Classify() has offset and scale parameters, which is related to compressing RGB values to [- 1,0] or [0,1] during training, but this parameter is not available in the official API document.

So are there any examples of workflow from tensorflow training model to deployment to openmv?

2

Hi, this script works with openmv.
As for the preprocess, if you are using uint8 image, div 255 as input.

1 Like
3

Thank you, I’ll try it later.

4

In addition, does openmv support multi output model?

5

See the FOMO object tracking model from Edge Impulse.

6

What do you mean “dive 255”, Do you mean that when I call the model in OpenMV, I input the grayscale image?

When training the model, I transformed the image in the first layer of the model and compressed the RGB value to 0-1 (div 255). Should the div operation you mentioned be carried out in openmv?

My model has good verification accuracy in tensorflow, but the correct output cannot be obtained on openmv after quantization and converted to tflite. I found that the model I trained in edge impulse has only one channel, (tf_model.channels()) while the model I exported has three channels. May this be related to the failure of the model to output correct results?

你的意思是应该将图像转换为灰度图像后再调用模型吗？

通过tf_model.channels()方法，我发现我的模型有三个通道，也就是它接收的是彩色图片，这可能是因为我在训练模型时，将压缩图像RGB值放在了模型内部：

    x = data_augmentation(inputs)
    x = layers.Rescaling(1. / 255)(x)

而Edge Impulse导出的模型只有一个通道，应该是因为它在特征提取时就已经完成了将图片转换为灰度图像的步骤，然后将一个颜色通道的张量输入神经网络。

这会与我的模型无法正常在OpenMV工作有关吗？