Ardupilot Rover Object Detection

OpenMV Boards
1

Hi Fam - I am in the process of building an Ardupilot Rover , I have a h7 r2 camera sitting on my desk which I will like to incorporate into my project .

1.Will it be able to detect moving object (humans ,dogs ,cars and bikes) ?

2.If it does can I stop the rover until obstacle if out of frame ?

3.After all is good continue with my planned mission .

4.How do I wire the camera to my Pixhawk (PX4).

any advice will be high appreciated .

2
  1. No, it cannot run high end Yolo algorithms. You can do more basic computer vision on board, though.
  2. Yes, depending on what algorithm you use.
  3. Yes…
  4. Depends; typically, the uart pins p4/p5 are used.

I don’t have experience integrating Mavlink with a camera, so I can’t tell you exactly how to do this.

3

So basically I can set is up for if it detects moving object in frame for question 1 not specific to (humans ,dogs ,cars and bikes). Can add an basic ultrasonic sensor to measure it’s distance if the object in frame comes really close if it is positioned properly . Sorry for all the questions but I want to spend my summer on this project , which I think is fun with my kids .

4

Yes, we can do this. Connecting to ultrasonic sensors is possible in Micropython via the machine pulseIn api.