ADROC: Autonomous Diver-Relative Operator Configuration

General Page Media
A display of the ADROC algorithm. On the left is a 3rd person view of the an AUV approaching a diver in SCUBA gear, on the right, a view from the robot's point of view.

 The ability of an AUV to navigate relative to a diver is essential for effective diver-AUV interaction.  In order for a robot to communicate with a diver, the robot must be able to position itself in front of a diver, at an appropriate distance from the diver. Our method, autonomous diver-relative operator configuration (ADROC), achieves this using only monocular vision as input. 

Two simulated displays of ADROC approaches are shown here.

Our method is capable of approaching a diver from a distance (up to 15m has been tested), searching for a diver when one is not initially seen, and adjusting its position relative to the diver in the x, y, and z dimensions. An overview of ADROC is shown below, with the overall algorithm on the right and the state machine which governs the searching/approaching/final position behavior on the left. The diver detector (bounding boxes) and body pose estimator ( 2d body skeleton keypoints) both provide information to the diver-relative position estimator, which generates a center point for the diver, as well as a ratio between the current distance to the diver and the ideal distance. This ratio is referred to as pseudodistance. Finally, the approach controller manages the thruster outputs to move the center point of the diver into the center of the image and reach a psuedodistance of 1.0. Once these conditions are met, the robot has approached the diver successfully.
 

Flowchart depicting the ADROC algorithm.

ADROC has been evaluated in a number of closed water experiments (open water trials have been prevented thus far by the COVID-19 pandemic). In 162 approach attempts, ADROC achieved successful approaches in 132 cases. We attempted approaches in clear and cloudy water, from distances of 3, 6, and 9 meters, and from initial angles of 0, 45, and 90 degrees, on a total of 9 divers. Aggregate results are visible below, along with two cases of ADROC approach graphed in terms of the center point and pseudodistance errors used as inputs the PID approach controller.

A table containing ADROC approach success rate and timing results for different conditions. An overall success rate of 81% is achieved.

 

A graph showing two different ADROC approaches in terms of center point and pseudo distance error. The approach on the left was successful, the approach on the right was not.