{"id":146443,"date":"2021-08-16T14:28:11","date_gmt":"2021-08-17T00:28:11","guid":{"rendered":"https:\/\/www.hawaii.edu\/news\/?p=146443"},"modified":"2025-03-17T08:32:50","modified_gmt":"2025-03-17T18:32:50","slug":"ai-for-live-fish-tracking","status":"publish","type":"post","link":"https:\/\/www.hawaii.edu\/news\/2021\/08\/16\/ai-for-live-fish-tracking\/","title":{"rendered":"UH<\/abbr> Hilo students improve AI<\/abbr> for live fish tracking, more"},"content":{"rendered":"Reading time: <\/span> 2<\/span> minutes<\/span><\/span>
\"teacher
Travis Mandel leads summer class on artificial intelligence. (Photo credit: Ilya Kravchik, photo may not be used without permission)<\/figcaption><\/figure>\n

This summer, five students from the University of Â鶹´«Ã½<\/span> at Hilo<\/a> worked with a computer scientist to investigate various research problems in human-in-the-loop artificial intelligence (AI<\/abbr>). It is a branch of AI<\/abbr> that combines human and machine intelligence to create machine learning models. The class was led by Travis Mandel<\/strong>, assistant professor of computer science, and sponsored by the National Science Foundation. Students were paid a stipend to participate.<\/p>\n

“The students have been working really hard and have some interesting work to present,” said Mandel. On July 30, the students virtually presented their group projects.<\/p>\n

Human-AI<\/abbr> collaboration in fish tracking<\/h2>\n
\"ocean\"
Phone app developed by the fish detection group. (Photo credit: Travis Mandel)<\/figcaption><\/figure>\n

Students Chris Hanley<\/strong> and Meynard Ballesteros<\/strong> developed a cross-platform app linked to detecting and tracking fish. It allows anyone to run fish detectors on live video from their webcam and on pre-collected dive videos.<\/p>\n

According to the project\u2019s abstract, existing pipelines have been built that can accurately detect and track fish in real-world video collected by divers off the coast of Â鶹´«Ã½<\/span> Island, but none are equipped to guide data collection in the field.<\/p>\n

Over the summer, the students trained with a wide variety of object detection network architectures on publicly available fish data.<\/p>\n

The budding computer scientists explain that in order to be useful to divers in the field, object detection and tracking need to occur on mobile devices rather than a desktop computer or server.<\/p>\n

In the project abstract they explain, “we instrumented our app to report key accuracy and timing metrics, which we compared to desktop performance, finding unexpected dissimilarities. Finally, we explore avenues for running tracking in real-time alongside detections.”<\/p>\n

They hope the app will lay a foundation for a new paradigm on how humans and computer vision systems can interact during real-time data collection.<\/p>\n