JavaFX In Action #18 with Brian Schlining: Annotating the Deep-Sea Wildlife

Brian has a dream job! He is responsible for a complex system that allows scientific researchers to research the animals living in the deep sea. He provides them with the tools to annotate videos and images made by submarines diving thousands of meters deep in the oceans. While he works on this software, he gets to know all the amazing creatures living in this mysterious world.

About Brian

Brian Schlining is a Software Engineer at the Monterey Bay Aquarium Research Institute (MBARI), specializing in designing software systems to support scientific research. This includes data systems design, database development, user interface development (desktop and web applications), GIS, image and video analysis, micro-services, and analysis of large data sets.

His primary development languages are Java(FX) and Scala, combined with SQL, JavaScript, TypeScript, Groovy, Python, C, Objective-C, and Matlab for projects.

You can find him on:

• LinkedIn
• Bluesky
• Mastodon
• GitHub
• Medium

About VARS Annotation

Within MBARI, a full system of micro-services has been developed to store a large number of deep-sea videos and images, a knowledge base about the animals living in the sea, machine learning tools, etc.

VARS Annotation is a JavaFX user interface for creating and editing video annotations. It targets modern video workflows and is part of the MBARI Media Management software stack. It's not a standalone application but depends on several external services that need to be deployed.

Links:

• MBARI Media Management (M3)
• MBARI Media Management (M3) sources
• VARS Annotation sources
• VARS Annotation documentation

Video content

00:00 Who is Brian and what is MBARI?

• MBARI Submarine ROV Doc Ricketts
• MBARI Submarine ROV Ventana

02:48 Demo of the search webtool

06:26 Demo of the JavaFX video annotation application

11:27 Code of the JavaFX timeline component

13:13 Using machine learning

16:49 Use by other organizations

• Quickstart for the full system

18:35 History of the project

19:58 Demo of the JavaFX image annotation application

22:16 Main advantages of using Java, JavaFX, and Scala

23:32 Plans for the future

25:15 Shout-out to use the tool for other annotation projects

More JFX In Action...

Click here for more posts with JFX In Action videos.