SafeSea: Synthetic Data Generation for Adverse & Low Probability Maritime Conditions

November 24, 2023 ยท Entered Twilight ยท ๐Ÿ› 2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)

๐Ÿ’ค TWILIGHT: Eternal Rest
Repo abandoned since publication

Repo contents: README.md, SafeSea_Dataset, crops, crops_checked, image_generation.ipynb, inputs, models, object_observation_checker.ipynb, outputs, scripts, sea_state_classified, sea_state_classifier.ipynb, temp.ipynb

Authors Martin Tran, Jordan Shipard, Hermawan Mulyono, Arnold Wiliem, Clinton Fookes arXiv ID 2311.14764 Category cs.CV: Computer Vision Citations 5 Venue 2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) Repository https://github.com/martin-3240/SafeSea โญ 5 Last Checked 1 month ago
Abstract
High-quality training data is essential for enhancing the robustness of object detection models. Within the maritime domain, obtaining a diverse real image dataset is particularly challenging due to the difficulty of capturing sea images with the presence of maritime objects , especially in stormy conditions. These challenges arise due to resource limitations, in addition to the unpredictable appearance of maritime objects. Nevertheless, acquiring data from stormy conditions is essential for training effective maritime detection models, particularly for search and rescue, where real-world conditions can be unpredictable. In this work, we introduce SafeSea, which is a stepping stone towards transforming actual sea images with various Sea State backgrounds while retaining maritime objects. Compared to existing generative methods such as Stable Diffusion Inpainting~\cite{stableDiffusion}, this approach reduces the time and effort required to create synthetic datasets for training maritime object detection models. The proposed method uses two automated filters to only pass generated images that meet the criteria. In particular, these filters will first classify the sea condition according to its Sea State level and then it will check whether the objects from the input image are still preserved. This method enabled the creation of the SafeSea dataset, offering diverse weather condition backgrounds to supplement the training of maritime models. Lastly, we observed that a maritime object detection model faced challenges in detecting objects in stormy sea backgrounds, emphasizing the impact of weather conditions on detection accuracy. The code, and dataset are available at https://github.com/martin-3240/SafeSea.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

๐Ÿ“œ Similar Papers

In the same crypt โ€” Computer Vision