SpatialFlow: Bridging All Tasks for Panoptic Segmentation

October 19, 2019 ยท Entered Twilight ยท ๐Ÿ› IEEE transactions on circuits and systems for video technology (Print)

๐ŸŒ… TWILIGHT: Old Age
Predates the code-sharing era โ€” a pioneer of its time

"Last commit was 5.0 years ago (โ‰ฅ5 year threshold)"

Evidence collected by the PWNC Scanner

Repo contents: .dev_scripts, .github, .gitignore, .pre-commit-config.yaml, .readthedocs.yml, LICENSE, README.md, README_mmdet.md, configs, demo, docker, docs, mmdet, pytest.ini, requirements.txt, requirements, resources, setup.cfg, setup.py, tests, tools

Authors Qiang Chen, Anda Cheng, Xiangyu He, Peisong Wang, Jian Cheng arXiv ID 1910.08787 Category cs.CV: Computer Vision Citations 33 Venue IEEE transactions on circuits and systems for video technology (Print) Repository https://github.com/chensnathan/SpatialFlow โญ 14 Last Checked 1 month ago
Abstract
Object location is fundamental to panoptic segmentation as it is related to all things and stuff in the image scene. Knowing the locations of objects in the image provides clues for segmenting and helps the network better understand the scene. How to integrate object location in both thing and stuff segmentation is a crucial problem. In this paper, we propose spatial information flows to achieve this objective. The flows can bridge all sub-tasks in panoptic segmentation by delivering the object's spatial context from the box regression task to others. More importantly, we design four parallel sub-networks to get a preferable adaptation of object spatial information in sub-tasks. Upon the sub-networks and the flows, we present a location-aware and unified framework for panoptic segmentation, denoted as SpatialFlow. We perform a detailed ablation study on each component and conduct extensive experiments to prove the effectiveness of SpatialFlow. Furthermore, we achieve state-of-the-art results, which are $47.9$ PQ and $62.5$ PQ respectively on MS-COCO and Cityscapes panoptic benchmarks. Code will be available at https://github.com/chensnathan/SpatialFlow.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

๐Ÿ“œ Similar Papers

In the same crypt โ€” Computer Vision