Semantic segmentation is a challenging task that needs to handle large scale variations, deformations, and different viewpoints. In this paper, we develop a novel network named Gated Path Selection Network (GPSNet), which aims to adaptively select receptive fields while maintaining the dense sampling capability. In GPSNet, we first design a two-dimensional SuperNet, which densely incorporates features from growing receptive fields. And then, a Comparative Feature Aggregation (CFA) module is introduced to dynamically aggregate discriminative semantic context. In contrast to previous works that focus on optimizing sparse sampling locations on regular grids, GPSNet can adaptively harvest free form dense semantic context information. The derived adaptive receptive fields and dense sampling locations are data-dependent and flexible which can model various contexts of objects. On two representative semantic segmentation datasets, i.e., Cityscapes and ADE20K, we show that the proposed approach consistently outperforms previous methods without bells and whistles.
|Number of pages||14|
|Journal||IEEE Transactions on Image Processing|
|State||Published - 2021|
Bibliographical noteFunding Information:
Manuscript received April 2, 2020; revised October 10, 2020; accepted December 5, 2020. Date of publication January 8, 2021; date of current version February 1, 2021. This work was supported in part by the National Key Research and Development Program of China under Grant 2018YFB2100601 and in part by the National Natural Science Foundation of China (NSFC) under Grant 61872024. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Raja Bala. (Corresponding author: Zhong Zhou.) Qichuan Geng is with the State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing 100191, China. His work was partially done when he was an intern at Baidu Research, Beijing 100193, China (e-mail: zhaokefirst@ buaa.edu.cn).
© 2021 IEEE.
- Semantic segmentation
- adaptive context aggregation
- adaptive receptive fields and sampling locations
- local discriminative feature
ASJC Scopus subject areas
- Computer Graphics and Computer-Aided Design