Deep Crisp Boundaries: From Boundaries to Higher-Level Tasks

Type: Article

Publication Date: 2018-10-08

Citations: 74

DOI: https://doi.org/10.1109/tip.2018.2874279

View Chat PDF

Abstract

Edge detection has made significant progress with the help of deep convolutional networks (ConvNet). These ConvNet-based edge detectors have approached human level performance on standard benchmarks. We provide a systematical study of these detectors' outputs. We show that the detection results did not accurately localize edge pixels, which can be adversarial for tasks that require crisp edge inputs. As a remedy, we propose a novel refinement architecture to address the challenging problem of learning a crisp edge detector using ConvNet. Our method leverages a top-down backward refinement pathway, and progressively increases the resolution of feature maps to generate crisp edges. Our results achieve superior performance, surpassing human accuracy when using standard criteria on BSDS500, and largely outperforming the state-of-the-art methods when using more strict criteria. More importantly, we demonstrate the benefit of crisp edge maps for several important applications in computer vision, including optical flow estimation, object proposal generation, and semantic segmentation.

Locations

  • IEEE Transactions on Image Processing - View
  • arXiv (Cornell University) - View - PDF
  • PubMed - View
  • DataCite API - View

Similar Works

Action Title Year Authors
+ PDF Chat Delving Into Crispness: Guided Label Refinement for Crisp Edge Detection 2023 Yunfan Ye
Renjiao Yi
Zhirui Gao
Zhiping Cai
Kai Xu
+ Tiny and Efficient Model for the Edge Detection Generalization 2023 Xavier Soria Poma
Yachuan Li
Mohammad Rouhani
Ángel D. Sappa
+ PDF Chat Tiny and Efficient Model for the Edge Detection Generalization 2023 Xavier Soria Poma
Yachuan Li
Mohammad Rouhani
Ángel D. Sappa
+ Dense Extreme Inception Network for Edge Detection 2021 Xavier Soria Poma
Ángel D. Sappa
Patricio Humanante
Arash Arbarinia
+ PDF Chat Learning to utilize gradient information for crisp edge detection 2024 Changsong Liu
Wei Zhang
Yanyan Liu
Yuming Li
Wenlin Li
Yimeng Fan
Liang Zhang
+ PDF Chat High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and Its Applications to High-Level Vision 2015 Gedas Bertasius
Jianbo Shi
Lorenzo Torresani
+ PDF Chat Holistically-Nested Edge Detection 2015 Saining Xie
Zhuowen Tu
+ High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and its Applications to High-Level Vision 2015 Gedas Bertasius
Jianbo Shi
Lorenzo Torresani
+ PDF Chat Richer Convolutional Features for Edge Detection 2018 Yun Liu
Ming–Ming Cheng
Xiaowei Hu
Jia-Wang Bian
Le Zhang
Xiang Bai
Jinhui Tang
+ High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and its Applications to High-Level Vision 2015 Gedas Bertasius
Jianbo Shi
Lorenzo Torresani
+ Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks 2017 Kevis-Kokitsi Maninis
Jordi Pont-Tuset
Pablo ArbelĂĄez
Luc Van Gool
+ Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks 2017 Kevis-Kokitsi Maninis
Jordi Pont-Tuset
Pablo ArbelĂĄez
Luc Van Gool
+ PDF Chat Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks 2017 Kevis-Kokitsi Maninis
Jordi Pont-Tuset
Pablo ArbelĂĄez
Luc Van Gool
+ Learning on the Edge: Explicit Boundary Handling in CNNs 2018 Carlo Innamorati
Tobias Ritschel
Tim Weyrich
Niloy J. Mitra
+ CASENet: Deep Category-Aware Semantic Edge Detection 2017 Zhiding Yu
Feng Chen
Ming-Yu Liu
Srikumar Ramalingam
+ Boundary Attention: Learning to Find Faint Boundaries at Any Resolution 2024 Mia Polansky
Charles Herrmann
Junhwa Hur
Deqing Sun
Dor Verbin
Todd Zickler
+ PDF Chat OneNet: A Channel-Wise 1D Convolutional U-Net 2024 Sanghyun Byun
Khurshed A. Shah
Ayushi Gang
Christopher Apton
Jilai Song
W.S. Chung
+ Pushing the Boundaries of Boundary Detection using Deep Learning 2015 Iasonas Kokkinos
+ Revisiting Edge Detection in Convolutional Neural Networks 2020 Minh Nghia Le
Subhradeep Kayal
+ PDF Chat Learning Crisp Boundaries Using Deep Refinement Network and Adaptive Weighting Loss 2020 Yijun Cao
Chuan Lin
Yongjie Li

Cited by (14)

Action Title Year Authors
+ PDF Chat Learning Good Features to Transfer Across Tasks and Domains 2023 Pierluigi Zama Ramirez
Adriano Cardace
Luca De Luigi
Alessio Tonioni
Samuele Salti
Luigi Di Stefano
+ PDF Chat Unmixing Convolutional Features for Crisp Edge Detection 2021 Linxi Huan
Nan Xue
Xianwei Zheng
Wei He
Jianya Gong
Gui-Song Xia
+ PDF Chat Cycle pixel difference network for crisp edge detection 2024 Changsong Liu
Wei Zhang
Yanyan Liu
Mingyang Li
Wenlin Li
Yimeng Fan
Xiwei Bai
Liang Zhang
+ PDF Chat Probabilistic Graph Attention Network with Conditional Kernels for Pixel-Wise Prediction 2020 Dan Xu
Xavier Alameda-Pineda
Wanli Ouyang
Elisa Ricci
Xiaogang Wang
Nicu Sebe
+ PDF Chat One-Stage Deep Edge Detection Based on Dense-Scale Feature Fusion and Pixel-Level Imbalance Learning 2022 Chunjie Wang
Dawei Dai
Shuyin Xia
Yingge Liu
Guoyin Wang
+ PDF Chat Object Contour and Edge Detection with RefineContourNet 2019 André Peter Kelm
Vijesh Soorya Rao
Udo Zölzer
+ PDF Chat Learning Part Boundaries from 3D Point Clouds 2020 Marios Loizou
Melinos Averkiou
Evangelos Kalogerakis
+ PDF Chat Semantic Edge Detection with Diverse Deep Supervision 2021 Yun Liu
Ming‐Ming Cheng
Deng-Ping Fan
Le Zhang
Jia-Wang Bian
Dacheng Tao
+ PDF Chat DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detection 2024 Yunfan Ye
Kai Xu
Yuhang Huang
Renjiao Yi
Zhiping Cai
+ Unmixing Convolutional Features for Crisp Edge Detection 2020 Linxi Huan
Xianwei Zheng
Nan Xue
Wei He
Jianya Gong
Gui-Song Xia
+ Semantic Edge Detection with Diverse Deep Supervision 2018 Yun Liu
Ming‐Ming Cheng
Jia-Wang Bian
Le Zhang
Peng-Tao Jiang
Yang Cao
+ PDF Chat Learning deep morphological networks with neural architecture search 2022 Yufei Hu
Nacim Belkhir
JesĂșs Angulo
Angela Yao
Gianni Franchi
+ PDF Chat Compact twice fusion network for edge detection 2025 Zongmin Li
Yachuan Li
Pablo Soria
Chaozhi Yang
Qian Xiao
Yun Bai
Hua Li
Xiangdong Wang
+ PDF Chat Richer Convolutional Features for Edge Detection 2018 Yun Liu
Ming–Ming Cheng
Xiaowei Hu
Jia-Wang Bian
Le Zhang
Xiang Bai
Jinhui Tang

Citing (43)

Action Title Year Authors
+ PDF Chat High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and Its Applications to High-Level Vision 2015 Gedas Bertasius
Jianbo Shi
Lorenzo Torresani
+ Very Deep Convolutional Networks for Large-Scale Image Recognition 2014 Karen Simonyan
Andrew Zisserman
+ PDF Chat Learning Deconvolution Network for Semantic Segmentation 2015 Hyeonwoo Noh
Seunghoon Hong
Bohyung Han
+ ParseNet: Looking Wider to See Better 2015 Wei Liu
Andrew Rabinovich
Alexander C. Berg
+ PDF Chat Visual saliency based on multiscale deep features 2015 Guanbin Li
Yizhou Yu
+ PDF Chat DeepEdge: A multi-scale bifurcated deep network for top-down contour detection 2015 Gedas Bertasius
Jianbo Shi
Lorenzo Torresani
+ PDF Chat EpicFlow: Edge-preserving interpolation of correspondences for optical flow 2015 JĂ©rĂŽme Revaud
Philippe Weinzaepfel
ZaĂŻd Harchaoui
Cordelia Schmid
+ PDF Chat Fast Edge Detection Using Structured Forests 2014 Piotr DollĂĄr
C. Lawrence Zitnick
+ PDF Chat The Secrets of Salient Object Segmentation 2014 Yin Li
Xiaodi Hou
Christof Koch
James M. Rehg
Alan Yuille
+ PDF Chat Conditional Random Fields as Recurrent Neural Networks 2015 Shuai Zheng
Sadeep Jayasumana
Bernardino Romera‐Paredes
Vibhav Vineet
Zhizhong Su
Dalong Du
Chang Huang
Philip H. S. Torr
+ PDF Chat Salient Object Detection: A Discriminative Regional Feature Integration Approach 2013 Huaizu Jiang
Jingdong Wang
Zejian Yuan
Wu Yang
Nanning Zheng
Shipeng Li
+ Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials 2012 Philipp KrĂ€henbĂŒhl
Vladlen Koltun
+ Deeply-Supervised Nets 2014 Chen‐Yu Lee
Saining Xie
Patrick W. Gallagher
Zhengyou Zhang
Zhuowen Tu
+ PDF Chat Deep Residual Learning for Image Recognition 2016 Kaiming He
Xiangyu Zhang
Shaoqing Ren
Jian Sun
+ PDF Chat Semantic Segmentation with Boundary Neural Fields 2016 Gedas Bertasius
Jianbo Shi
Lorenzo Torresani
+ PDF Chat Weakly Supervised Object Boundaries 2016 Anna Khoreva
Rodrigo Benenson
Mohamed Omran
Matthias Hein
Bernt Schiele
+ PDF Chat Object Contour Detection with a Fully Convolutional Encoder-Decoder Network 2016 Shuicheng Yan
Brian Price
Scott Cohen
Honglak Lee
Ming–Hsuan Yang
+ A guide to convolution arithmetic for deep learning 2016 Vincent Dumoulin
Francesco Visin
+ PDF Chat Deep Saliency with Encoded Low Level Distance Map and High Level Features 2016 Ga‐Young Lee
Yu‐Wing Tai
Junmo Kim
+ Fully Convolutional Networks for Semantic Segmentation 2016 Evan Shelhamer
Jonathan Long
Trevor Darrell
+ PDF Chat DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs 2017 Liang-Chieh Chen
George Papandreou
Iasonas Kokkinos
Kevin Murphy
Alan Yuille
+ PDF Chat Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network 2016 Wenzhe Shi
José Caballero
Ferenc HuszĂĄr
Johannes Totz
Andrew P. Aitken
Rob Bishop
Daniel Rueckert
Zehan Wang
+ Improving Fully Convolution Network for Semantic Segmentation 2016 Bing Shuai
Ting Liu
Gang Wang
+ PDF Chat Deeply Supervised Salient Object Detection with Short Connections 2018 Qibin Hou
Ming‐Ming Cheng
Xiaowei Hu
Ali Borji
Zhuowen Tu
Philip H. S. Torr
+ PDF Chat Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks 2017 Kevis-Kokitsi Maninis
Jordi Pont-Tuset
Pablo ArbelĂĄez
Luc Van Gool
+ PDF Chat Understanding Convolution for Semantic Segmentation 2018 Panqu Wang
Pengfei Chen
Ye Yuan
Ding Liu
Zehua Huang
Xiaodi Hou
Garrison W. Cottrell
+ PixelNet: Representation of the pixels, by the pixels, and for the pixels 2017 Aayush Bansal
Xinlei Chen
Bryan Russell
Abhinav Gupta
Deva Ramanan
+ PDF Chat Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network 2017 Chao Peng
Xiangyu Zhang
Gang Yu
Guiming Luo
Jian Sun
+ Mask R-CNN 2017 Kaiming He
Georgia Gkioxari
Piotr DollĂĄr
Ross Girshick
+ PDF Chat Holistically-Nested Edge Detection 2017 Saining Xie
Zhuowen Tu
+ Caffe: Convolutional Architecture for Fast Feature Embedding 2014 Yangqing Jia
Evan Shelhamer
Jeff Donahue
Sergey Karayev
Jonathan Long
Ross Girshick
Sergio Guadarrama
Trevor Darrell
+ Understanding Convolution for Semantic Segmentation 2017 Panqu Wang
Pengfei Chen
Ye Yuan
Ding Liu
Zehua Huang
Xiaodi Hou
Garrison W. Cottrell
+ Learning Deconvolution Network for Semantic Segmentation 2015 Hyeonwoo Noh
Seunghoon Hong
Bohyung Han
+ MatConvNet - Convolutional Neural Networks for MATLAB 2014 Andrea Vedaldi
Karel Lenc
+ Pushing the Boundaries of Boundary Detection using Deep Learning 2015 Iasonas Kokkinos
+ Very Deep Convolutional Networks for Large-Scale Image Recognition 2014 Karen Simonyan
Andrew Zisserman
+ PDF Chat Semantic Image Segmentation with Task-Specific Edge Detection Using CNNs and a Discriminatively Trained Domain Transform 2016 Liang-Chieh Chen
Jonathan T. Barron
George Papandreou
Kevin Murphy
Alan Yuille
+ PDF Chat Unsupervised Learning of Edges 2016 Yin Li
Manohar Paluri
James M. Rehg
Piotr DollĂĄr
+ PDF Chat Deeply Supervised Salient Object Detection with Short Connections 2017 Qibin Hou
Ming‐Ming Cheng
Xiaowei Hu
Ali Borji
Zhuowen Tu
Philip H. S. Torr
+ Pixel-wise Deep Learning for Contour Detection 2015 Jyh-Jing Hwang
Tyng-Luh Liu