Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objects

Type: Article

Publication Date: 2023-12-25

Citations: 2

DOI: https://doi.org/10.1109/tvcg.2023.3346995

Abstract

We present a novel freehand sketch beautification method, which takes as input a freely drawn sketch of a man-made object and automatically beautifies it both geometrically and structurally. Beautifying a sketch is challenging because of its highly abstract and heavily diverse drawing manner. Existing methods are usually confined to their limited training samples and thus cannot beautify freely drawn sketches with both geometric and structural variations. To address this challenge, we adopt a divide-and-combine strategy. Specifically, we first parse an input sketch into semantic components, beautify individual components by a learned part beautification module based on part-level implicit manifolds, and then reassemble the beautified components through a structure beautification module. With this strategy, our method can go beyond the training samples and handle novel freehand sketches. We demonstrate the effectiveness of our system with extensive experiments and a perceptual study.

Locations

  • arXiv (Cornell University) - View - PDF
  • PubMed - View
  • IEEE Transactions on Visualization and Computer Graphics - View

Similar Works

Action Title Year Authors
+ Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objects 2023 Deng Yu
Manfred Lau
Lin Gao
Hongbo Fu
+ Deep Sketch-Based Modeling of Man-Made Shapes 2019 Dmitriy Smirnov
Mikhail Bessmeltsev
Justin Solomon
+ PDF Chat Fast Sketch Segmentation and Labeling With Deep Learning 2018 Lei Li
Hongbo Fu
Chiew‐Lan Tai
+ 3D Shape Reconstruction from Free-Hand Sketches 2020 Jiayun Wang
Jierui Lin
Qian Yu
Runtao Liu
Yubei Chen
Stella X. Yu
+ Fast Sketch Segmentation and Labeling with Deep Learning 2018 Lei Li
Hongbo Fu
Chiew‐Lan Tai
+ Learning Manifold Patch-Based Representations of Man-Made Shapes 2019 Dmitriy Smirnov
Mikhail Bessmeltsev
Justin Solomon
+ PDF Chat Sketch-specific data augmentation for freehand sketch recognition 2021 Ying Zheng
Hongxun Yao
Xiaoshuai Sun
Shengping Zhang
Sicheng Zhao
Fatih Porikli
+ Learning Manifold Patch-Based Representations of Man-Made Shapes 2019 Dmitriy Smirnov
Mikhail Bessmeltsev
Justin Solomon
+ PDF Chat Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketches 2021 Song–Hai Zhang
Yuan-Chen Guo
Qing-Wen Gu
+ Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketches 2021 Song–Hai Zhang
Yuan-Chen Guo
Qing-Wen Gu
+ PDF Chat Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketches 2021 Song–Hai Zhang
Yuan-Chen Guo
Qing-Wen Gu
+ Free-hand Sketch Synthesis with Deformable Stroke Models 2015 Yi Li
Yi-Zhe Song
Timothy M. Hospedales
Shaogang Gong
+ Sketch-Specific Data Augmentation for Freehand Sketch Recognition 2019 Ying Zheng
Hongxun Yao
Xiaoshuai Sun
Shengping Zhang
Sicheng Zhao
Fatih Porikli
+ PDF Chat Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches 2023 Ying Zang
Chaotao Ding
Tianrun Chen
Papa Mao
Wenjun Hu
+ SENS: Sketch-based Implicit Neural Shape Modeling 2023 Alexandre Binninger
Amir Hertz
Olga Sorkine‐Hornung
Daniel Cohen‐Or
Raja Giryes
+ CLIPasso: Semantically-Aware Object Sketching 2022 Yael Vinker
Ehsan Pajouheshgar
Jessica Y. Bo
Roman Bachmann
Amit H. Bermano
Daniel Cohen‐Or
Amir Zamir
Ariel Shamir
+ Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches 2023 Ying Zang
Chaotao Ding
Tianrun Chen
Papa Mao
Wenjun Hu
+ PDF Chat SENS: Part‐Aware Sketch‐based Implicit Neural Shape Modeling 2024 Alexandre Binninger
Amir Hertz
Olga Sorkine‐Hornung
Daniel Cohen‐Or
Raja Giryes
+ PDF Chat Deep Learning for Free-Hand Sketch: A Survey 2022 Peng Xu
Timothy M. Hospedales
Qiyue Yin
Yi-Zhe Song
Tao Xiang
Liang Wang
+ Deep Learning for Free-Hand Sketch: A Survey 2020 Peng Xu

Works Cited by This (24)

Action Title Year Authors
+ Sketch-a-Net that Beats Humans 2015 Qian Yu
Yongxin Yang
Yi-Zhe Song
Tao Xiang
Timothy M. Hospedales
+ PDF Chat 3D Sketching using Multi-View Deep Volumetric Prediction 2018 Johanna Delanoy
Mathieu Aubry
Phillip Isola
Alexei A. Efros
Adrien Bousseau
+ PDF Chat Deep Cross-Modality Adaptation via Semantics Preserving Adversarial Learning for Sketch-Based 3D Shape Retrieval 2018 Jiaxin Chen
Yi Fang
+ PDF Chat Fast Sketch Segmentation and Labeling With Deep Learning 2018 Lei Li
Hongbo Fu
Chiew‐Lan Tai
+ PDF Chat TransGaGa: Geometry-Aware Unsupervised Image-To-Image Translation 2019 Wayne Wu
Kaidi Cao
Cheng Li
Chen Qian
Chen Change Loy
+ PDF Chat PartNet: A Large-Scale Benchmark for Fine-Grained and Hierarchical Part-Level 3D Object Understanding 2019 Kaichun Mo
Shilin Zhu
Anne Lynn S. Chang
Li Yi
Subarna Tripathi
Leonidas Guibas
Hao Su
+ PDF Chat Learning Implicit Fields for Generative Shape Modeling 2019 Zhiqin Chen
Hao Zhang
+ PDF Chat SketchMate: Deep Hashing for Million-Scale Human Sketch Retrieval 2018 Peng Xu
Yongye Huang
Tongtong Yuan
Kaiyue Pang
Yi-Zhe Song
Tao Xiang
Timothy M. Hospedales
Zhanyu Ma
Jun Guo
+ PDF Chat 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks 2017 Zhaoliang Lun
Matheus Gadelha
Evangelos Kalogerakis
Subhransu Maji
Rui Wang
+ PDF Chat DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation 2019 Jeong Joon Park
Pete Florence
Julian Straub
Richard Newcombe
Steven Lovegrove