MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling

Sidong Feng, Suyu Ma, Han Wang, David S. Kong, Chunyang Chen

Type: Article

Publication Date: 2024-05-11

Citations: 1

DOI: https://doi.org/10.1145/3613904.3642350

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+ PDF Chat	MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling	2024	Sidong Feng Suyu Ma Han Wang David S. Kong Chunyang Chen
+ PDF Chat	Bridging Design and Development with Automated Declarative UI Code Generation	2024	Ting Zhou Yanjie Zhao Xinyi Hou Xiaoyu Sun Kai Chen H. Wang
+	Predicting the usability of mobile applications using AI tools: the rise of large user interface models, opportunities, and challenges	2024	Abdallah Namoun Ahmed Alrehaili Zaib Un Nisa Hani Almoamari Ali Tufail
+ PDF Chat	AutoDroid: LLM-powered Task Automation in Android	2024	Hao Wen Yuanchun Li Guohong Liu Shanhui Zhao Tao Yu Toby Jia-Jun Li Shiqi Jiang Yunhao Liu Ya-Qin Zhang Yunxin Liu
+ PDF Chat	From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps	2024	Jieshan Chen Zhen Wang Jiamou Sun Wenbo Zou Zhenchang Xing Qinghua Lu Qing Huang Xiwei Xu
+	Computational Approaches for App-to-App Retrieval and Design Consistency Check	2023	Seokhyeon Park Wonjae Kim Young Ho Kim Jinwook Seo
+	Empowering LLM to use Smartphone for Intelligent Task Automation	2023	Hao Wen Yuanchun Li Guohong Liu Shanhui Zhao Yu Tao Toby Jia-Jun Li Shiqi Jiang Yunhao Liu Yaqin Zhang Yunxin Liu
+	Never-ending Learning of User Interfaces	2023	Jason Wu Rebecca Krosnick Eldon Schoop Amanda Swearngin Jeffrey P. Bigham Jeffrey Nichols
+	What do all these Buttons do? Statically Mining Android User Interfaces at Scale	2021	Konstantin Kuznetsov Chen Fu Gao Song David N. Jansen Lijun Zhang Andreas Zeller
+ PDF Chat	Enabling Cost-Effective UI Automation Testing with Retrieval-Based LLMs: A Case Study in WeChat	2024	Sidong Feng Haochuan Lu Jianqin Jiang Ting Xiong Lin-Chien Huang Yinglin Liang Xiaoqin Li Yuetang Deng Aldeida Aleti
+	Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scale	2022	Gang Li Gilles Baechler Manuel Tragut Yang Li
+ PDF Chat	Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scale	2022	Gang Li Gilles Baechler Manuel Tragut Yang Li
+	Never-ending Learning of User Interfaces	2023	Jason Wu Rebecca Krosnick Eldon Schoop Amanda Swearngin Jeffrey P. Bigham Jeffrey A. Nichols
+ PDF Chat	Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis	2022	Eldon Schoop Xin Zhou Gang Li Zhourong Chen Bjoern Hartmann Yang Li
+ PDF Chat	Inferring Alt-text For UI Icons With Large Language Models During App Development	2024	Sabrina Haque Christoph Csallner
+	WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics	2023	Jason Wu Siyan Wang Siman Shen Yi‐Hao Peng Jeffrey Nichols Jeffrey P. Bigham
+	WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics	2023	Jason Wu Siyan Wang Siman Shen Yi-Hao Peng Jeffrey Nichols Jeffrey P. Bigham
+ PDF Chat	UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset	2024	Peitong Duan C Chen Gang Li Bjoern Hartmann Yang Li
+	Automatic Macro Mining from Interaction Traces at Scale	2023	Forrest Huang Gang Li Tao Li Yang Li
+	A Computational Method for Evaluating UI Patterns	2018	Bardia Doosti Dong Tao Biplab Deka Jeffrey Nichols

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (21)

Action	Title	Year	Authors
+ PDF Chat	StoryDroid: Automated Generation of Storyboard for Android Apps	2019	Sen Chen Lingling Fan Chunyang Chen Ting Su Wenhe Li Yang Liu Lihua Xu
+ PDF Chat	Guigle: A GUI Search Engine for Android Apps	2019	Carlos Bernal-Cárdenas Kevin Moran Michele Tufano Zichang Liu Linyong Nan Zhehan Shi Denys Poshyvanyk
+	Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps	2018	Kevin Moran Carlos Bernal-Cárdenas Michael Curcio Richard Bonett Denys Poshyvanyk
+ PDF Chat	Humanoid: A Deep Learning-Based Approach to Automated Black-box Android App Testing	2019	Yuanchun Li Ziyue Yang Yao Guo Xiangqun Chen
+	Mapping Natural Language Instructions to Mobile UI Action Sequences	2020	Yang Li Jiacong He Xin Zhou Yuan Zhang Jason Baldridge
+ PDF Chat	VINS: Visual Search for Mobile User Interface Design	2021	Sara Bunian Kai Li Chaima Jemmali Casper Harteveld Yun Fu Magy Seif El‐Nasr
+	Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels	2021	Xiaoyi Zhang Lilian de Greef Amanda Swearngin Samuel White Kyle I. Murray Lisa Yu Qi Shan Jeffrey Nichols Jason Wu Chris Fleizach
+	Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning	2021	Xin Zhou Yang Li
+	Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning	2021	Bryan Wang Gang Li Xin Zhou Zhourong Chen Tovi Grossman Yang Li
+ PDF Chat	GANSpiration: Balancing Targeted and Serendipitous Inspiration in User Interface Design with Style-Based Generative Adversarial Network	2022	Mohammad Mozaffari Xinyuan Zhang Jinghui Cheng Jin Guo