A Baseline Model for Software Effort Estimation

Type: Article

Publication Date: 2015-05-13

Citations: 92

DOI: https://doi.org/10.1145/2738037

Abstract

Software effort estimation (SEE) is a core activity in all software processes and development lifecycles. A range of increasingly complex methods has been considered in the past 30 years for the prediction of effort, often with mixed and contradictory results. The comparative assessment of effort prediction methods has therefore become a common approach when considering how best to predict effort over a range of project types. Unfortunately, these assessments use a variety of sampling methods and error measurements, making comparison with other work difficult. This article proposes an automatically transformed linear model (ATLM) as a suitable baseline model for comparison against SEE methods. ATLM is simple yet performs well over a range of different project types. In addition, ATLM may be used with mixed numeric and categorical data and requires no parameter tuning. It is also deterministic, meaning that results obtained are amenable to replication. These and other arguments for using ATLM as a baseline model are presented, and a reference implementation described and made available. We suggest that ATLM should be used as a baseline of effort prediction quality for all future model comparisons in SEE.

Locations

  • ACM Transactions on Software Engineering and Methodology - View
  • arXiv (Cornell University) - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ Time-Aware Models for Software Effort Estimation 2020 Michael Franklin Bosu
Stephen G. MacDonell
Peter A. Whigham
+ PDF Chat “Estimating software project effort using analogies”: Reflections after 28 years 2025 Martin Shepperd
+ PDF Chat Software effort estimation accuracy prediction of machine learning techniques: A systematic performance evaluation 2021 Yasir Mahmood
Nazri Kama
Azri Azmi
Ahmad Salman Khan
Mazlan Ali
+ Analysis of Empirical Software Effort Estimation Models 2010 M. S. Saleem Basha
P. Dhavachelvan
+ Predicting Software Effort from Use Case Points: A Systematic Review 2020 Mohammad Azzeh
Ali Bou Nassif
Imtinan B. Attili
+ Predicting Software Effort from Use Case Points: A Systematic Review 2020 Mohammad Azzeh
Ali Bou Nassif
Imtinan B. Attili
+ Software Effort Estimation Accuracy Prediction of Machine Learning Techniques: A Systematic Performance Evaluation 2021 Yasir Mahmood
Nazri Kama
Azri Azmi
Ahmad Salman Khan
Mazlan Ali
+ PDF Chat State of the Practice in Software Effort Estimation: A Survey and Literature Review 2011 Adam Trendowicz
JĂŒrgen MĂŒnch
Ross Jeffery
+ PDF Chat On the Value of Project Productivity for Early Effort Estimation 2022 Mohammad Azzeh
Ali Bou Nassif
Yousef Elsheikh
Lefteris Angelis
+ Negative Results for Software Effort Estimation 2016 Tim Menzies
Yang Ye
George Mathew
Barry Boehm
Jairus Hihn
+ PDF Chat Leveraging AI for Enhanced Software Effort Estimation: A Comprehensive Study and Framework Proposal 2024 Nhi Tran
Tan Tran
Nam Nguyen
+ PDF Chat Leveraging AI for Enhanced Software Effort Estimation: A Comprehensive Study and Framework Proposal 2023 Tue Nhi Tran
Huyen Tan Tran
Quy Nam Nguyen
+ PDF Chat Leveraging Large Language Models for Predicting Cost and Duration in Software Engineering Projects 2024 James R. Carpenter
Chen Wu
Nasir U. Eisty
+ Do Not Take It for Granted: Comparing Open-Source Libraries for Software Development Effort Estimation 2022 Rebecca Moussa
Federica Sarro
+ Negative Results for Software Effort Estimation 2016 Tim Menzies
Ye Yang
George Mathew
Barry Boehm
Jairus Hihn
+ An Empirical Study of Effort-Size and Effort-Time in Expert-Based Estimations 2017 Habibi Husain Arifin
Jirapun Daengdej
Nguyen Thien Khanh
+ Analysis of Empirical Software Effort Estimation Models 2010 M. S. Saleem Basha
P. Dhavachelvan
+ PDF Chat Software Estimation in the Design Stage with Statistical Models and Machine Learning: An Empirical Study 2024 Ángel J. Sånchez-García
MarĂ­a Saarayim GonzĂĄlez-HernĂĄndez
Karen Cortés-Verdín
Juan Carlos PĂ©rez-Arriaga
+ PDF Chat Software effort estimation based on optimized model tree 2011 Mohammad Azzeh
+ Software effort estimation based on optimized model tree 2017 Mohammad Azzeh

Works That Cite This (24)

Action Title Year Authors
+ PDF Chat Investigating the Significance of Bellwether Effect to Improve Software Effort Estimation 2017 Solomon Mensah
Jacky Keung
Stephen G. MacDonell
Michael Franklin Bosu
Kwabena Ebo Bennin
+ Negative Results for Software Effort Estimation 2016 Tim Menzies
Ye Yang
George Mathew
Barry Boehm
Jairus Hihn
+ Finite volume method network for the acceleration of unsteady computational fluid dynamics: Non‐reacting and reacting flows 2022 Joongoo Jeon
Juhyeong Lee
Sung Joong Kim
+ MAT: A simple yet strong baseline for identifying self-admitted technical debt 2019 Zhaoqiang Guo
Shiran Liu
Jinping Liu
Yanhui Li
Lin Chen
Hongmin Lu
Yuming Zhou
Baowen Xu
+ PDF Chat “Bad smells” in software analytics papers 2019 Tim Menzies
Martin Shepperd
+ Why Software Effort Estimation Needs SBSE 2018 Tianpei Xia
Jianfeng Chen
George Mathew
Xipeng Shen
Tim Menzies
+ PDF Chat “Sampling” as a Baseline Optimizer for Search-Based Software Engineering 2018 Jianfeng Chen
Vivek Nair
Rahul Krishna
Tim Menzies
+ Hyperparameter Optimization for Effort Estimation 2018 Tianpei Xia
Rahul Krishna
Jianfeng Chen
George Mathew
Xipeng Shen
Tim Menzies
+ PDF Chat Investigating the Significance of the Bellwether Effect to Improve Software Effort Prediction: Further Empirical Study 2018 Solomon Mensah
Jacky Keung
Stephen G. MacDonell
Michael Franklin Bosu
Kwabena Ebo Bennin
+ PDF Chat Analyzing the Stationarity Process in Software Effort Estimation Datasets 2020 Michael Franklin Bosu
Stephen G. MacDonell
Peter A. Whigham