Please use this identifier to cite or link to this item:
|Scopus||Web of Science®||Altmetric|
|Title:||A benchmarking approach for comparing data splitting methods for modeling water resources parameters using artificial neural networks|
|Citation:||Water Resources Research, 2013; 49(11):7598-7614|
|Publisher:||Amer Geophysical Union|
|Wenyan Wu, Robert J. May, Holger R. Maier, and Graeme C. Dandy|
|Abstract:||Data splitting is an important step in the artificial neural network (ANN) development process, whereby the available data are divided into training, testing, and validation subsets to ensure good generalization ability of the model. Considering that only one split of the data is typically used when developing ANN models, data splitting has a significant impact on model performance, depending on which data are allocated to the three subsets. Therefore, it is important to find a data splitting method that consistently results in predictive validation errors that are representative of the predictive errors obtained over the full range of the available data. This paper addresses this issue by introducing a benchmarking approach for comparing different data splitting methods in terms of (1) bias, which is the difference between the expected validation performance over the entire data set and that obtained using a particular data splitting method and (2) variability, which is the spread of the validation errors obtained by repeated implementation of that method. The utility of the proposed approach is assessed on a number of well-known data splitting methods in the context of four water resources ANN modelling problems. The results obtained indicate that the proposed approach for comparing data splitting methods is more representative than the previous approach where a value of zero is used as the predictive performance benchmark, as it can avoid the selection of an over-optimistic data splitting method that under-represents extreme data in the validation set. Key Points Development of predictive performance benchmark for estimating model bias Development of benchmarking approach for comparing data splitting methods Application of the approach to different data splitting methods and datasets ©2013. American Geophysical Union. All Rights Reserved.|
|Keywords:||artificial neural networks|
data splitting methods
|Rights:||©2013. American Geophysical Union. All Rights Reserved.|
|Appears in Collections:||Aurora harvest 4|
Civil and Environmental Engineering publications
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.