A framework for characterising and evaluating the effectiveness of environmental modelling

Serena H. Hamilton, Baihua Fu, Joseph H.A. Guillaume, Jennifer Badham, Sondoss Elsawah, Patricia Gober, Randall J. Hunt, Takuya Iwanaga, Anthony J. Jakeman, Daniel P. Ames, Allan Curtis, Mary C. Hill, Suzanne A. Pierce, Fateme Zare

Research output: Contribution to journalArticle

Abstract

Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.
Original languageEnglish
Pages (from-to)83-98
Number of pages16
JournalEnvironmental Modelling and Software
Volume118
Early online date13 Apr 2019
DOIs
Publication statusE-pub ahead of print - 13 Apr 2019

Fingerprint

environmental modeling
accessibility
modeling
evaluation

Cite this

Hamilton, S. H., Fu, B., Guillaume, J. H. A., Badham, J., Elsawah, S., Gober, P., ... Zare, F. (2019). A framework for characterising and evaluating the effectiveness of environmental modelling. Environmental Modelling and Software, 118, 83-98. https://doi.org/10.1016/j.envsoft.2019.04.008
Hamilton, Serena H. ; Fu, Baihua ; Guillaume, Joseph H.A. ; Badham, Jennifer ; Elsawah, Sondoss ; Gober, Patricia ; Hunt, Randall J. ; Iwanaga, Takuya ; Jakeman, Anthony J. ; Ames, Daniel P. ; Curtis, Allan ; Hill, Mary C. ; Pierce, Suzanne A. ; Zare, Fateme. / A framework for characterising and evaluating the effectiveness of environmental modelling. In: Environmental Modelling and Software. 2019 ; Vol. 118. pp. 83-98.
@article{6809acf552f940bfa7dc593b5943c913,
title = "A framework for characterising and evaluating the effectiveness of environmental modelling",
abstract = "Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.",
keywords = "Model assessment, Model evaluation, Model performance",
author = "Hamilton, {Serena H.} and Baihua Fu and Guillaume, {Joseph H.A.} and Jennifer Badham and Sondoss Elsawah and Patricia Gober and Hunt, {Randall J.} and Takuya Iwanaga and Jakeman, {Anthony J.} and Ames, {Daniel P.} and Allan Curtis and Hill, {Mary C.} and Pierce, {Suzanne A.} and Fateme Zare",
year = "2019",
month = "4",
day = "13",
doi = "10.1016/j.envsoft.2019.04.008",
language = "English",
volume = "118",
pages = "83--98",
journal = "Environmental Software",
issn = "1364-8152",
publisher = "Elsevier BV",

}

Hamilton, SH, Fu, B, Guillaume, JHA, Badham, J, Elsawah, S, Gober, P, Hunt, RJ, Iwanaga, T, Jakeman, AJ, Ames, DP, Curtis, A, Hill, MC, Pierce, SA & Zare, F 2019, 'A framework for characterising and evaluating the effectiveness of environmental modelling' Environmental Modelling and Software, vol. 118, pp. 83-98. https://doi.org/10.1016/j.envsoft.2019.04.008

A framework for characterising and evaluating the effectiveness of environmental modelling. / Hamilton, Serena H.; Fu, Baihua; Guillaume, Joseph H.A.; Badham, Jennifer; Elsawah, Sondoss; Gober, Patricia; Hunt, Randall J.; Iwanaga, Takuya; Jakeman, Anthony J.; Ames, Daniel P.; Curtis, Allan; Hill, Mary C.; Pierce, Suzanne A.; Zare, Fateme.

In: Environmental Modelling and Software, Vol. 118, 01.08.2019, p. 83-98.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A framework for characterising and evaluating the effectiveness of environmental modelling

AU - Hamilton, Serena H.

AU - Fu, Baihua

AU - Guillaume, Joseph H.A.

AU - Badham, Jennifer

AU - Elsawah, Sondoss

AU - Gober, Patricia

AU - Hunt, Randall J.

AU - Iwanaga, Takuya

AU - Jakeman, Anthony J.

AU - Ames, Daniel P.

AU - Curtis, Allan

AU - Hill, Mary C.

AU - Pierce, Suzanne A.

AU - Zare, Fateme

PY - 2019/4/13

Y1 - 2019/4/13

N2 - Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.

AB - Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.

KW - Model assessment

KW - Model evaluation

KW - Model performance

UR - http://www.scopus.com/inward/record.url?scp=85064906457&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064906457&partnerID=8YFLogxK

U2 - 10.1016/j.envsoft.2019.04.008

DO - 10.1016/j.envsoft.2019.04.008

M3 - Article

VL - 118

SP - 83

EP - 98

JO - Environmental Software

JF - Environmental Software

SN - 1364-8152

ER -