Lessons from a comprehensive validation of an agent based-model: The experience of the Pampas Model of Argentinean agricultural systems

Federico E. Bert, Santiago L. Rovere, Charles M. Macal, Michael J. North, Guillermo P. Podestá

Research output: Contribution to journalArticlepeer-review

33 Scopus citations

Abstract

There are few published examples of comprehensively validated large-scale land-use agent-based models (ABMs). We present guidelines for doing so, and provide an example in the context of the Pampas Model (PM), an ABM aimed to explore the dynamics of structural and land use changes in the agricultural systems of the Argentine Pampas. Many complementary strategies are proposed for validation of ABM's. We adopted a validation framework that relies on two main streams: (a) validation of model processes and components during model development, which involved a literature survey, design based on similar models, involvement of stakeholders, and focused test scenarios and (b) empirical validation, which involved comparisons of model outputs from multiple realistic simulations against real world data. The design process ensured a realistic model ontology and representative behavioral rules. As result, we obtained reasonable outcomes from a set of initial and simplified scenarios: the PM successfully reproduced the direction of the primary observed structural and land tenure patterns, even before calibration. The empirical validation process lead to tuning and further development of the PM. After this, the PM was able to reproduce not only the direction but also the magnitude of the observed changes. The main lesson from our validation process is the need for multiple validation strategies, including empirical validation. Approaches intended to validate model processes and components may lead to structurally realistic models. However, some kind of subsequent empirical validation is needed to assess the model's ability to reproduce observed results.

Original languageEnglish (US)
Pages (from-to)284-298
Number of pages15
JournalEcological Modelling
Volume273
DOIs
StatePublished - Feb 10 2014

Keywords

  • Agent-based model
  • Agriculture
  • Land tenure
  • Land use
  • Validation

ASJC Scopus subject areas

  • Ecological Modeling

Fingerprint Dive into the research topics of 'Lessons from a comprehensive validation of an agent based-model: The experience of the Pampas Model of Argentinean agricultural systems'. Together they form a unique fingerprint.

Cite this