On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure

Jason Maassen, Ben van Werkhoven, Maarten van Meersbergen, Henri E. Bal, Michael Kliphuis, Sandra E. Brunnabend, Henk A. Dijkstra, Gerben van Malenstein, Migiel de Vos, Sylvia Kuijpers, Sander Boele, Jules Wolfrat, Nick Hill, David Wallom, Christian Grimm, Dieter Kranzlmüller, Dinesh Ganpathi, Shantenu Jha, Yaakoub El Khamra, Frank O. BryanBenjamin Kirtman, Frank J. Seinstra

Research output: Contribution to journalArticle

2 Scopus citations

Abstract

In Autumn 2013, we-an international team of climate scientists, computer scientists, eScience researchers, and e-Infrastructure specialists-participated in the enlighten your research global competition, organized to showcase advanced lightpath technologies in support of state-of-the-art research questions. As one of the winning entries, our enlighten your research global team embarked on a very ambitious project to run an extremely high resolution climate model on a collection of supercomputers distributed over two continents and connected using an advanced 10 G lightpath networking infrastructure. Although good progress was made, we were not able to perform all desired experiments due to a varying combination of technical problems, configuration issues, policy limitations and lack of (budget for) human resources to solve these issues. In this paper, we describe our goals, the technical and non-technical barriers, we encountered and provide recommendations on how these barriers can be removed so future project of this kind may succeed.

Original languageEnglish (US)
JournalConcurrency Computation Practice and Experience
DOIs
StateAccepted/In press - 2016

    Fingerprint

Keywords

  • Distributed cyberinfrastructure
  • Global climate modeling
  • Lightpaths

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Software
  • Computational Theory and Mathematics
  • Theoretical Computer Science

Cite this

Maassen, J., van Werkhoven, B., van Meersbergen, M., Bal, H. E., Kliphuis, M., Brunnabend, S. E., Dijkstra, H. A., van Malenstein, G., de Vos, M., Kuijpers, S., Boele, S., Wolfrat, J., Hill, N., Wallom, D., Grimm, C., Kranzlmüller, D., Ganpathi, D., Jha, S., Khamra, Y. E., ... Seinstra, F. J. (Accepted/In press). On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure. Concurrency Computation Practice and Experience. https://doi.org/10.1002/cpe.3853