Toward a meta-grid middleware

Heithem Abbes, Christophe Cérin, Mohamed Jemni, Walid Saad

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Institutional Desktop Grid systems are attractive for running distributed applications with significant computational requirements. While the rapid increasing number of users and applications running on such systems does demonstrate the potential of Desktop Grid, current implementations follow the old-fashioned master-worker paradigm. Obviously, vulnerability to failures and permanent administrative monitoring are the disadvantages of clientserver architectures. Moreover, it is important to exploit existing computing systems in order to make a meta-grid middleware able to support any kind of applications. To bypass this, we propose a novel system, called BonjourGrid, able to orchestrate multiple instances of Institutional Desktop Grid middlewares, able to remove the risk of single-source bottleneck and failure, and able to guaranty the continuity of services in a distributed manner. We choose XtremWeb-CH, Boinc and Condor as computing systems in BonjourGrid. Thus, BonjourGrid can create a specific environment for each user based on XtremWeb-CH, Boinc or Condor. In addition, BonjourGrid can be adapted to fulfill all the requirements of a decentralized job scheduler. In this paper, we set experimentations using the threecited systems: Boinc, Condor and XtremeWeb-CH, in order to analyze the overhead generated by BonjourGrid and its capacity to manage multiple instances of Desktop Grid. The evaluation proves that BonjourGrid is able to manage more than 400 applications instantiated in a concurrent way on an Institutional Desktop Grid using more than 1000 machines. Analyzing the execution of 405 applications with 2110 tasks during 3 hours demonstrates the potential of BonjourGrid concept and shows that, comparing to a classical Desktop Grid, such as Condor, Boinc and XtremWeb-CH, with one central master, BonjourGrid gives an acceptable overhead.

Original languageEnglish
Pages (from-to)55-67
Number of pages13
JournalJournal of Internet Technology
Volume11
Issue number1
StatePublished - Apr 7 2010

Fingerprint

Middleware
Monitoring

Keywords

  • Desktop Grid
  • Meta Grid
  • Middleware
  • Resource management

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Software

Cite this

Abbes, H., Cérin, C., Jemni, M., & Saad, W. (2010). Toward a meta-grid middleware. Journal of Internet Technology, 11(1), 55-67.

Toward a meta-grid middleware. / Abbes, Heithem; Cérin, Christophe; Jemni, Mohamed; Saad, Walid.

In: Journal of Internet Technology, Vol. 11, No. 1, 07.04.2010, p. 55-67.

Research output: Contribution to journalArticle

Abbes, H, Cérin, C, Jemni, M & Saad, W 2010, 'Toward a meta-grid middleware', Journal of Internet Technology, vol. 11, no. 1, pp. 55-67.
Abbes H, Cérin C, Jemni M, Saad W. Toward a meta-grid middleware. Journal of Internet Technology. 2010 Apr 7;11(1):55-67.
Abbes, Heithem ; Cérin, Christophe ; Jemni, Mohamed ; Saad, Walid. / Toward a meta-grid middleware. In: Journal of Internet Technology. 2010 ; Vol. 11, No. 1. pp. 55-67.
@article{0cde294543fc4d41a0a74261e8d4fbf2,
title = "Toward a meta-grid middleware",
abstract = "Institutional Desktop Grid systems are attractive for running distributed applications with significant computational requirements. While the rapid increasing number of users and applications running on such systems does demonstrate the potential of Desktop Grid, current implementations follow the old-fashioned master-worker paradigm. Obviously, vulnerability to failures and permanent administrative monitoring are the disadvantages of clientserver architectures. Moreover, it is important to exploit existing computing systems in order to make a meta-grid middleware able to support any kind of applications. To bypass this, we propose a novel system, called BonjourGrid, able to orchestrate multiple instances of Institutional Desktop Grid middlewares, able to remove the risk of single-source bottleneck and failure, and able to guaranty the continuity of services in a distributed manner. We choose XtremWeb-CH, Boinc and Condor as computing systems in BonjourGrid. Thus, BonjourGrid can create a specific environment for each user based on XtremWeb-CH, Boinc or Condor. In addition, BonjourGrid can be adapted to fulfill all the requirements of a decentralized job scheduler. In this paper, we set experimentations using the threecited systems: Boinc, Condor and XtremeWeb-CH, in order to analyze the overhead generated by BonjourGrid and its capacity to manage multiple instances of Desktop Grid. The evaluation proves that BonjourGrid is able to manage more than 400 applications instantiated in a concurrent way on an Institutional Desktop Grid using more than 1000 machines. Analyzing the execution of 405 applications with 2110 tasks during 3 hours demonstrates the potential of BonjourGrid concept and shows that, comparing to a classical Desktop Grid, such as Condor, Boinc and XtremWeb-CH, with one central master, BonjourGrid gives an acceptable overhead.",
keywords = "Desktop Grid, Meta Grid, Middleware, Resource management",
author = "Heithem Abbes and Christophe C{\'e}rin and Mohamed Jemni and Walid Saad",
year = "2010",
month = "4",
day = "7",
language = "English",
volume = "11",
pages = "55--67",
journal = "Journal of Internet Technology",
issn = "1607-9264",
publisher = "Taiwan Academic Network Management Committee",
number = "1",

}

TY - JOUR

T1 - Toward a meta-grid middleware

AU - Abbes, Heithem

AU - Cérin, Christophe

AU - Jemni, Mohamed

AU - Saad, Walid

PY - 2010/4/7

Y1 - 2010/4/7

N2 - Institutional Desktop Grid systems are attractive for running distributed applications with significant computational requirements. While the rapid increasing number of users and applications running on such systems does demonstrate the potential of Desktop Grid, current implementations follow the old-fashioned master-worker paradigm. Obviously, vulnerability to failures and permanent administrative monitoring are the disadvantages of clientserver architectures. Moreover, it is important to exploit existing computing systems in order to make a meta-grid middleware able to support any kind of applications. To bypass this, we propose a novel system, called BonjourGrid, able to orchestrate multiple instances of Institutional Desktop Grid middlewares, able to remove the risk of single-source bottleneck and failure, and able to guaranty the continuity of services in a distributed manner. We choose XtremWeb-CH, Boinc and Condor as computing systems in BonjourGrid. Thus, BonjourGrid can create a specific environment for each user based on XtremWeb-CH, Boinc or Condor. In addition, BonjourGrid can be adapted to fulfill all the requirements of a decentralized job scheduler. In this paper, we set experimentations using the threecited systems: Boinc, Condor and XtremeWeb-CH, in order to analyze the overhead generated by BonjourGrid and its capacity to manage multiple instances of Desktop Grid. The evaluation proves that BonjourGrid is able to manage more than 400 applications instantiated in a concurrent way on an Institutional Desktop Grid using more than 1000 machines. Analyzing the execution of 405 applications with 2110 tasks during 3 hours demonstrates the potential of BonjourGrid concept and shows that, comparing to a classical Desktop Grid, such as Condor, Boinc and XtremWeb-CH, with one central master, BonjourGrid gives an acceptable overhead.

AB - Institutional Desktop Grid systems are attractive for running distributed applications with significant computational requirements. While the rapid increasing number of users and applications running on such systems does demonstrate the potential of Desktop Grid, current implementations follow the old-fashioned master-worker paradigm. Obviously, vulnerability to failures and permanent administrative monitoring are the disadvantages of clientserver architectures. Moreover, it is important to exploit existing computing systems in order to make a meta-grid middleware able to support any kind of applications. To bypass this, we propose a novel system, called BonjourGrid, able to orchestrate multiple instances of Institutional Desktop Grid middlewares, able to remove the risk of single-source bottleneck and failure, and able to guaranty the continuity of services in a distributed manner. We choose XtremWeb-CH, Boinc and Condor as computing systems in BonjourGrid. Thus, BonjourGrid can create a specific environment for each user based on XtremWeb-CH, Boinc or Condor. In addition, BonjourGrid can be adapted to fulfill all the requirements of a decentralized job scheduler. In this paper, we set experimentations using the threecited systems: Boinc, Condor and XtremeWeb-CH, in order to analyze the overhead generated by BonjourGrid and its capacity to manage multiple instances of Desktop Grid. The evaluation proves that BonjourGrid is able to manage more than 400 applications instantiated in a concurrent way on an Institutional Desktop Grid using more than 1000 machines. Analyzing the execution of 405 applications with 2110 tasks during 3 hours demonstrates the potential of BonjourGrid concept and shows that, comparing to a classical Desktop Grid, such as Condor, Boinc and XtremWeb-CH, with one central master, BonjourGrid gives an acceptable overhead.

KW - Desktop Grid

KW - Meta Grid

KW - Middleware

KW - Resource management

UR - http://www.scopus.com/inward/record.url?scp=77950303770&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77950303770&partnerID=8YFLogxK

M3 - Article

VL - 11

SP - 55

EP - 67

JO - Journal of Internet Technology

JF - Journal of Internet Technology

SN - 1607-9264

IS - 1

ER -