3G Bridge
Encyclopedia
The Generic Grid-Grid Bridge is an open-source core job bridging component between different grid
infrastructures. Its development started in 2008 within the CancerGrid and EDGeS projects. The
aim was to create a generic bridge component that can be used in different grid interoperability
scenarios. The 3G Bridge used within the EDGeS project that provides the core component of the Service Grid - Desktop Grid interoperability solution. 3G Bridge helps to connect user communities of different grid systems. For example communities working on parameter sweep problems (physics, biologists, ...) and using service grid infrastructures can migrate their applications to the more adequate desktop grid platform using the 3G Bridge technology, resulting in an accelerated research.
The project, started in 2008, is technically coordinated by Prof. Peter Kacsuk
, head of the Laboratory of Parallel and Distributed Systems and Msc.Zoltan Farkas
, research leader of LPDS at MTA
-SZTAKI, Hungary.
technology between service and desktop grids. 3G Bridge enables interconnecting different grid technologies by migrating jobs between them. This way it allows to move specific type of applications to an adequate execution platform, and enables load sharing among different grid infrastructures, resulting in increased job capacity and faster execution.
The 3G Bridge has the following main components:
• Job Handler Interface: this is a very simple MySQL interface for handling jobs in the 3G
Bridge Job Database. Can be used by local MySQL clients, or a very simple application
shipped with the 3G Bridge called 'injector'.
• WSSubmitter: this is a Web Service interface above the 3G Bridge Job Database. Using this
interface, remote clients can add jobs to the 3G Bridge for execution, or check the status of
already submitted ones.
• 3G Bridge Job Database: this is a MySQL database that contains the set of jobs the 3G
Bridge should handle. Important properties of the jobs, like executable name, command-line
arguments, list of files used is stored within the database.
• Download Manager: this component is responsible for fetching the input files belonging to
jobs submitted in a remote manner.
• Queue Manager: this component arranges the execution and management of 3G Bridge jobs,
periodically calls the different grid plugins in order to manage jobs assigned to them.
• Grid Handler Interface: this is a generic interface above the grid plugins. By using this
generic layer, no 3G Bridge components other than the grid plugins must contain grid-
specific code. The methods a grid plugin should implement is: submission and status update.
• Grid Plugin: grid plugins are responsible for managing jobs in destination grids. For each
plugin, there can be a number of instances, for example for submitting jobs to different
EGEE VOs. The 3G Bridge supports the following grids: EGEE, BOINC, XtremWeb-HEP,
and OurGrid.
• HTTPD: is a web server so remote clients can fetch output files of finished jobs from the 3G
Bridge server.
The main programming language is C++, however 3G Bridge supports implementing grid plugins
in Java. The project's development is hosted at SourceForge: http://edges-3g-bridge.sf.net/. Web
service interfaces are implemented using gSOAP (http://www.cs.fsu.edu/~engelen/soap.html).
afterwards.
grid.. This plugin is mainly used in the EDGI project.
submitting job batches to the BOINC server. The batch feature enables packing many
short-running jobs into one BOINC workunit, resulting in increased computation-to-
communication ratio.
is extensively used within the DEGISCO project, solving bridging BOINC workunits to
gLite.
plugin is actively used within the EDGI project.
UNICORE.
infrastructures. Its development started in 2008 within the CancerGrid and EDGeS projects. The
aim was to create a generic bridge component that can be used in different grid interoperability
scenarios. The 3G Bridge used within the EDGeS project that provides the core component of the Service Grid - Desktop Grid interoperability solution. 3G Bridge helps to connect user communities of different grid systems. For example communities working on parameter sweep problems (physics, biologists, ...) and using service grid infrastructures can migrate their applications to the more adequate desktop grid platform using the 3G Bridge technology, resulting in an accelerated research.
The project, started in 2008, is technically coordinated by Prof. Peter Kacsuk
Péter Kacsuk
Prof. Dr. Péter Kacsuk, PhD DSc, is a Hungarian computer scientist at MTA-SZTAKI, Budapest, Hungary.- Biography :Péter Kacsuk received his MSc and university doctorate degrees from the Technical University of Budapest, Hungary in 1976 and 1984, respectively. He received the Kandidat degree from...
, head of the Laboratory of Parallel and Distributed Systems and Msc.Zoltan Farkas
Zoltán Farkas
Zoltán Farkas is a Hungarian football player who currently plays for Vasas SC.-References:* *...
, research leader of LPDS at MTA
Hungarian Academy of Sciences
The Hungarian Academy of Sciences is the most important and prestigious learned society of Hungary. Its seat is at the bank of the Danube in Budapest.-History:...
-SZTAKI, Hungary.
Architecture
3G Bridge is currently actively used in the EDGI and DEGSICO projects as the job bridgingtechnology between service and desktop grids. 3G Bridge enables interconnecting different grid technologies by migrating jobs between them. This way it allows to move specific type of applications to an adequate execution platform, and enables load sharing among different grid infrastructures, resulting in increased job capacity and faster execution.
The 3G Bridge has the following main components:
• Job Handler Interface: this is a very simple MySQL interface for handling jobs in the 3G
Bridge Job Database. Can be used by local MySQL clients, or a very simple application
shipped with the 3G Bridge called 'injector'.
• WSSubmitter: this is a Web Service interface above the 3G Bridge Job Database. Using this
interface, remote clients can add jobs to the 3G Bridge for execution, or check the status of
already submitted ones.
• 3G Bridge Job Database: this is a MySQL database that contains the set of jobs the 3G
Bridge should handle. Important properties of the jobs, like executable name, command-line
arguments, list of files used is stored within the database.
• Download Manager: this component is responsible for fetching the input files belonging to
jobs submitted in a remote manner.
• Queue Manager: this component arranges the execution and management of 3G Bridge jobs,
periodically calls the different grid plugins in order to manage jobs assigned to them.
• Grid Handler Interface: this is a generic interface above the grid plugins. By using this
generic layer, no 3G Bridge components other than the grid plugins must contain grid-
specific code. The methods a grid plugin should implement is: submission and status update.
• Grid Plugin: grid plugins are responsible for managing jobs in destination grids. For each
plugin, there can be a number of instances, for example for submitting jobs to different
EGEE VOs. The 3G Bridge supports the following grids: EGEE, BOINC, XtremWeb-HEP,
and OurGrid.
• HTTPD: is a web server so remote clients can fetch output files of finished jobs from the 3G
Bridge server.
The main programming language is C++, however 3G Bridge supports implementing grid plugins
in Java. The project's development is hosted at SourceForge: http://edges-3g-bridge.sf.net/. Web
service interfaces are implemented using gSOAP (http://www.cs.fsu.edu/~engelen/soap.html).
Destination plugins
- Null: the simplest plugin which first sets incoming job's status to running, and finished
afterwards.
- DC-API-Single: this plugin can be used to submit individual jobs to a BOINC-based desktop
grid.. This plugin is mainly used in the EDGI project.
- DC-API: this plugin is an enhanced version of the DC-API-Single plugin, capable of
submitting job batches to the BOINC server. The batch feature enables packing many
short-running jobs into one BOINC workunit, resulting in increased computation-to-
communication ratio.
- EGEE: the EGEEEgeeEgee was a mythical Libyan queen, known in ancient Greece. Legend says she commanded an army of Amazon women warriors that traveled from Libya to Asia Minor to fight at Troy. Little else is known about her.-References:...
plugin can be used to submit jobs to gLite-based service grids. This plugin
is extensively used within the DEGISCO project, solving bridging BOINC workunits to
gLite.
- XtremWeb: this plugin can be used to submit jobs to XtremWeb-based desktop grids. The
plugin is actively used within the EDGI project.
- BES: the BES plugin can be used to submit jobs to OGSA BES resources, like ARC or
UNICORE.
- EC2: this plugin can be used to execute jobs on different Cloud systems.
External links
- Grid ComputingGrid computingGrid computing is a term referring to the combination of computer resources from multiple administrative domains to reach a common goal. The grid can be thought of as a distributed system with non-interactive workloads that involve a large number of files...
- Web 2.0Web 2.0The term Web 2.0 is associated with web applications that facilitate participatory information sharing, interoperability, user-centered design, and collaboration on the World Wide Web...
- MTA SZTAKI Laboratory of Parallel and Distributed SystemsMTA SZTAKI Laboratory of Parallel and Distributed SystemsThe Laboratory of Parallel and Distributed Systems is part of the Autonomous Research Division , one of the three main divisions of the Computer and Automation Research Institute of the Hungarian Academy of Sciences....
- WebComputing
- CancerGrid: www.cancergrid.eu
- EDGeS: www.edges-grid.eu
- MySQLMySQLMySQL officially, but also commonly "My Sequel") is a relational database management system that runs as a server providing multi-user access to a number of databases. It is named after developer Michael Widenius' daughter, My...
: www.mysql.com - EGEEEgeeEgee was a mythical Libyan queen, known in ancient Greece. Legend says she commanded an army of Amazon women warriors that traveled from Libya to Asia Minor to fight at Troy. Little else is known about her.-References:...
/gLiteGLitegLite is a middleware computer software project for grid computing used by the CERN LHC experiments and other scientific domains. It was implemented by collaborative efforts of more than 80 people in 12 different academic and industrial research centers in Europe...
: glite.cern.ch - BOINC: boinc.berkeley.edu
- XtremWeb: www.xtremweb.net
- ARCARCARC may refer to:- Business :* African Rainforest Conservancy, an environmental nonprofit* Airport Regions Conference, a European organization of major airports* Amalgamated Roadstone Corporation, a British stone quarrying company...
: www.nordugrid.org - UNICOREUNICOREUNICORE is a Grid computing technology that provides seamless, secure, and intuitive access to distributed Grid resources such as supercomputers or cluster systems and information stored in databases. UNICORE was developed in two projects funded by the German ministry for education and research...
: www.unicore.eu