Sun Grid Engine

From Wikipedia, the free encyclopedia


Sun Grid Engine
GridEngine Logo
Developed by Sun Microsystems in association with the community
Latest release 6.1 update 4 / April 4, 2008
Preview release 6.2 Beta / May 13, 2008
OS Cross-platform
Genre Grid computing
License SISSL
Website gridengine.sunsource.net

Sun Grid Engine (SGE), previously known as CODINE (COmputing in DIstributed Networked Environments) or GRD (Global Resource Director),[1] is an open source batch-queuing system, supported by Sun Microsystems. Sun also sells a commercial product based on SGE, also known as N1 Grid Engine (N1GE).

SGE is typically used on a computer farm or computer cluster and is responsible for accepting, scheduling, dispatching, and managing the remote execution of large numbers of standalone, parallel or interactive user jobs. It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and software licenses.

SGE is the foundation of the Sun Grid utility computing system, made available over the Internet in the United States in 2006,[2] later becoming available in many other countries.

Contents

[edit] Features

A screenshot of the xml-qstat web interface.
A screenshot of the xml-qstat web interface.

Features of SGE 6.1 include:

  • Multiple advanced scheduling algorithms allow powerful policy-based resource allocation
  • Cluster queues
  • Job and scheduler fault tolerance
  • Job checkpointing
  • Job arrays and job tasks
  • DRMAA (Job API)
  • Resource reservation
  • XML status reporting (qstat and qhost), and the xml-qstat web interface
  • Parallel jobs (MPI, PVM, OpenMP), and scalable parallel job startup with qrsh [3]
  • Usage accounting
  • accounting and reporting (ARCO)
  • parallel make: distmake, dmake (Sun Studio), and SGE's own qmake
  • FLEXlm integration [4] and multi-cluster software license management with LicenseJuggler [5]

[edit] Upcoming features in version 6.2

  • Advance reservation
  • Array job interdependencies
  • Enhanced remote execution (without using external rshd/rlogind/sshd processes)
  • Multi-clustering [6]
  • Daemons managed by the Service Management Facility on Solaris

[edit] Platforms

SGE runs on multiple platforms, including:

[edit] Support and training

Sun provides support contracts [7] for the commercial version of Grid Engine on most UNIX platforms and Windows. Professional services, consulting, training, and support are also provided by Sun Partners. [8] Sun partners with Georgetown University to deliver Grid Engine administration classes.[9] The Bioteam runs short SGE training workshops that are 1 or 2 days long.[10]

Users can get community support on the Grid Engine mailing lists.[11]

Grid Engine Workshops were held in 2002, 2003, and 2007 in Regensburg, Germany.[12]

[edit] Prominent users

Notable deployments of SGE include:

[edit] History

In 2000, Sun acquired Gridware, Inc. a privately owned commercial vendor of advanced computing resource management software with offices in San Jose, Calif., and Regensburg, Germany.[16] Later that year, Sun offered a free version of Gridware for Solaris and Linux, and renamed the product Sun Grid Engine.

In 2001, Sun made the source code available,[17] and adopted the open source development model. Ports for Mac OS X and *BSD were contributed by the non-Sun open source developers.

[edit] Other Grid Engine based products

[edit] Add-on software

A number of SGE add-ons are available:

[edit] References

  1. ^ A Little History Lesson. Sun Microsystems (2006-06-23).
  2. ^ World's First Utility Grid Comes Alive on the Internet. Sun Microsystems (2006-03-22).
  3. ^ Long delay when submitting large jobs (mailing list message). Sun Microsystems. Retrieved on 2007-12-25.
  4. ^ Olesen-FLEXlm-Integration. wiki.gridengine.info. Retrieved on 2007-12-25.
  5. ^ LicenseJuggler. wiki.gridengine.info. Retrieved on 2007-12-26.
  6. ^ Hedeby Project home. Sun Microsystems. Retrieved on 2008-01-25.
  7. ^ Sun Store Grid Engine Entitlement Purchase. Sun Microsystems. Retrieved on 2008-03-03.
  8. ^ Sun Grid Engine 6 Partners. Sun Microsystems. Retrieved on 2007-12-14.
  9. ^ Advanced Sun Grid Engine Configuration and Administration Class. Sun Microsystems. Retrieved on 2007-12-14.
  10. ^ Training. The Bioteam Inc.. Retrieved on 2008-03-24.
  11. ^ Grid Engine Mail Lists. Sun Microsystems. Retrieved on 2008-01-23.
  12. ^ Grid Engine Workshops. Sun Microsystems. Retrieved on 2007-12-14.
  13. ^ Sun N1 Grid Engine Software and the Tokyo Institute of Technology Super Computer Grid. Sun Microsystems. Retrieved on 2007-11-16.
  14. ^ TACC > HPC Systems. The University of Texas at Austin. Retrieved on 2007-12-13.
  15. ^ More Ranger Facts and Figures. Sun Microsystems. Retrieved on 2008-02-12.
  16. ^ Gridware's resource management software increases efficiency and productivity in compute-intensive technical computing environments. Sun Microsystems (2000-07-24).
  17. ^ Sun Microsystems makes SUN GRID ENGINE software available to open source community. Sun Microsystems (2001-07-23).
  18. ^ Sun Grid Engine, a new scheduler for EGEE middleware. Imperial College (2000-12-29).
  19. ^ Installing and Configuring Sun Cluster HA for Sun Grid Engine. Sun Microsystems (2008-02-15).

[edit] See also

[edit] External links