A GPU cluster is a computer cluster in which each node is equipped with a Graphics Processing Unit

Graphics processing unit

A graphics processing unit or GPU is a specialized circuit designed to rapidly manipulate and alter memory in such a way so as to accelerate the building of images in a frame buffer intended for output to a display...

 (GPU). By harnessing the computational power of modern GPUs via General-Purpose Computing on Graphics Processing Units (GPGPU), very fast calculations can be performed with a GPU cluster.

Hardware (GPU)

The hardware classification of GPU clusters fall into two categories:
Heterogeneous and Homogeneous.

Heterogeneous

Hardware from both of the major IHV

Independent hardware vendor

An independent hardware vendor is a business term for companies specializing in making or selling computer hardware, usually for niche markets.-See also:*Independent software vendor*Software company...

's can be used (ATi and nVidia). Even if different models of the same GPU are used (e.g. 8800GT mixed with 8800GTX) the gpu cluster is considered heterogeneous.

Homogeneous

Every single GPU is of the same hardware class, make, and model. (i.e. a homogeneous cluster comprising 100 8800GTs, all with the same amount of VRAM

VRAM

Video RAM, or VRAM, is a dual-ported variant of dynamic RAM , which was once commonly used to store the framebuffer in some graphics adapters....

)

Classifying a GPU cluster according to the above semantics largely directs software development on the cluster, as different GPUs have different capabilities that can be utilized.

Hardware (Other)

Interconnect

In addition to the computer nodes and their respective GPUs, a fast enough interconnect is needed in order to shuttle data amongst the nodes. The type of interconnect largely depends on the number of nodes present. Some examples of interconnects include Gigabit Ethernet

Gigabit Ethernet

Gigabit Ethernet is a term describing various technologies for transmitting Ethernet frames at a rate of a gigabit per second , as defined by the IEEE 802.3-2008 standard. It came into use beginning in 1999, gradually supplanting Fast Ethernet in wired local networks where it performed...

 and InfiniBand

InfiniBand

InfiniBand is a switched fabric communications link used in high-performance computing and enterprise data centers. Its features include high throughput, low latency, quality of service and failover, and it is designed to be scalable...

.

Vendors

NVIDIA

NVIDIA

Nvidia is an American global technology company based in Santa Clara, California. Nvidia is best known for its graphics processors . Nvidia and chief rival AMD Graphics Techonologies have dominated the high performance GPU market, pushing other manufacturers to smaller, niche roles...

 provides a list of dedicated Tesla Preferred Partners (TPP) with the capability of building and delivering a fully configured GPU cluster using the NVIDIA® Tesla™ 20-series GPGPU processors. AMAX Information Technologies

AMAX Information Technologies

AMAX is a privately held, ISO 9001 certified, enterprise computing solutions company that provides custom-built servers, storage, clusters, workstations and various high performance computing systems for corporate, scientific, military, educational and governmental use.- Location & Facilities :In...

, Dell

Dell

Dell, Inc. is an American multinational information technology corporation based in 1 Dell Way, Round Rock, Texas, United States, that develops, sells and supports computers and related products and services. Bearing the name of its founder, Michael Dell, the company is one of the largest...

, Hewlett-Packard

Hewlett-Packard

Hewlett-Packard Company or HP is an American multinational information technology corporation headquartered in Palo Alto, California, USA that provides products, technologies, softwares, solutions and services to consumers, small- and medium-sized businesses and large enterprises, including...

 and Silicon Graphics

Silicon Graphics

Silicon Graphics, Inc. was a manufacturer of high-performance computing solutions, including computer hardware and software, founded in 1981 by Jim Clark...

 are some of the few companies that provides a complete line of GPU clusters and systems.

ATI

Ati

As a word, Ati may refer to:* Ati, a town in Chad* Ati, a Negrito ethnic group in the Philippines* Ati-Atihan Festival, an annual celebration held in the Philippines* Ati, a queen of the fabled Land of Punt in Africa...

 currently does not have a list of Preferred Partners. ATI Marketing has been contacted for confirmation as this information is being constantly updated

Software

The software components that are required to make many GPU-equipped machines act as one include:

1. Operating System
2. GPU driver for the each type of GPU present in each cluster node.
3. Clustering API (such as the Message Passing Interface
   Message Passing Interface
   Message Passing Interface is a standardized and portable message-passing system designed by a group of researchers from academia and industry to function on a wide variety of parallel computers...
   
   , MPI).
4. Virtual OpenCL (VCL) cluster platform http://www.MOSIX.org/txt_vcl.html.

Algorithm mapping

Mapping an algorithm to run a GPU cluster is somewhat similar to mapping an algorithm to run on a traditional computer cluster. Example: rather than distributing pieces of an array from RAM, a texture is divided up amongst the nodes of the GPU cluster.