VMmark
Encyclopedia
VMmark is a freeware virtual machine
benchmark
software suite from VMware
, Inc., a division of EMC Corporation
. The suite measures the performance of virtualized servers while running under load on a set of physical hardware. VMmark was independently developed by VMware.
- the suite must run several virtual machines (VMs) simultaneously. Each VM is configured according to a template, three of which are provided with the VMmark software. The templates mimic typical software applications found in corporate data center
s, such as email server
s, database server
s, and Web server
s. The VMmark software collects performance statistics that are relevant to each type of application, such as commits per second for database servers, or page accesses per second for web servers.
VMs are grouped into logical units called "tiles". When evaluating a system's performance, the VMmark software first calculates a score for each tile, culled from the performance statistics produced by each VM, and aggregates the per-tile scores into a final number.
and proprietary software
in its virtual machine templates, such as Apache HTTP Server
for Web servers and Microsoft Exchange Server
for email servers.
, Hewlett-Packard
, IBM
, and Sun Microsystems
) have submitted VMmark benchmark results to VMware. Additionally, Dell and Sun have separately published whitepapers with VMmark results obtained on their respective computer systems. SWsoft
, one of VMware's competitors in the x86 virtualization
market, has levied criticisms against VMmark regarding the realism of the simulated workloads and the choice of software platforms.
By October 2009 that had increased to 10 vendors (HP, NEC, IBM, Unisys, Sun, Dell, Inspur
, Lenovo, Fujitsu and Cisco)
Virtual machine
A virtual machine is a "completely isolated guest operating system installation within a normal host operating system". Modern virtual machines are implemented with either software emulation or hardware virtualization or both together.-VM Definitions:A virtual machine is a software...
benchmark
Benchmark (computing)
In computing, a benchmark is the act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it...
software suite from VMware
VMware
VMware, Inc. is a company providing virtualization software founded in 1998 and based in Palo Alto, California, USA. The company was acquired by EMC Corporation in 2004, and operates as a separate software subsidiary ....
, Inc., a division of EMC Corporation
EMC Corporation
EMC Corporation , a Financial Times Global 500, Fortune 500 and S&P 500 company, develops, delivers and supports information infrastructure and virtual infrastructure hardware, software, and services. EMC is headquartered in Hopkinton, Massachusetts, USA.Former Intel executive Richard Egan and his...
. The suite measures the performance of virtualized servers while running under load on a set of physical hardware. VMmark was independently developed by VMware.
Technical overview
In order to measure the efficiency of the virtualization layer - the hypervisorHypervisor
In computing, a hypervisor, also called virtual machine manager , is one of many hardware virtualization techniques that allow multiple operating systems, termed guests, to run concurrently on a host computer. It is so named because it is conceptually one level higher than a supervisory program...
- the suite must run several virtual machines (VMs) simultaneously. Each VM is configured according to a template, three of which are provided with the VMmark software. The templates mimic typical software applications found in corporate data center
Data center
A data center is a facility used to house computer systems and associated components, such as telecommunications and storage systems...
s, such as email server
Mail transfer agent
Within Internet message handling services , a message transfer agent or mail transfer agent or mail relay is software that transfers electronic mail messages from one computer to another using a client–server application architecture...
s, database server
Database server
A database server is a computer program that provides database services to other computer programs or computers, as defined by the client–server model. The term may also refer to a computer dedicated to running such a program...
s, and Web server
Web server
Web server can refer to either the hardware or the software that helps to deliver content that can be accessed through the Internet....
s. The VMmark software collects performance statistics that are relevant to each type of application, such as commits per second for database servers, or page accesses per second for web servers.
VMs are grouped into logical units called "tiles". When evaluating a system's performance, the VMmark software first calculates a score for each tile, culled from the performance statistics produced by each VM, and aggregates the per-tile scores into a final number.
Software components
VMmark uses a mixture of free/open sourceFree software
Free software, software libre or libre software is software that can be used, studied, and modified without restriction, and which can be copied and redistributed in modified or unmodified form either without restriction, or with restrictions that only ensure that further recipients can also do...
and proprietary software
Proprietary software
Proprietary software is computer software licensed under exclusive legal right of the copyright holder. The licensee is given the right to use the software under certain conditions, while restricted from other uses, such as modification, further distribution, or reverse engineering.Complementary...
in its virtual machine templates, such as Apache HTTP Server
Apache HTTP Server
The Apache HTTP Server, commonly referred to as Apache , is web server software notable for playing a key role in the initial growth of the World Wide Web. In 2009 it became the first web server software to surpass the 100 million website milestone...
for Web servers and Microsoft Exchange Server
Microsoft Exchange Server
Microsoft Exchange Server is the server side of a client–server, collaborative application product developed by Microsoft. It is part of the Microsoft Servers line of server products and is used by enterprises using Microsoft infrastructure products...
for email servers.
Industry reception
, four computer system vendors (Dell ComputerDell
Dell, Inc. is an American multinational information technology corporation based in 1 Dell Way, Round Rock, Texas, United States, that develops, sells and supports computers and related products and services. Bearing the name of its founder, Michael Dell, the company is one of the largest...
, Hewlett-Packard
Hewlett-Packard
Hewlett-Packard Company or HP is an American multinational information technology corporation headquartered in Palo Alto, California, USA that provides products, technologies, softwares, solutions and services to consumers, small- and medium-sized businesses and large enterprises, including...
, IBM
IBM
International Business Machines Corporation or IBM is an American multinational technology and consulting corporation headquartered in Armonk, New York, United States. IBM manufactures and sells computer hardware and software, and it offers infrastructure, hosting and consulting services in areas...
, and Sun Microsystems
Sun Microsystems
Sun Microsystems, Inc. was a company that sold :computers, computer components, :computer software, and :information technology services. Sun was founded on February 24, 1982...
) have submitted VMmark benchmark results to VMware. Additionally, Dell and Sun have separately published whitepapers with VMmark results obtained on their respective computer systems. SWsoft
SWsoft
SWsoft was a privately held server automation and virtualization software company and the parent company of Parallels, Inc. SWsoft developed software for running data centers, particularly for web-hosting services companies, application service providers, and managed service providers...
, one of VMware's competitors in the x86 virtualization
X86 virtualization
In computing, x86 virtualization is the facility that allows multiple operating systems to simultaneously share x86 processor resources in a safe and efficient manner, a facility generically known as hardware virtualization...
market, has levied criticisms against VMmark regarding the realism of the simulated workloads and the choice of software platforms.
By October 2009 that had increased to 10 vendors (HP, NEC, IBM, Unisys, Sun, Dell, Inspur
Inspur
Inspur, formerly named Langchao, is a Chinese computer technology company famous for its PC server and software products....
, Lenovo, Fujitsu and Cisco)
External links
- VMmark product page - VMware, Inc.
- VMmark white paper - VMware, Inc.
- Virtualization committee - SPEC