Xmark93

Standardized benchmarking tool

Xmark93 is a standardized benchmarking tool for measuring the performance of computer systems running the X Window System. It was developed by the SPEC XPC group in 1993.

Xmark93 allows systems evaluators and vendors to compare the performance of X server/hardware systems for a broad set of X basic functions, covering a wide range of applications. The benchmark provides a standardized method for summarizing X11perf results, providing a single-number measure of overall X11 server/hardware performance.

Specifications

Xmark93 is derived by calculating the ratio between the geometrically weighted mean of the 447 individual X11perf tests for the server/hardware being evaluated and the corresponding results from a Sun Microsystems SPARCstation 1. Weightings for each of the X11perf tests were obtained by a survey of X11 technical experts. The weightings reflect the experts' ratings of the relative importance of individual X11perf operations within a wide mix of applications.

Processing benchmarks

Concepts

Free software
Proprietary software
Performance per watt
Data center infrastructure efficiency
Giga-updates per second (memory)
CPU power dissipation

Organizations

BAPCo consortium
EEMBC
Futuremark
Standard Performance Evaluation Corporation (SPEC)
Transaction Processing Performance Council (TPC)

Processor

Floating-point unit (FLOPS)	SPECfp LINPACK LAPACK Prime95 Super PI SuperPrime Whetstone IBM iSeries benchmarks (Computational Intensive Workload)
Integer (ALU)	Dhrystone Fhourstones SPECint CoreMark
Digital signal processor (DSP)	BTDi
Graphics processing unit (GPU)	BRL-CAD
Parallel computing	DEISA Benchmark Suite Livermore loops NAS Parallel Benchmarks HPC Challenge Benchmark Princeton Application Repository for Shared-Memory Computers (PARSEC)

Peripherals

Network	BreakingPoint Systems SUPS
Filesystems and storage	Bonnie++ HD Tach IOzone Diskspd
Computer memory	BSS Random Access benchmark HPC Challenge Random Memory Access
Input/output	Iometer Ioblazer IBM iSeries benchmarks (Commercial Processing Workload)

Computer system (entire)

Hierarchical INTegration (HINT)
NBench (CPU, memory)

Energy consumption

Software

JavaScript engine	Browser speed test
Cryptography	Cycles per byte
Multiuser system	SDET AIM Multiuser Benchmark
Virtual machine	VMmark SPECvirt
Physics engine	Physics Abstraction Layer API Bench
Recursion performance	Tak (function)
Database transactions	TATP Benchmark Transaction Processing over XML (TPoX) YCSB (NoSQL)
Web server benchmarking	Apache JMeter Curl-loader httperf OpenSTA TPC-W Tsung
X Window System	Xmark93