Phoronix Test Suite

An Automated, Open-Source Testing Framework

Latest Release: Phoronix Test Suite 5.0.1

Home Downloads Features Documentation Contact OpenBenchmarking.org Forum Support

Open-Source Benchmarking

The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. The software is designed to effectively carry out both qualitative and quantitative benchmarks in a clean, reproducible, and easy-to-use manner.

The Phoronix Test Suite is based upon the extensive testing and internal tools developed by Phoronix.com since 2004 along with support from leading tier-one computer hardware and software vendors. This software is open-source and licensed under the GNU GPLv3.

Originally developed for automated Linux testing, support to the Phoronix Test Suite has since been added for OpenSolaris, Apple Mac OS X, Microsoft Windows, and BSD operating systems. The Phoronix Test Suite consists of a lightweight processing core (pts-core) with each benchmark consisting of an XML-based profile and related resource scripts. The process from the benchmark installation, to the actual benchmarking, to the parsing of important hardware and software components is heavily automated and completely repeatable, asking users only for confirmation of actions.

The Phoronix Test Suite interfaces with OpenBenchmarking.org as a collaborative web platform for the centralized storage of test results, sharing of test profiles and results, advanced analytical features, and other functionality. Phoromatic is an enterprise component to orchestrate test execution across multiple systems with remote management capabilities.

Software Features

  1. Runs On Linux, Solaris, Mac OS X, Windows & BSD Operating Systems
  2. Extensible Testing Architecture
  3. Embedded To Cloud Scale
  4. 450+ Test Profiles
  5. 100+ Test Suites
  6. Automated Batch Mode Support
  7. Automated Test Downloading & Installation
  8. Dependency Management Support
  9. Module-based Plug-In Architecture
  10. Minimum / Average / Maximum Result Reporting
  11. Standard Deviation Monitoring & Insurance
  12. PNG, SVG Graph Rendering Support
  13. PDF Result Reports
  14. Detailed Software, Hardware Detection
  15. System Monitoring Support
  16. Commercial Support& Custom Engineering Available

OpenBenchmarking.org Features

  1. Global Database For Result Uploads, Benchmark Comparisons
  2. Side-by-Side Results Comparisons
  3. Performance Classifications
  4. Crowd-Sourced Aggregated Results Analysis

Phoromatic Features

  1. Conduct Tests Across Multiple Systems On A Schedule Basis
  2. Per-Commit Git Testing
  3. Multi-System Support
  4. Turn-Key Deployment
  5. Remote Testing

Overview

The Phoronix Test Suite can be used for simply comparing your computer's performance with your friends and colleagues or can be used within your organization for internal quality assurance purposes, hardware validation, and continuous performance management.

The Phoronix Test Suite has received widespread adoption and is used by numerous technical publications for facilitating hardware performance comparisons, is used by nearly every tier-one independent hardware vendor (IHV), is depended upon by software projects for monitoring the performance of their active code-base and the monitoring of regressions, and is used by many other Fortune 500 companies and other global organizations for various purposes.

Other ways the Phoronix Test Suite has been used within real-world applications include stressing a system's different sub-systems, financial institutions and trading firms using the framework for finding software/hardware that offer the peak performance combination as to maximize their transactions, and hardware vendors using it for driver performance management. The Phoronix Test Suite can be adapted to run on platforms ranging from smartphones and personal computers to multi-core workstations and cloud computing infrastructures.

About

The Phoronix Test Suite was conceived out of the internal tools developed by Phoronix Media over the years of operating Phoronix.com, one of the first Linux-based hardware review web-sites and is now the largest provider of Linux software and hardware benchmarks on the Internet. Phoronix launched in June of 2004 and in mid 2007 is when work on the public version of Phoronix Test Suite commenced. The lead developer of the Phoronix Test Suite is Michael Larabel, the founder of Phoronix. Matthew Tippett, formerly the Linux Core Engineering Manager of Advanced Micro Devices (AMD), is a Phoronix Test Suite partner and shares responsibility for the overall direction of the test suite.

Many independent hardware and software vendors have also provided feedback, patches, and other forms of support to the development of the Phoronix Test Suite. More than two dozen different corporations and individuals have directly contributed to the development of this software. Phoronix Media remains the key sponsor and entity behind the development of the Phoronix Test Suite with it striving to make Linux benchmarking incredibly robust and innovative, very easy to perform nearly any kind of benchmark, and when it out-paces other leading operating systems for its benchmarking abilities. Phoronix Media provides commercial services and custom engineering for the long-term sustainability of this open-source software product.

While the internal Linux testing tools at Phoronix began as just a simple set of scripts many years ago, the Phoronix Test Suite has evolved into becoming a one-of-a-kind, feature-rich framework and a software package that is unique regardless of platform for its capabilities and openness. Vendors no longer need to rely upon their own engineers to develop in-house utilities to accomplish their internal testing needs whatever they may be for computer hardware or software, but they are able to leverage this extensible platform that provides a greater feature-set while lowering their costs.

The Phoronix Test Suite has received many awards and accolades for its features and capabilities. Various milestones are shared on the press page and release history.