Phoronix Test Suite

Phoronix Test Suite

The Leading Software For Automated, Open-Source Testing & Benchmarking

Latest Release
Phoronix Test Suite 5.2.1-Khanino
11 July 2014

About

Phoronix The Phoronix Test Suite was developed out of the tools devleoped at Phoronix.com since its founding in 2004. The Phoronix Test Suite is designed for Linux benchmarking but also supports other operating systems. Read more about the Phoronix Test Suite.

OpenBenchmarking.org

OpenBenchmarking.org OpenBenchmarking.org was launched with Phoronix Test Suite 3.0 as a means of sharing benchmark results with the greater community, collectively collaborate over test results, store test profiles and test suites within a centralized cloud repository, and carry out other tests. Visit OpenBenchmarking.org to learn more.

Phoromatic

Phoromatic Phoromatic is an enterprise-designed component to the Phoronix Test Suite to centrally manage entire test farms/clusters of systems, carry out tests on a time or triggered basis, and provide support for other centralized test management purposes. Learn more at Phoromatic.com.

Commercial Support

Commercial Support The Phoronix Test Suite's future development is dependent upon the continued support from organizations and other stakeholders taking advantage of this long-standing, open-source benchmarking software. We are happy to offer custom engineering services, commercial support, sponsorship of new open-source software features, custom test profiles, and other commercial support options for those interested in helping advance this automated Linux benchmarking software. Contact us to learn more.

Phoronix Test Suite 1.8 Changes

Phoronix Test Suite 1.8.0 "Selbu"
April 6, 2009

- pts-core: Only emit a warning when the inputted test result file is associated with a different test/suite
- pts-core: Add AA/AF reporting to sub-titles on graphics for Graphics tests where levels are forced by driver
- pts-core: More robust detection of clock frequencies with ATI OverDrive
- pts-core: Fix a few PHP warnings
- pts-core: Fix regression in excess removal of spaces from strings in pts_trim_spaces()
- pts-core: Revise the installation interface for GTK2 GUI
- pts: Add favorites test suite
- pts: Allow c-ray test profile to have millisecond precision for test results
- pts: Update nexuiz test profile to Nexuiz 2.5.0
- pts_Graph: Add support for multiple sub-titles on graphs
- bilde_renderer: Support for using system default TTF fonts
- documentation: Update for Phoronix Test Suite 1.8

Phoronix Test Suite 1.8.0 Beta 2
March 26, 2009

- pts-core: Introduce pts_sensor infrastructure
- pts-core: Define PTS_LIBRARY_PATH, rename pts-core/functions/ to pts-core/library/
- pts-core: Small code clean-ups and optimizations
- pts-core: Fix launching of Phoronix Global from run_test option
- pts-core: Fix list-suites so that it will not show suites containing no supported tests
- pts-core: Use file-locking based system for determining whether another phoronix-test-suite instance is active
- pts-core: Use file-locking based system for test instances and drop pts_process_register(), pts_process_remove(), pts_process_active()
- pts-core: Move XSL for user-config.xml into ~/.phoronix-test-suite/xsl/
- pts-core: Support SearchMediaForCache on Mac OS X with /Volumes/ mount
- pts-core: Use the $PATH variable when looking for the downloading application to use in pts_download()
- pts-core: Add support on Mac OS X for reading enabled monitors with hw_gpu_enabled_monitors()
- pts-core: Add ReferenceSystems tag to XML profile specifications for tests and suites
- pts-core: Generate graphs if they are missing when running show-result on a saved file
- pts-core: Add support for being able to merge together test result files, but to only merge selected result sets / identifiers
- pts-core: Add reference-comparison option for comparing test results to available reference test systems on supported tests / suites
- pts-core: Add support to the GTK2 GUI for performing reference comparisons on test results and recently run tests
- pts-core: Add Archive Results item to menu on GTK2 GUI for backing up test results to a compressed file
- pts-core: Bring InstallationAgreement tag for EULA / license agreement handling at install time to Selbu branch
- pts-core: Make notebook page switching reliable on GTK2 GUI
- pts: Support build-mysql test profile on platforms besides Linux
- pts: Upgrade build-apache test profile to Apache 2.2.11
- pts: Upgrade build-imagemagick test profile to ImageMagick 6.5.0
- pts: Upgrade compress-7zip test profile to p7zip 4.65
- pts: Upgrade openssl test profile to OpenSSL 0.9.8k
- pts: Upgrade sqlite test profile to SQLite 3.6.11
- pts: Add povray test profile for POV-Ray benchmark
- pts: Add c-ray test profile for C-Ray ray-tracing benchmark
- pts: Add bwfirt test profile for another ray-tracing test
- pts: Add External Dependencies support to Intel Moblin by mirroring the Fedora dependencies
- bilde_renderer: With GD renderer don't crash when TTF support isn't available, fall back to the soft font renderer
- system_monitor: Rewrite system_monitor module to use pts_sensor infrastructure

Phoronix Test Suite 1.8.0 Beta 1
March 17, 2009

- pts-core: Add sample phoronix-test-suite.desktop file to pts-core/static/
- pts-core: Move short-description.txt to pts-core/static/
- pts-core: Add module_setup_validate() to pts_module_interface
- pts-core: Add menu mnemonics to GTK2 GUI
- pts-core: Few improvements to result-file-to-pdf writer
- pts-core: Add "drag and drop" benchmarking support of test result graphs on GTK2 GUI
- pts-core: Move Java version detection into pts-core
- pts-core: Move 2D acceleration type (UXA/XAA/EXA) detection into pts-core
- pts-core: Clean up some of the pts-includes-run code
- pts-core: Check for PHP binary in /usr/pkg/bin/
- pts-core: Add enhanced BSD support to pts_download()
- pts-core: Allow null input for test identifier (defaults to date/time stamp)
- pts-core: Split out some pts-includes-run code into pts-includes-run_setup and pts-includes-run_options
- pts-core: Add auto-disk-mount-points as an automatic identifier for providing mounted disk point locations to test profiles
- pts-core: Begin work on system tray support for GTK2 GUI
- pts-core: Un-globalize some functions that were included by default always but are only used in select cases
- pts-core: Introduce IgnoreRuns tag to test profile specification, to replace IgnoreFirstRun option
- pts-core: Drop support for read_ati_extension() since ATI OverDrive has been on Linux long enough now -- using read_ati_overdrive()
- pts-core: When launching browser, if konqueror is installed, use x-www-browser
- pts-core: Support inputting Global IDs for more test options
- pts-core: Drop P_CACHE_PTS_VERSION from pts-download-cache.xml specification
- pts: Add RETAIL to License type for test profiles
- pts: OpenAL fix for smokin-guns test profile when using newer Debian / Ubuntu
- pts: Update ffmpeg test profile to FFmpeg version 0.5
- pts: Allow alternate disks to be tested with sqlite test profile through auto-disk-mount-points option
- pts: Few trivial test profile tweaks
- pts: Drop tandem-xml and pts-graph test profiles
- pts: Drop no longer used php-gd and git from External Dependencies
- pts: Add External Dependencies support for PCLinuxOS
- pts: Add External Dependencies support for NetBSD
- pts: Add External Dependencies support for Debian through Ubuntu scripts
- pts: Fix for smokin-guns test with OpenAL and other work so that it runs cleanly on Ubuntu
- install-sh: Install Phoronix Test Suite icon

Phoronix Test Suite 1.8.0 Alpha 3
March 8, 2009

- pts-core: Introduce pts_gtk_window object
- pts-core: Move more of pts-core logic out of gui_gtk and into the generic GUI function set
- pts-core: When estimated the test's run-time but the test hasn't been installed or run yet, use the EstimatedLength tag from test profile
- pts-core: Override the LANG and LC_* environmental variables when running tests to not apply any language / locale settings to results
- pts-core: Rework PTS user agreement handling
- pts-core: Add support for prompting the PTS user agreement when running the GTK GUI
- pts-core: Move more test option prompting calculations to pts_test_option object
- pts-core: Implement test options within the GTK GUI
- pts-core: Add file-system detection support for SquashFS, AuFS, and UnionFS when running from a Live CD/DVD mode
- pts-core: Add in new option override support for the user-config.xml settings
- pts-core: Implement basic preferences window with batch mode options and more in GTK GUI
- pts-core: Allow pts_option_interface objects to provide a required_function_sets() function to load needed function sets
- pts-core: Add graph configuration options to preferences area
- pts-core: Set LC_NUMERIC locale within pts-core to "C"
- pts-core: Add is_module_setup() function to pts_module object
- pts-core: Quit testing prematurely if ~/.phoronix-test-suite/halt-testing is touched during the testing process
- pts-core: Add basic support for detecting the attached/enabled monitor name(s) in system information string
- pts-core: Move make download cache how-to into a static file
- pts-core: Remove RenderBorder tag from graph-config.xml scheme when there is already Border tag doing same thing
- pts-core: Start on Phoronix Global support for the GTK2 GUI
- pts: Add autoconf to PTS External Dependencies support
- pts: Add libtool to PTS External Dependencies support
- pts: Update vdrift test profile to VDrift 2009-02-15 and make the test profile work to verified state
- pts: Add EnvironmentSize tag to many more test profiles
- pts: Update prey test profile to use Prey Linux Installer 02192009
- bilde_renderer: Optimize what is outputted by the SVG renderer
- bilde_renderer: Add style definitions support to the SVG renderer that complies with the W3 CSS SVG styling specification

Phoronix Test Suite 1.8.0 Alpha 2
February 25, 2009

- pts-core: For alpha and beta builds using build-package-deb.php, separate version number with "~"
- pts-core: Improve Linux distribution detection for distributions that supply an empty *-release file (Such as Arch Linux)
- pts-core: Improve Linux distribution detection where there are multiple *-version or *-release files
- pts-core: Add support for KDE 3.5.x desktop detection that remains compatible with the KDE 4.x detection
- pts-core: Add pts_suite_name_to_identifier(), pts_suite_identifier_to_name(), pts_supported_suites_array()
- pts-core: Add various new functions to different pts_test_* objects
- pts-core: Add initial Phoronix Test Suite GTK GUI (launch: phoronix-test-suite gui-gtk)
- pts-core: Provide variable caching for more test functions
- pts-core: Provide more cache support throughout pts-core, with GUI it's evident what functions can use caching
- pts-core: Add pts_set_assignment_next() operator for setting assignments in the next option in the execution queue
- pts-core: Merge pts_test_result_info_details and pts_test_results_details into pts_test_result_details
- pts-core: Add MEDIA_DIR
- pts-core: Allow multiple periods to be used in command string when running a module command
- pts-core: Change format of several tags within graph-config.xml
- pts-core: From view menu allow to toggle showing tests of a particular license (free / non-free)
- pts: Various install.sh test script changes from Kano
- pts: Fix in nexuiz test installation script from Kano
- pts: Add PTS External Dependencies support for Arch Linux
- pts: Add PTS External Dependencies support for MEPIS by aliasing the Ubuntu external dependencies
- pts: Nexuiz test profile FPS calculation change
- pts: Update filesystem test suite
- pts_Graph: Allow path to a font file to be specified in FontType tag
- bilde_renderer: Add a GIF renderer back-end that uses the GD library (bilde_gif_renderer)
- bilde_renderer: Fix failure with bilde_renderer fallback renderer

Phoronix Test Suite 1.8.0 Alpha 1
February 16, 2009

- pts-core: Allow modules to be installed and loaded locally from ~/.phoronix-test-suite/modules/
- pts-core: Add support for "user run commands" stored within PTS modules
- pts-core: Rewrite test result merging code to use new pts_result_file_merge_manager and pts_result_file_merge_test objects
- pts-core: Allow an unlimited number of test result files to be merged at once using pts_merge_test_results() (compared to previous limit of 2)
- pts-core: Allow more than two test result files to be merged at once using the merge-results option
- pts-core: Setup PTS_PATH define for phoronix-test-suite directory
- pts-core: Don't reinstall a test only when the reported CPU frequency changes, but the CPU model remains the same
- pts-core: With result-file-to-pdf save the PDF to the home directory
- pts-core: Rename function files that aren't loaded by default to use pts-includes- prefix
- pts-core: Expand capabilities for pts_module_option
- pts-core: Save system logs when running in batch mode
- pts-core: Save system logs to system-logs/ instead of system-details/
- pts-core: Add fall-back support in OpenSolaris detection for CPU manufacturer when rest of processor detection fails
- pts-core: Don't prefix "-" to memory string before memory speed when memory type isn't detected
- pts-core: Drop OS_PREFIX support from beginning of test profile names, since it's not being used and there's better ways to handle it
- pts-core: Improve estimated run-time reporting when running multiple instances of the same test
- pts-core: When there is a local test profile installed, compare it to the in-PTS version and use whatever one is newer
- pts-core: When there is a local test suite installed, compare it to the in-PTS version and use whatever one is newer
- pts-core: Drop TYPE_LOCAL_BASE_TEST and TEST_RESOURCE_LOCAL_CTP_BASE_DIR
- pts-core: Remove SCTP (Self-Contained Test Profile) support until it's redesigned
- pts-core: Fix warnings related to array merging of non-arrays
- pts-core: Add $SYSTEM_MONITOR_START and $SYSTEM_MONITOR_STOP for system monitoring capabilities for test profiles
- pts-core: Add support for reading the CPU usage on OpenSolaris
- pts-core: Fix for recursively handling of nested suites for batch and default modes
- pts-core: Provide smarter caching during make-download-cache process
- pts-core: Don't show suites in list-suites that contain no supported tests
- pts-core: Improve multi-CPU detection support on OpenSolaris
- pts-core: Add Sun Studio compiler detection support
- pts-core: Add LLVM compiler detection support
- pts-core: Fix for generating download cache when destination is not writable
- pts-core: Use pts_Chart overview chart when using result-file-to-pdf
- pts-core: Don't copy XSL result viewer file on each time a graph is rendered
- pts-core: When running a PTS module command of .help with no function being implemented, list all available commands
- pts: Update compress-pbzip2 test profile to pbzip2 1.0.5
- pts: Update memory-bandwidth test profile to version 0.15
- pts: Nexuiz test profile doesn't need build-utilities
- pts: Add mesa test suite for graphics tests that should be compatible with the Mesa 3D drivers
- pts: Fix external dependencies typo in qgears2 test profile
- pts: Fix external dependencies typo in render-bench test profile
- pts: Add graphics-magick to nevada test profile
- pts: Start on OpenSolaris support for specviewperf9 and specviewperf10 test profiles
- pts: Add XSL stylesheet for PTS External Dependency XML files
- pts: Add XSL stylesheet for test suite XML specification
- pts: Add XSL stylesheet covering most of the XML test profile specification
- pts: Add XSL stylesheet for the user-config.xml file
- pts: Add Name tag to PTS External Dependency XML specification
- pts_Graph: Render an arrow to indicate graph proportion for higher or lower results being better
- pts_Graph: Add option to graph-config.xml for specifying the renderer to use by default
- pts_Graph: Add pts_Chart object for rendering charts
- bilde_renderer: Require and implement renderer_supported() function for renderers
- bilde_renderer: Require and implement html_embed_code() function to provide HTML markup for embedding the renderer's file