Benchmark testing is a reference point that contains a set of standards or metrics against which a product or a service is assessed. Benchmark testing is considered part of the Software Development Life Cycle (SDLC) in which testing creates a standard of the software delivered that is set across an organization. The software is checked against requirements like performance standards that include product behavior, speed, functionality, stability, scalability, reliability, load capacity, etc. It mainly focuses on the present and future releases of the software to ensure high-quality standards.

Phoronix Test Suite

The Phoronix Test Suite is a complete testing and benchmarking platform, with an expandable foundation that allows for the easy addition of additional tests. It reports detailed information about installed system software and hardware. The Phoronix Test Suite takes care of the whole process from dependency management to test download/installation, execution, and result aggregation which makes it easy to use. Most of the time it just requires one to run a command like phoronix-test-suite and the rest is done by the Suite.

With Phoronix Test Suite it is easy to compare side-by-side performance and result comparisons with your friends or associates across the Internet. There are over 90 commands that are accessible via the Phoronix Test Suite command line. It is not limited to running tests but also analyzing test results, merging multiple test sets, easily building new test suites, and validating test profiles. It is Free and Open-source with a low cost if you want to deploy the Phoromatic server within an intranet. They also offer other custom services to enterprise clients.

Features

  • Easy to Use makes the process of carrying out automated tests incredibly simple.
  • Extensible Architecture with access to more than 450 test profiles and over 100 test suites via OpenBenchmarking.org. 
  • Cost Savings – The Phoronix Test Suite is open-source and licensed under the GNU GPL.
  • System Monitoring – Log in real-time various system sensors like the CPU temperature and the battery power consumption.
  • Statistical accuracy ensures a test is executed additional times to ensure the reported result is accurate.
  • Cross-Platform with support on popular OS like Linux, Solaris, Mac OS X, Windows, Hurd, and BSD operating systems.
  • Phoromatic Tracker is an extension that allows the tracking of a code-base / system for any performance regression.

This guide will show you how to Benchmark Windows 11 / Windows 10 using Phoronix Test Suite.

Prerequisites

You should have PHP installed on your system.

Install Phoronix Test Suite on Windows 11 / Windows 10

Download the latest features for the Phoronix Test Suite from the Downloads page.

Extract the zip file to get something similar to the file below.

Click on the install.bat file. This will create a folder called phoenix-test-suite in the C:\ directory. Copy the extracted files to that folder, then you can also rename the folder for easier access.

Open the command prompt as an administrator. Then change the path to the folder with phoronix-test-suite. I renamed the folder to PTS.

\> cd PTS

Then start the service with the following command:

\PTS> phoronix-test-suite

This will install additional files including Cygwin from the internet.

Running the command again would give you an output similar to the one below.

\PTS> phoronix-test-suite
Starting the Phoronix Test Suite
Phoronix Test Suite v10.8.4

The **Phoronix Test Suite** is the most comprehensive testing and benchmarking platform available for Linux, Solaris, macOS, Windows, and BSD operating systems. The Phoronix Test Suite allows for carrying out tests in a fully automated manner from test installation to execution and reporting. All tests are meant to be easily reproducible, easy-to-use, and support fully automated execution. The Phoronix Test Suite is open-source under the GNU GPLv3 license and is developed by Phoronix Media in cooperation with partners.

View the included documentation or visit https://www.phoronix-test-suite.com/ for full details.

........
........

Run the following command to get system information. This shows your Operating system, Memory, Processor, and other system information-related features.

\PTS> phoronix-test-suite system-info

PROCESSOR:              Intel 6 Model 58 Stepping 9
    Core Count:           4
    Core Family:          Ivy Bridge

  GRAPHICS:
    Screen:               x

  MOTHERBOARD:

  MEMORY:

  DISK:                   221GB
    File-System:          Unknown

  OPERATING SYSTEM:       Microsoft Windows [Version 10.0.19044.1826]
    Kernel:               10.0 (x86_64)
    Security:             __user pointer sanitization: Disabled
                          + Retpoline: Full
                          + IBPB: Always
                          + IBRS: Enabled
                          + STIBP: Enabled
                          + KPTI Enabled: Yes
                          + PTE Inversion: Yes

Run the following command to list the available tests.

\PTS> phoronix-test-suite list-all-tests
Starting the Phoronix Test Suite
Phoronix Test Suite v10.8.4
Available Tests

windows/apptimer          AppTimer                             System
windows/diskspd           Diskspd                              Disk
windows/euler3d           Euler3D                              System
windows/hdtunepro         HD Tune Pro                          Disk
windows/openssl           OpenSSL                              Processor
windows/passmark          PassMark PerformanceTEST             System
windows/pcmark10          PCMark 10                            System
windows/redis             Redis                                System
windows/winsat            WinSAT                               System
pts/aircrack-ng           Aircrack-ng                          Processor
pts/aobench               AOBench                              Processor
pts/appleseed             Appleseed                            System
pts/asmfish               asmFish                              Processor
pts/astcenc               ASTC Encoder                         System
pts/avifenc               libavif avifenc                      Processor
pts/basemark              Basemark GPU                         System
pts/basis                 Basis Universal                      System
pts/bioshock-infinite     BioShock Infinite                    Graphics
pts/blake2                BLAKE2                               Processor
pts/blender               Blender                              System
pts/blogbench             BlogBench                            Disk
pts/c-ray                 C-Ray                                Processor
.......
.......

To list the tests compatible with your OS, use the following command.

\PTS> phoronix-test-suite list-recommended-tests
Starting the Phoronix Test Suite
Phoronix Test Suite v10.8.4
Recommended OpenBenchmarking.org Test Profiles


Processor Tests


pts/x264          x264
pts/compress-7zip 7-Zip Compression
pts/encode-flac   FLAC Audio Encoding
pts/blake2        BLAKE2
pts/primesieve    Primesieve
pts/stockfish     Stockfish
pts/cpuminer-opt  Cpuminer-Opt
pts/dav1d         dav1d
pts/aircrack-ng   Aircrack-ng
pts/svt-av1       SVT-AV1
System Tests

pts/pgbench      PostgreSQL pgbench
pts/blender      Blender
system/selenium  Selenium
system/gimp      GIMP
pts/compress-rar RAR Compression
pts/v-ray        Chaos Group V-RAY
system/redis     Redis Memtier / Redis Benchmark
pts/astcenc      ASTC Encoder
pts/basis        Basis Universal
Graphics Tests

pts/xonotic     Xonotic
pts/csgo        Counter-Strike: Global Offensive
pts/dota2       Dota 2
pts/paraview    ParaView
pts/yquake2     yquake2
pts/gravitymark GravityMark
pts/ddnet       DDraceNetwork
pts/portal2     Portal 2
pts/quake2rtx   Quake II RTX
pts/hashcat     Hashcat
Network Tests

pts/ethr Ethr

Run Tests with Phoronix

To run a benchmark test without installing it first, use the following command.

\PTS> phoronix-test-suite run c-ray

To install a test, use the following command. I will install C-Ray, a simple raytracer designed to test the floating-point CPU performance.

\PTS> phoronix-test-suite install c-ray

To install and run a test altogether, use the following command. You can save the results, Enter the name of the file and description of the test.

\PTS> phoronix-test-suite benchmark c-ray
Starting the Phoronix Test Suite
 PROCESSOR:              Intel 6 Model 58 Stepping 9
    Core Count:           4
    Core Family:          Ivy Bridge

  GRAPHICS:
    Screen:               x

  MOTHERBOARD:

  MEMORY:

  DISK:                   221GB
    File-System:          Unknown

  OPERATING SYSTEM:       Microsoft Windows [Version 10.0.19044.1826]
    Kernel:               10.0 (x86_64)
    Security:             __user pointer sanitization: Disabled
                          + Retpoline: Full
                          + IBPB: Always
                          + IBRS: Enabled
                          + STIBP: Enabled
                          + KPTI Enabled: Yes
                          + PTE Inversion: Yes

    Would you like to save these test results (Y/n): Y
    Enter a name for the result file: CPU-test
    Enter a unique name to describe this test run / configuration: CPU-testing 
    If desired, enter a new description below to better describe this result set / system configuration under test.
Press ENTER to proceed without changes.

Current Description: Intel 6 Model 58 Stepping 9 testing on Microsoft Windows [Version 10.0.19044.1826] via the Phoronix Test Suite.

New Description:

C-Ray 1.1:
    pts/c-ray-1.2.0
    Test 1 of 1
    Estimated Trial Run Count:    3
    Estimated Time To Completion: 9 Minutes [20:39 UTC]
        Started Run 1 @ 20:31:47
        Started Run 1 @ 20:31:54
        Started Run 1 @ 20:32:01
     Do you want to view the text-based test results? (Y/n): Y
     CPU-test
Intel 6 Model 58 Stepping 9 testing on Microsoft Windows [Version 10.0.19044.1826] via the Phoronix Test Suite.

CPU-testing:

        Processor: Intel 6 Model 58 Stepping 9 (4 Cores), Disk: 221GB

        OS: Microsoft Windows [Version 10.0.19044.1826], Kernel: 10.0 (x86_64), File-System: Unknown, Screen Resolution: x

C-Ray 1.1

Seconds < Lower Is Better

      Would you like to upload the results to OpenBenchmarking.org (y/n): y
    Would you like to attach the system logs (lspci, dmesg, lsusb, etc) to the test result (y/n): y

    Results Uploaded To: https://openbenchmarking.org/result/2207253-NE-CPUTEST1102
    Do you want to launch OpenBenchmarking.org (Y/n):Y

The website opens as shown below.

Run tests in Batch Mode

You can also run tests in the Phoronix Test Suite batch mode.

Run the following command to set up batch mode which will configure the batch mode options for the Phoronix Test Suite.

\PTS> phoronix-test-suite batch-setup
Starting the Phoronix Test Suite
    Save test results when in batch mode (Y/n): Y
    Open the web browser automatically when in batch mode (y/N):N
    Auto upload the results to OpenBenchmarking.org (Y/n):N
    Prompt for test identifier (Y/n):Y
    Prompt for test description (Y/n):Y
    Prompt for saved results file-name (Y/n):Y
    Run all test options (Y/n):Y

Batch settings saved.

To install tests in batch mode but not run them, use the batch-install command.

\PTS> phoronix-test-suite batch-install c-ray mencoder
Starting the Phoronix Test Suite
Evaluating External Test Dependencies
Phoronix Test Suite v10.8.4

    To Install:    pts/c-ray-1.2.0
    To Install:    pts/video-sample-1.0.0

Searching Download Caches
    2 Tests To Install
        4 Files To Download [135MB]
        6MB Of Disk Space Is Needed
        26 Seconds Estimated Install Time

    pts/c-ray-1.2.0:
        Test Installation 1 of 2
        1 File Needed [0.22 MB / 1 Minute]
 Downloading: c-ray-1.1.tar.gz [0.22MB]
        Estimated Download Time: 1m ..........
        Approximate Install Size: 6.0 MB
        Estimated Install Time: 12 Seconds
        Installing Test @ 21:38:15

pts/video-sample-1.0.0:
        Test Installation 2 of 2
        3 Files Needed [135 MB / 21 Minutes]
 Downloading: pts-trondheim-avi.tar.bz2 [86.24MB]
        Estimated Download Time: 14m ..................
 Downloading: pts-sample-playback-1.avi.tar.bz2 [15.13MB]
        Estimated Download Time: 3m ............................
 Downloading: Grey.ts.tar.bz2 [33.24MB]
        Estimated Download Time: 5m ..........
        Estimated Install Time: 14 Seconds
        Installing Test @ 21:53:32

To run a process in batch mode, use the following command.

\PTS> phoronix-test-suite batch-run c-ray mencoder
Starting the Phoronix Test Suite
 PROCESSOR:              Intel 6 Model 58 Stepping 9
    Core Count:           4
    Core Family:          Ivy Bridge

  GRAPHICS:
    Screen:               x

  MOTHERBOARD:

  MEMORY:

  DISK:                   221GB
    File-System:          Unknown

  OPERATING SYSTEM:       Microsoft Windows [Version 10.0.19044.1826]
    Kernel:               10.0 (x86_64)
    Security:             __user pointer sanitization: Disabled
                          + Retpoline: Full
                          + IBPB: Always
                          + IBRS: Enabled
                          + STIBP: Enabled
                          + KPTI Enabled: Yes
                          + PTE Inversion: Yes


    Recently Saved Test Results:
       cpu-test   [Today]

    Enter a name for the result file: cray-memcoder
    Enter a unique name to describe this test run / configuration: memcoder-cray
If desired, enter a new description below to better describe this result set / system configuration under test.
Press ENTER to proceed without changes.

Current Description: Intel 6 Model 58 Stepping 9 testing on Microsoft Windows [Version 10.0.19044.1826] via the Phoronix Test Suite.

New Description:

C-Ray 1.1:
    pts/c-ray-1.2.0
    Test 1 of 1
    Estimated Trial Run Count:    3
    Estimated Time To Completion: 9 Minutes [22:09 UTC]
        Started Run 1 @ 22:01:05
        Started Run 2 @ 22:01:15
        Started Run 3 @ 22:01:19

To remove a test:

\PTS> phoronix-test-suite remove-installed-test c-ray

 Are you sure you wish to remove the test pts/c-ray-1.2.0 (y/N):y
 pts/c-ray-1.2.0 has been removed

Conclusion

This guide has shown you how to Benchmark Windows 11 / Windows 10 using Phoronix Test Suite. Phoronix Test Suite is a testing and benchmarking platform available for Linux, Solaris, macOS, Windows, and BSD operating systems. It allows you to carry tests in an automated manner and also produce a report of the results.

Other guides available for you on our website:

LEAVE A REPLY

Please enter your comment!
Please enter your name here