Benchmark testing Archives - IEEE Transactions on Quantum Engineering

Benchmarking the Ability of a Controller to Execute Quantum Error Corrected Non-Clifford Circuits

September 9, 2025Yaniv Kurman Lior Ella Ramon Szmuk Oded Wertheim Benedikt Dorschner Sam StanwyckEnabling TechnologiesBenchmark testing, Circuits, Codes, Decoding, Fault tolerance, Fault tolerant systems, Logic gates, Measurement uncertainty, Quantum computing, Qubit

Abstract: Reaching fault-tolerant quantum computation relies on the successful implementation of non-Clifford circuits with quantum error correction (QEC). In QEC, quantum gates and measurements encode quantum information into an error-protected Hilbert space, while classical processing decodes the measurements into logical errors. QEC non-Clifford gates pose the greatest computation challenge from the classical controller’s perspective, as […]

A Grover-Meets-Simon Approach to Match Vector Boolean Functions

August 4, 2025Marco Venere; Alessandro Barenghi; Gerardo PelosiQuantum ComputingBenchmark testing, Boolean functions, Digital circuits, Integrated circuit interconnections, Libraries, Logic gates, Polynomials, Quantum algorithm, Time complexity, Vectors

Abstract: The Boolean matching problem via NP-equivalence requires determining whether two Boolean functions are equivalent or not up to a permutation and negation of the input binary variables. Its solution is a fundamental step in the electronic design automation (EDA) tool chains commonly used for digital circuit design. In fact, the library-mapping step of an […]

A Comprehensive Cross-Model Framework for Benchmarking the Performance of Quantum Hamiltonian Simulations

April 4, 2025Avimita Chatterjee; Sonny Rappaport; Anish Giri; Sonika Johri; Timothy Proctor; David E. Bernal NeiraQuantum ComputingBenchmark testing, Computational modeling, Hardware, Integrated circuit modeling, Legged locomotion, Noise, Quantum algorithm, Quantum computing, Qubit, Software algorithms

Abstract: Quantum Hamiltonian simulation is one of the most promising applications of quantum computing and forms the basis for many quantum algorithms. Benchmarking them is an important gauge of progress in quantum computing technology. We present a methodology and software framework to evaluate various facets of the performance of gate-based quantum computers on Trotterized quantum […]

Benchmarking Quantum Machine Learning Kernel Training for Classification Tasks

February 13, 2025Diego Alvarez-EstevezQuantum SoftwareBenchmark testing, Estimation, Kernel, Machine learning, Quantum computing, Quantum mechanics, Quantum state, Support vector machines, Training, Vectors

Quantum-enhanced machine learning is a rapidly evolving field that aims to leverage the unique properties of quantum mechanics to enhance classical machine learning. However, the practical applicability of these methods remains an open question, particularly beyond the context of specifically crafted toy problems, and given the current limitations of quantum hardware. For more about this […]

Benchmarking Quantum Circuit Transformation With QKNOB Circuits

January 8, 2025Sanjiang Li, Xiangzhen Zhou, Yuan FengQuantum SoftwareApproximation algorithms, Benchmark testing, Costs, Logic gates, Performance evaluation, Quantum circuit, Quantum mechanics, Qubit, Scalability, Transforms

Current superconducting quantum devices impose strict connectivity constraints on quantum circuit execution, necessitating circuit transformation before executing quantum circuits on physical hardware. Numerous quantum circuit transformation (QCT) algorithms have been proposed. To enable faithful evaluation of state-of-the-art QCT algorithms, this article introduces qubit mapping benchmark with known near-optimality (QKNOB), a novel benchmark construction method for […]

Scalable Full-Stack Benchmarks for Quantum Computers

May 23, 2024Jordan Hines, Timothy ProctorQuantum ComputingBenchmark testing, Circuits, Computers, Integrated circuit modeling, Logic gates, Program processors, Quantum computing

Quantum processors are now able to run quantum circuits that are infeasible to simulate classically, creating a need for benchmarks that assess a quantum processor’s rate of errors when running these circuits. Here, we introduce a general technique for creating efficient benchmarks from any set of quantum computations, specified by unitary circuits. Our benchmarks assess […]

Quantum Vulnerability Analysis to Guide Robust Quantum Computing System Design

December 15, 2023Fang QiQuantum ComputingBenchmark testing, Computational modeling, Computers, Error analysis, Integrated circuit modeling, Logic gates, Quantum computing

While quantum computers provide exciting opportunities for information processing, they currently suffer from noise during computation that is not fully understood. Incomplete noise models have led to discrepancies between quantum program success rate (SR) estimates and actual machine outcomes. For example, the estimated probability of success (ESP) is the state-of-the-art metric used to gauge quantum […]

Quantum Vulnerability Analysis to Guide Robust Quantum Computing System Design

December 15, 2023Fang Qi, Kaitlin N. Smith, Travis LeCompte, Nian-feng Tzeng, Xu Yuan, Frederic T. Chong, Lu PengQuantum ComputingBenchmark testing, Computational modeling, Computers, Error analysis, Integrated circuit modeling, Logic gates, Quantum computing

Testing Platform-Independent Quantum Error Mitigation on Noisy Quantum Computers

August 15, 2023Vincent RussoQuantum ComputingBenchmark testing, Computers, Logic gates, Noise measurement, Quantum computing, Qubit, Superconducting devices

We apply quantum error mitigation (QEM) techniques to a variety of benchmark problems and quantum computers to evaluate the performance of QEM in practice. To do so, we define an empirically motivated, resource-normalized metric of the improvement of error mitigation, which we call the improvement factor, and calculate this metric for each experiment we perform. […]

Quantum Volume in Practice: What Users Can Expect From NISQ Devices

November 2, 2022Elijah PelofskeOpen Access, Quantum ComputingBenchmark testing, Computers, Error analysis, Logic gates, Measurement, Optimization, Qubit

Quantum volume (QV) has become the de-facto standard benchmark to quantify the capability of noisy intermediate-scale quantum (NISQ) devices. While QV values are often reported by NISQ providers for their systems, we perform our own series of QV calculations on 24 NISQ devices currently offered by IBM Q, IonQ, Rigetti, Oxford Quantum Circuits, and Quantinuum […]