Deep Reinforcement Learning for Efficient Measurement of Quantum Devices

ORAL

Abstract

Deep reinforcement learning is an emerging machine learning approach which can teach a computer to learn from their actions and rewards similar to the way humans learn from experience. It offers many advantages in automating decision processes to navigate large parameter spaces. This paper proposes a novel approach to the efficient measurement of quantum devices based on deep reinforcement learning. We focus on double quantum dot devices, demonstrating the fully automatic identification of specific transport features called bias triangles. Measurements targeting these features are difficult to automate, since bias triangles are found in otherwise featureless regions of the parameter space. Our algorithm identifies bias triangles in a mean time of less than 30 minutes, and sometimes as little as 1 minute. This approach, based on dueling deep Q-networks, can be adapted to a broad range of devices and target transport features. This is a crucial demonstration of the utility of deep reinforcement learning for decision making in the measurement and operation of quantum devices.

*Supported by the Royal Society, EPSRC NQT Hub, Quantum Technology Capital, EPSRC Platform Grant, European Research Council, Graphcore, NCCR QSIT, NCCR SPIN, EU H2020 European Microkelvin Platform EMP grant.

Presenters

  • Sebastian Orbell

    • University of Oxford

Authors

  • Sebastian Orbell

    • University of Oxford
  • Vu Nguyen

    • University of Oxford
  • Dominic Lennon

    • University of Oxford
  • Hyungil Moon

    • University of Oxford
  • Florian Vigneau

    • University of Oxford
  • Leon Camezind

    • University of Basel
  • Liuqi Yu

    • Department of Physics, University of Basel
    • University of Basel
    • LPS at the University of Maryland, College Park
    • University of Maryland, College Park
  • Dominik Zumbuhl

    • University of Basel
    • Physics, University of Basel
    • Department of Physics, University of Basel
  • Andrew Briggs

    • University of Oxford
  • Michael Osborne

    • University of Oxford
  • Dino Sejdinovic

    • University of Oxford
  • Natalia Ares

    • University of Oxford