Skip to main contentIBM Quantum Documentation Preview

Introduction to Qiskit Runtime execution modes

There are several ways to run workloads, depending on your needs.

Note

The mode option requires qiskit-ibm-runtime 0.24 or later.

Job mode: A single primitive request of the estimator or the sampler made without a context manager. Circuits and inputs are packaged as primitive unified blocs (PUBs) and submitted as an execution task on the quantum computer. To run in job mode, specify mode=backend when instantiating a primitive. See Primitives examples for examples.

Session mode: A dedicated window for running a multi-job workload. This allows users to experiment with variational algorithms in a more predictable way and even run multiple experiments simultaneously taking advantage of parallelism in the stack. Use sessions for iterative workloads or experiments that require dedicated access. To run in session mode, specify mode=session when instantiating a primitive or run the job in a session context manager. See Run jobs in a session for examples.

Batch mode: A multi-job manager for efficiently running an experiment that is comprised of bundle of independent jobs. Use batch mode to submit multiple primitive jobs simultaneously. To run in batch mode, specify mode=batch when instantiating a primitive or run the job in a batch context manager. See Run jobs in a batch for examples.

The differences are summarized in the following table:

ModeUsageBenefit
Job modeQuantum computation only.Easiest to use when running a small experiment. Might run sooner than batch mode.
Batch modeQuantum computation only.The entire batch of jobs is scheduled together and there is no additional queuing time for each. Jobs in a batch are usually run close together.
Session modeBoth classical and quantum computation.Dedicated and exclusive access to the QPU during the session active window, and no other users’ or QPU jobs can run. This is particularly useful for workloads that don’t have all inputs ready at the outset.

Best practices

To ensure the most efficient use of the execution modes, the following practices are recommended:

  • Always close your session or batch, either by using a context manager or by specifying session.close() or batch.close(), respectively.

  • There is a fixed overhead associated with running a job. In general, if each of your jobs uses less than one minute of QPU time, consider combining several into one larger job (this applies to all execution modes). "QPU time" refers to time spent by the QPU complex to process your job.

    A job's QPU time is listed in the Usage column on the IBM Quantum Platform Workloads page, or you can query it by using qiskit-ibm-runtime with this command job.metrics()["usage"]["quantum_seconds"]

  • If each of your jobs consumes more than one minute of QPU time, or if combining jobs is not practical, you can still run multiple jobs in parallel. Every job goes through both classical and quantum processing. While a QPU can process only one job at a time, up to five classical jobs can be processed in parallel. You can take advantage of this by submitting multiple jobs in batch or session execution mode.

The above are general guidelines, and you should tune your workload to find the optimal ratio, especially when using sessions. For example, if you are using a session to get exclusive access to a backend, consider breaking up large jobs into smaller ones and running them in parallel. This might be more cost effective because it can reduce wall clock time.


Sessions versus batch usage

The reported usage is the time a QPU is locked for your workload. Failed or canceled jobs count toward your reported usage in certain circumstances - see the Failed and canceled jobs section for details.

  • Session usage is the time from when the first job starts until the session goes inactive, is closed, or when its last job completes, whichever happens last.
  • Batch usage is the amount of time all jobs spend on the QPU.
  • Single job usage is the quantum time they use in processing.

To find the usage time for your session or batch, in qiskit-ibm-runtime 0.30 or later, run session.usage() or batch.usage(). If using an older version of qiskit-ibm-runtime (>= 0.23 and < 0.30), the usage can be still be found in session.details()["usage_time"] and batch.details()["usage_time"].

If you are calling the REST API directly, the usage time is the elapsed_time value returned by the GET /sessions/{id} endpoint, for both session and batch workloads.

This image shows multiple sets of jobs.  One set is being run in session mode and the other is being run in batch mode.  For session mode, between each job is the interactive TTL (time to live).  The active window starts when the first job starts and ends after the last job is completed. After the final job of the first set of jobs completes, the active window ends and the session is paused (but not closed).  Another set of jobs then starts and jobs continue in a similar manner. The QPU is reserved for your use during the entire session.  For batch mode, the classical computation part of each job happens simultaneously, then all jobs are sent to the QPU.  The QPU is locked for your use from the time the first job reaches the QPU until the last job is done processing.  There is no gap between jobs where the QPU is idle.
Sessions compared to batch

Failed and canceled jobs

When a job is failed or canceled, the reported usage is as follows:

  • Job or batch mode: the reported usage is the time the QPU was locked for executing your workload until the time it failed or was canceled. Therefore, if the failure or cancellation occurred before the lock, the reported usage is zero. Otherwise, the workload's reported usage is the value that Qiskit Runtime returns as consumed. Thus, some failed jobs do not appear in your reported usage and others do.

  • Session mode: the reported usage is the wall-clock time from the when the first job started executing in the session until the session terminates, regardless of the number of jobs that fail or are canceled.


Interactive time to live (ITTL)

The ITTL in batch mode is one second for all instances.

The ITTL for a session (Premium Plan users only) is 60 seconds, unless there is an instance-specific configuration that dictates a different ITTL.

Execution modeInstance type (Open or Premium Plan)ITTL
Batch modeBoth Open and Premium Plan1 sec
Session modePremium Plan60 sec*

* Certain Premium Plan instances might be specially configured to have a different ITTL.

Note

You can also programmatically query the ITTL; see details on the Maximum execution time page.