Skip to content

The job scheduler and the queue

  • How does the queue work?

  • Let's look graphically at jobs presently running.

Image

  • x-axis: cores, one thread per core
  • y-axis: time

  • We see some holes where we may fit jobs already!

  • Let's see which type of jobs that can fit!

Image

  • 4 one-core jobs can run immediately (or a 4-core wide job).*

    • The jobs are too long to fit at core number 9-13.

Image

  • A 5-core job has to wait.*

    • Too long to fit in cores 9-13 and too wide to fit in the last cores.
  • Easiest to schedule single-threaded, short jobs

Tip

  • You don't see the queue graphically, however.
  • But, overall:
    • short and narrow jobs will start fast
    • test and development jobs can get use of specific development nodes if they are shorter than 1 hour and uses up to two nodes.
    • waste of resources unless you have a parallel program or need all the memory, e.g. 128 GB per node