Selecting Nodes Classes

Node Properties

Nodes can be selected by adding requirements to your job scripts. Such requirements might be a number of processors per node or memory requirement. For example, if you require 25 processors or more than your job cannot be scheduled on a node with 24 processors.

Another way to select nodes is to use properties. Use the qnodes command to view detailed information about nodes. Most interesting is the properties string.

$ qnodes
node001
     state = free
     np = 24
     properties = infiniband,Intel.X5650
     ntype = cluster
     jobs = 0/4278.master.allegro.imp.fu-berlin.de, 1/4278.master.allegro.imp.fu-berlin.de, 2/4278.master.allegro.imp.fu-berlin.de, 3/4278.master.allegro.imp.fu-berlin.de, 4/4278.master.allegro.imp.fu-berlin.de, 5/4278.master.allegro.imp.fu-berlin.de, 6/4278.master.allegro.imp.fu-berlin.de, 7/4278.master.allegro.imp.fu-berlin.de, 8/4278.master.allegro.imp.fu-berlin.de, 9/4278.master.allegro.imp.fu-berlin.de, 10/4278.master.allegro.imp.fu-berlin.de, 11/4278.master.allegro.imp.fu-berlin.de, 12/4278.master.allegro.imp.fu-berlin.de, 13/4278.master.allegro.imp.fu-berlin.de, 14/4278.master.allegro.imp.fu-berlin.de, 15/4278.master.allegro.imp.fu-berlin.de
     status = rectime=1336482417,varattr=,jobs=4278.master.allegro.imp.fu-berlin.de,state=free,netload=4551585884327,gres=,loadave=1.00,ncpus=24,physmem=74375616kb,availmem=74569584kb,totmem=76472764kb,idletime=1205623,nusers=1,nsessions=1,sessions=13503,uname=Linux cmp001 3.2.0-2-amd64 #1 SMP Sun Apr 15 16:47:38 UTC 2012 x86_64,opsys=linux

node002
     state = free
…

Selecting the 24-core Intel Nodes

To make your processes run only on the Intel Nodes, append :Intel.X5650 to your nodes argument of torque.

$ qsub -l nodes=1:Intel.X5650 job.sh

Of course, this can be combined with processor or memory requirements:

$ qsub -l nodes=1:ppn=3:Intel.X5650 job.sh

And it can also be used in your job scripts:

#!/bin/bash
...
#PBS -l nodes=1:ppn=2:Intel.X5650
....

Selecting the 64-core AMD Nodes

To make your processes run only on the AMD Nodes, append :AMD.FX6274 to your nodes argument of torque.

$ qsub -l nodes=1:AMD.FX6274 job.sh

Of course, this can be combined with processor or memory requirements:

$ qsub -l nodes=1:ppn=3:AMD.FX6274 job.sh

And it can also be used in your job scripts:

#!/bin/bash
...
#PBS -l nodes=1:ppn=2:AMD.FX6274
....