Discuss a pre-matching check for waiting jobs

A static definition of a maximum waiting time can lead to two scenarios: Either a job waits extremely long for a resource that does not fit before it is released, or a job does not wait long enough for a suitable resource that provides the best cache hit rate. The exact perfect waiting time depends on cluster utilization and job characteristics. Here, an advanced checking and individual calculation of the waiting time may lead to better results. We can include informations of a pre-matching of the job to the most suitable worker node using job and worker node characteristics. The advantages of this approach need to be discussed in detail.

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information