Setting up queues in slurm based on resource requestQuestions about HPC on SLURMSpecifying number of slurm nodesRunning a queue of MPI calls in parallel with SLURM and limited resourcesReserve memory per task in SLURMMonitor the CPU usage of an OpenFOAM simulation running on a slurm jobslurm jobs are pending but resources are availableSLURM does not follow requested resourcesHow to set RealMemory in slurm?dask jobqueue worker failure at startup 'Resource temporarily unavailable'Setting up a multi-user job scheduler for data science / ML tasks
What are some good ways to treat frozen vegetables such that they behave like fresh vegetables when stir frying them?
The Digit Triangles
C++ copy constructor called at return
When were female captains banned from Starfleet?
Mimic lecturing on blackboard, facing audience
Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?
awk assign to multiple variables at once
What kind of floor tile is this?
"It doesn't matter" or "it won't matter"?
Why does AES have exactly 10 rounds for a 128-bit key, 12 for 192 bits and 14 for a 256-bit key size?
How do you make your own symbol when Detexify fails?
Which was the first story featuring espers?
What to do when eye contact makes your coworker uncomfortable?
Do we have to expect a queue for the shuttle from Watford Junction to Harry Potter Studio?
How to explain what's wrong with this application of the chain rule?
How many arrows is an archer expected to fire by the end of the Tyranny of Dragons pair of adventures?
Microchip documentation does not label CAN buss pins on micro controller pinout diagram
15% tax on $7.5k earnings. Is that right?
Why does this expression simplify as such?
What's the name of the logical fallacy where a debater extends a statement far beyond the original statement to make it true?
Taxes on Dividends in a Roth IRA
Quoting Keynes in a lecture
Shouldn’t conservatives embrace universal basic income?
Biological Blimps: Propulsion
Setting up queues in slurm based on resource request
Questions about HPC on SLURMSpecifying number of slurm nodesRunning a queue of MPI calls in parallel with SLURM and limited resourcesReserve memory per task in SLURMMonitor the CPU usage of an OpenFOAM simulation running on a slurm jobslurm jobs are pending but resources are availableSLURM does not follow requested resourcesHow to set RealMemory in slurm?dask jobqueue worker failure at startup 'Resource temporarily unavailable'Setting up a multi-user job scheduler for data science / ML tasks
I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:
small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
large_cpu = node4,5,6 <- assigned when requesting > 10 cores
big_mem = node7,8,9 <- assign when requesting > 100GB memory
fail/backfill = nodes10,11,12 <- assigned when the other queues are full
I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.
M
slurm
add a comment |
I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:
small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
large_cpu = node4,5,6 <- assigned when requesting > 10 cores
big_mem = node7,8,9 <- assign when requesting > 100GB memory
fail/backfill = nodes10,11,12 <- assigned when the other queues are full
I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.
M
slurm
add a comment |
I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:
small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
large_cpu = node4,5,6 <- assigned when requesting > 10 cores
big_mem = node7,8,9 <- assign when requesting > 100GB memory
fail/backfill = nodes10,11,12 <- assigned when the other queues are full
I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.
M
slurm
I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:
small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
large_cpu = node4,5,6 <- assigned when requesting > 10 cores
big_mem = node7,8,9 <- assign when requesting > 100GB memory
fail/backfill = nodes10,11,12 <- assigned when the other queues are full
I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.
M
slurm
slurm
asked Mar 8 at 0:06
Martin JamesMartin James
569
569
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55054803%2fsetting-up-queues-in-slurm-based-on-resource-request%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55054803%2fsetting-up-queues-in-slurm-based-on-resource-request%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown