Setting up queues in slurm based on resource requestQuestions about HPC on SLURMSpecifying number of slurm nodesRunning a queue of MPI calls in parallel with SLURM and limited resourcesReserve memory per task in SLURMMonitor the CPU usage of an OpenFOAM simulation running on a slurm jobslurm jobs are pending but resources are availableSLURM does not follow requested resourcesHow to set RealMemory in slurm?dask jobqueue worker failure at startup 'Resource temporarily unavailable'Setting up a multi-user job scheduler for data science / ML tasks

What are some good ways to treat frozen vegetables such that they behave like fresh vegetables when stir frying them?

The Digit Triangles

C++ copy constructor called at return

When were female captains banned from Starfleet?

Mimic lecturing on blackboard, facing audience

Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?

awk assign to multiple variables at once

What kind of floor tile is this?

"It doesn't matter" or "it won't matter"?

Why does AES have exactly 10 rounds for a 128-bit key, 12 for 192 bits and 14 for a 256-bit key size?

How do you make your own symbol when Detexify fails?

Which was the first story featuring espers?

What to do when eye contact makes your coworker uncomfortable?

Do we have to expect a queue for the shuttle from Watford Junction to Harry Potter Studio?

How to explain what's wrong with this application of the chain rule?

How many arrows is an archer expected to fire by the end of the Tyranny of Dragons pair of adventures?

Microchip documentation does not label CAN buss pins on micro controller pinout diagram

15% tax on $7.5k earnings. Is that right?

Why does this expression simplify as such?

What's the name of the logical fallacy where a debater extends a statement far beyond the original statement to make it true?

Taxes on Dividends in a Roth IRA

Quoting Keynes in a lecture

Shouldn’t conservatives embrace universal basic income?

Biological Blimps: Propulsion



Setting up queues in slurm based on resource request


Questions about HPC on SLURMSpecifying number of slurm nodesRunning a queue of MPI calls in parallel with SLURM and limited resourcesReserve memory per task in SLURMMonitor the CPU usage of an OpenFOAM simulation running on a slurm jobslurm jobs are pending but resources are availableSLURM does not follow requested resourcesHow to set RealMemory in slurm?dask jobqueue worker failure at startup 'Resource temporarily unavailable'Setting up a multi-user job scheduler for data science / ML tasks













0















I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:



small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
large_cpu = node4,5,6 <- assigned when requesting > 10 cores
big_mem = node7,8,9 <- assign when requesting > 100GB memory
fail/backfill = nodes10,11,12 <- assigned when the other queues are full


I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.



M










share|improve this question


























    0















    I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:



    small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
    large_cpu = node4,5,6 <- assigned when requesting > 10 cores
    big_mem = node7,8,9 <- assign when requesting > 100GB memory
    fail/backfill = nodes10,11,12 <- assigned when the other queues are full


    I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.



    M










    share|improve this question
























      0












      0








      0








      I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:



      small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
      large_cpu = node4,5,6 <- assigned when requesting > 10 cores
      big_mem = node7,8,9 <- assign when requesting > 100GB memory
      fail/backfill = nodes10,11,12 <- assigned when the other queues are full


      I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.



      M










      share|improve this question














      I'm curious if there is a way to setup Slurm partitions so that the scheduler will query against available partitions and assign to a partition depending on amount of requested resources, eg. say I have a few queues:



      small_cpu = node1,2,3 <- assigned when requesting <= 10 cores
      large_cpu = node4,5,6 <- assigned when requesting > 10 cores
      big_mem = node7,8,9 <- assign when requesting > 100GB memory
      fail/backfill = nodes10,11,12 <- assigned when the other queues are full


      I'm able to do this in PBS/Moab, but I'm having difficulty with the Slurm documentation trying to figure it out. Any insight is appreciated.



      M







      slurm






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Mar 8 at 0:06









      Martin JamesMartin James

      569




      569






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55054803%2fsetting-up-queues-in-slurm-based-on-resource-request%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55054803%2fsetting-up-queues-in-slurm-based-on-resource-request%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Can't initialize raids on a new ASUS Prime B360M-A motherboard2019 Community Moderator ElectionSimilar to RAID config yet more like mirroring solution?Can't get motherboard serial numberWhy does the BIOS entry point start with a WBINVD instruction?UEFI performance Asus Maximus V Extreme

          Identity Server 4 is not redirecting to Angular app after login2019 Community Moderator ElectionIdentity Server 4 and dockerIdentityserver implicit flow unauthorized_clientIdentityServer Hybrid Flow - Access Token is null after user successful loginIdentity Server to MVC client : Page Redirect After loginLogin with Steam OpenId(oidc-client-js)Identity Server 4+.NET Core 2.0 + IdentityIdentityServer4 post-login redirect not working in Edge browserCall to IdentityServer4 generates System.NullReferenceException: Object reference not set to an instance of an objectIdentityServer4 without HTTPS not workingHow to get Authorization code from identity server without login form

          2005 Ahvaz unrest Contents Background Causes Casualties Aftermath See also References Navigation menue"At Least 10 Are Killed by Bombs in Iran""Iran"Archived"Arab-Iranians in Iran to make April 15 'Day of Fury'"State of Mind, State of Order: Reactions to Ethnic Unrest in the Islamic Republic of Iran.10.1111/j.1754-9469.2008.00028.x"Iran hangs Arab separatists"Iran Overview from ArchivedConstitution of the Islamic Republic of Iran"Tehran puzzled by forged 'riots' letter""Iran and its minorities: Down in the second class""Iran: Handling Of Ahvaz Unrest Could End With Televised Confessions""Bombings Rock Iran Ahead of Election""Five die in Iran ethnic clashes""Iran: Need for restraint as anniversary of unrest in Khuzestan approaches"Archived"Iranian Sunni protesters killed in clashes with security forces"Archived