<div dir="ltr">Eric,<div><br></div><div>Thanks for the reply. My aim would be to get them launched one of the login nodes. A "ssh clustername" would get you a round-robin to one of them to balance things. FWIW, we use systemd and cgroups to throttle people and make sure everyone gets an even slice of the login node (and knock off anyone using more than some % of memory), so I think that would handle those concerns for us.</div><div><br></div><div>As for the quick implementation, yes, actually one suggestion I got here was to turn the front-ends into nodes in torque, and have a queue only OOD can access which I think is similar to the proposal there. Maybe we could dedicate a few compute node similarly and allow heavier use, but that'll take some convincing up the chain.</div><div><br></div><div>I think this gives me enough information for the time being - I've got an internal demo planned for later next month where I hope to make some decisions on whether this is functionality we want to offer. Right now users can use Thinlinc remote desktops to quick launch things on a login node (there's a set of 'start' menu items) so I don't necessarily want to provide duplicate functionality to do the same thing.</div><div><br></div><div>Thanks!</div><div><br></div><div>Dan</div></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Nov 20, 2018 at 3:51 PM Franz, Eric <<a href="mailto:efranz@osc.edu">efranz@osc.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="m_-6671001164791060160WordSection1">
<p class="MsoNormal">Dan,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Were you thinking of starting these on the web node, login node, or just any dedicated node to run these processes on demand, without the wait imposed by the queue?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">We proposed to tackle this problem in the CSSI proposal that was recently awarded so this is on the roadmap for next year. We discussed possibly building a “fork” adapter that would implement the same interface as the job adapters, but
instead just fork + exec (or in your case, ssh + fork). The replacement for qstat would be a mixture of ps and inspecting /proc/<pid>; the “job id” would be the process id. qdel would just be kill. There would be problems introduced for process cleanup. Some
type of containerization would be helpful but then that would require escalated privileges, complicating the implementation. Or we might investigate using systemd for supporting the process management.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">At OSC we support such lightweight processing through a “quick cluster” to support “VDI” apps where jobs only get 1 core and we oversubscribe jobs on the nodes. That is explained in the relevant portions in this thread:
<a href="https://listsprd.osu.edu/pipermail/ood-users/2018-March/000122.html" target="_blank">https://listsprd.osu.edu/pipermail/ood-users/2018-March/000122.html</a>. While they use the same batch submission (the torque adapter, in OSC’s case), jobs typically take 10-30 seconds
to start instead of minutes. Would this approach work for you in the interim? Otherwise perhaps we could explore another option till a more robust “fork” adapter is available.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
<p class="MsoNormal">Eric<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">---<u></u><u></u></p>
<p class="MsoNormal">Eric Franz, Senior Web & Interface App Engineer<u></u><u></u></p>
<p class="MsoNormal">Ohio Supercomputer Center<u></u><u></u></p>
<p class="MsoNormal">An Ohio Technology Consortium (OH-TECH) Member<u></u><u></u></p>
<p class="MsoNormal">1224 Kinnear Road<u></u><u></u></p>
<p class="MsoNormal">Columbus, OH 43212<u></u><u></u></p>
</div>
<p class="MsoNormal">email: <a href="mailto:efranz@osc.edu" target="_blank">efranz@osc.edu</a><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">OOD-users <ood-users-bounces+efranz=<a href="mailto:osc.edu@lists.osc.edu" target="_blank">osc.edu@lists.osc.edu</a>> on behalf of Dan Dietz via OOD-users <<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>><br>
<b>Reply-To: </b>Dan Dietz <<a href="mailto:ddietz@purdue.edu" target="_blank">ddietz@purdue.edu</a>>, User support mailing list for Open OnDemand <<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>><br>
<b>Date: </b>Tuesday, November 20, 2018 at 8:45 AM<br>
<b>To: </b>"<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>" <<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>><br>
<b>Subject: </b>[OOD-users] Launching apps outside job system<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I wonder if there is a way to launch the apps outside the job system, ie, directly on the cluster front-ends? We support running a few lightweight apps on cluster front-ends (visualizations, things like that). Is there a way to have it
just "ssh" instead of "qsub" to start an interactive session? <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Dan<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">Dan Dietz<br>
Senior Scientific Applications Analyst<br>
ITaP Research Computing, Purdue University<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Dan Dietz<br>Senior Scientific Applications Analyst<br>ITaP Research Computing, Purdue University</div></div></div>