<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.colour
{mso-style-name:colour;}
span.size
{mso-style-name:size;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">We use the University's common authentication for all our HPC nodes, so extending that to the ondemand VM was relatively easy for us via Shibboleth. That method means we have common User IDs and Group IDs for all systems, which make NFS
easy. OOD has an implicit dependency on the compute nodes having access to the same directory path as the OOD node as far as I can tell.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I wouldn't worry about .bashrc or .bash_profile. The user should not be able to get a command line shell on the OOD node. If the user opens open a shell window vi a OOD, it's on a cluster node.
<o:p></o:p></p>
<p class="MsoNormal">Ric<o:p></o:p></p>
<div>
<p class="MsoNormal">--<o:p></o:p></p>
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">Ric Anderson</span></b><span style="font-size:12.0pt;color:black">| <b>Systems Administrator</b>
<img width="15" height="15" style="width:.1562in;height:.1562in" id="_x0000_i1028" src="cid:image001.png@01D4AF09.80616520" alt="Description: Description: Description: Description: Description: Description: Description: http://redbar.web.arizona.edu/logos/images/thumb_pawprints.gif"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Research And Discovery Tech | HPC Large Systems Support<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">XSEDE Campus Champion<o:p></o:p></span></p>
<p class="MsoNormal"><u><span style="color:black"><a href="mailto:Ric@email.arizona.edu"><span style="color:#0563C1">ric@email.arizona.edu</span></a> </span></u><u><span style="color:#AFABAB">(V): +1-520-626-1642</span></u><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"><img border="0" width="160" height="39" style="width:1.6666in;height:.4062in" id="_x0000_i1027" src="cid:image002.png@01D4AF09.80616520" alt="cid:image005.png@01D01593.CF7DFA60"></span><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">"edijh403@tutanota.com" <edijh403@tutanota.com><br>
<b>Date: </b>Friday, January 18, 2019 at 6:26 AM<br>
<b>To: </b>"Anderson, Richard O - (ric)" <ric@email.arizona.edu><br>
<b>Cc: </b>Ohio Super Computing On Demand Users List <ood-users@lists.osc.edu><br>
<b>Subject: </b>Re: [OOD-users] common NFS for ood data shared with slurm workers<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Ok, thanks, Ric.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">For the slurm master and the worker nodes it makes sense to have an NFS mounted at their /home<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">directories because these nodes are very similar (in my case they have at least the same users and the<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">same OS (Ubuntu)).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">However, I'm hesitating to also share the ood node's /home because that node uses another OS<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">(CentOS, because OOD is not yet available as a Debian package) and there are different users on it<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">(no 'ubuntu' user but a 'centos' user instead). After all, I don't want the NFS to hide /home/centos.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">So I could mount at /home/ood instead. But then who gives me the guarantee that e.g. .bash_profile,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">.bashrc, etc. will work on both Ubuntu and CentOS?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">So should I mount at /home/ood/ondemand where OOD actually puts its data?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Jan 17, 2019, 6:02 PM by ric@email.arizona.edu:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #93A3B8 1.0pt;padding:0in 0in 0in 8.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">We use common NFS mount for /home and several other file systems that the compute nodes can access as users may have files in any/all of those they need to edit.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Ric<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">--<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span class="size"><b><span style="font-size:12.0pt;color:black">Ric Anderson</span></b></span><span class="size"><span style="font-size:12.0pt;color:black">| <b>Systems Administrator</b>
</span></span><span style="font-size:12.0pt;color:black;border:solid windowtext 1.0pt;padding:0in"><img border="0" width="15" height="15" style="width:.1562in;height:.1562in" id="Picture_x0020_2" src="cid:~WRD000.jpg" alt="Image removed by sender. Description: Description: Description: Description: Description: Description: Description: http://redbar.web.arizona.edu/logos/images/thumb_pawprints.gif"></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span class="colour"><span style="color:black">Research And Discovery Tech | HPC Large Systems Support</span></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span class="colour"><span style="color:black">XSEDE Campus Champion</span></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span class="colour"><u><span style="color:black"><a href="mailto:Ric@email.arizona.edu" target="_blank"><span style="color:#0563C1">ric@email.arizona.edu</span></a> </span><span style="color:#AFABAB">(V):
+1-520-626-1642</span></u></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black;border:solid windowtext 1.0pt;padding:0in"><img border="0" width="160" height="39" style="width:1.6666in;height:.4062in" id="Picture_x0020_1" src="cid:~WRD000.jpg" alt="Image removed by sender. cid:image005.png@01D01593.CF7DFA60"></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span class="size"><b><span style="font-size:12.0pt;color:black">From:
</span></b></span><span class="size"><span style="font-size:12.0pt;color:black">OOD-users <<a href="mailto:ood-users-bounces+ric=email.arizona.edu@lists.osc.edu" target="_blank">ood-users-bounces+ric=email.arizona.edu@lists.osc.edu</a>> on behalf of Ohio Super
Computing On Demand Users List <<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>></span></span><span style="font-size:12.0pt;color:black"><br>
<span class="size"><b>Reply-To: </b>"<a href="mailto:edijh403@tutanota.com" target="_blank">edijh403@tutanota.com</a>" <<a href="mailto:edijh403@tutanota.com" target="_blank">edijh403@tutanota.com</a>>, Ohio Super Computing On Demand Users List <<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>></span><br>
<span class="size"><b>Date: </b>Thursday, January 17, 2019 at 9:59 AM</span><br>
<span class="size"><b>To: </b>Ohio Super Computing On Demand Users List <<a href="mailto:ood-users@lists.osc.edu" target="_blank">ood-users@lists.osc.edu</a>></span><br>
<span class="size"><b>Subject: </b>[OOD-users] common NFS for ood data shared with slurm workers</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi all,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">when trying to launch a slurm job from within the ood dashboard, i get, in slurmd.log:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[14.batch] error: Could not open stdout file /home/ood/ondemand/data/sys/myjobs/projects/default/4/slurm-14.out: No such file or directory<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[14.batch] error: IO setup failed: No such file or directory<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">similarly, when trying to launch a jupyter notebook, i get:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[39.batch] error: Could not open stdout file /home/ood/ondemand/data/sys/dashboard/batch_connect/dev/jupyter/output/380b6eec-6d71-4a83-8a5e-20398831668a/output.log: No such file
or directory<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[39.batch] error: IO setup failed: No such file or directory<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">and that's because that path only exists on the ood node but not on a slurm worker node.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">to have this path exist on the ood node and all slurm worker nodes<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">i'd suggest to use a common NFS they all mount. is that the recommended way to go<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">or what would you suggest?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">thanks in advance.<o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>