{"id":876,"date":"2010-07-17T11:16:32","date_gmt":"2010-07-17T18:16:32","guid":{"rendered":"http:\/\/greg.porter.name\/wordpress\/?p=876"},"modified":"2010-10-05T11:16:55","modified_gmt":"2010-10-05T18:16:55","slug":"high-performance-computing-clusters-in-the-computer-science-department-cal-poly-slo","status":"publish","type":"post","link":"https:\/\/greg.porter.name\/wordpress\/?p=876","title":{"rendered":"High Performance Computing Clusters in the Computer Science Department, Cal Poly, SLO"},"content":{"rendered":"<p><a href=\"https:\/\/www.calpoly.edu\/\">Cal Poly, SLO<\/a>, where I work is a teaching university.\u00a0 We don&#8217;t do a lot of research and historically, there hasn&#8217;t been a lot of high performance computing on campus.\u00a0 A number of years ago, <a href=\"https:\/\/www.servicedesk.calpoly.edu\/content\/about\">Information Technology Services<\/a> (ITS, the central campus computing people) got a grant and set up <a href=\"https:\/\/www.gridcomputing.calpoly.edu\/index.html\">a small cluster for general use<\/a>.\u00a0 Users of this cluster that I&#8217;ve talked to weren&#8217;t very happy with it.\u00a0 It wan&#8217;t particularly big, and it wasn&#8217;t particularly easy to use.\u00a0 Since then, various faculty with research projects have gotten their own clusters which their departments operated, not ITS.\u00a0 The first cluster I&#8217;m aware of like this was ravel.csc.calpoly.edu, which I helped spec out, buy, rack up, and loaded the operating system on.<\/p>\n<p><!--more--><\/p>\n<div id=\"attachment_880\" style=\"width: 160px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/greg.porter.name\/wordpress\/wp-content\/uploads\/2010\/10\/043.JPG\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-880\" class=\"size-thumbnail wp-image-880\" title=\"ravel cluster\" src=\"https:\/\/greg.porter.name\/wordpress\/wp-content\/uploads\/2010\/10\/043-150x150.jpg\" alt=\"ravel cluster\" width=\"150\" height=\"150\" \/><\/a><p id=\"caption-attachment-880\" class=\"wp-caption-text\">ravel.csc.calpoly.edu<\/p><\/div>\n<p>Ravel.csc.calpoly.edu is a 23 node high performance computing cluster  located in the Computer Science Department, Cal Poly, SLO, <a href=\"https:\/\/maps.google.com\/maps?f=q&amp;source=s_q&amp;hl=en&amp;geocode=&amp;q=n35.30038+w120.66219&amp;sll=35.300346,-120.662026&amp;sspn=0.001285,0.00284&amp;ie=UTF8&amp;ll=35.300315,-120.661967&amp;spn=0.001285,0.00284&amp;t=h&amp;z=19\">building 14-238<\/a>.\u00a0 It was originally acquired by <a href=\"https:\/\/www.cs.ucsb.edu\/%7Efranklin\/\">Dr. Diana Franklin<\/a> with <a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward.do?AwardNumber=0619911\">an NSF grant<\/a> in April of 2007.\u00a0 The compute nodes are two socket, 2 core machines (4 cores per node) for a total of 92 64 bit cores of <a href=\"https:\/\/ark.intel.com\/Product.aspx?id=27216\">Intel Xeon 5130<\/a> at 2 GHz.\u00a0 Each node has 4GB of memory.\u00a0 Nodes use Gigabit Ethernet for interconnect.\u00a0 The head node has a 1TB external array of SAS drives to hold user data.\u00a0 User home directories are mounted with NFS.<\/p>\n<p>Ravel runs a Linux distribution for HPC named <a href=\"https:\/\/www.rocksclusters.org\/wordpress\/\">Rocks<\/a>.<\/p>\n<div id=\"attachment_879\" style=\"width: 160px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/greg.porter.name\/wordpress\/wp-content\/uploads\/2010\/10\/041.JPG\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-879\" class=\"size-thumbnail wp-image-879\" title=\"steger cluster\" src=\"https:\/\/greg.porter.name\/wordpress\/wp-content\/uploads\/2010\/10\/041-150x150.jpg\" alt=\"steger.aero.calpoly.edu\" width=\"150\" height=\"150\" \/><\/a><p id=\"caption-attachment-879\" class=\"wp-caption-text\">steger.aero.calpoly.edu<\/p><\/div>\n<p><a href=\"https:\/\/aero.calpoly.edu\/faculty\/david-marshall\/\">Dr. David Marshall<\/a> in the Cal Poly<a href=\"https:\/\/aero.calpoly.edu\/\"> Aerospace Engineering<\/a> Department got a grant to buy a cluster for research.\u00a0 He bought a small cluster from <a href=\"https:\/\/www.pssclabs.com\/\">PSSC Labs<\/a>.\u00a0 Steger.aero.calpoly.edu has 11 nodes.\u00a0 Each compute node is a two socket, quad core machine (8 cores per node) for a total of 88 64 bit cores of <a href=\"https:\/\/products.amd.com\/en-us\/OpteronCPUDetail.aspx?id=490&amp;f1=&amp;f2=&amp;f3=Yes&amp;f4=&amp;f5=&amp;f6=&amp;f7=&amp;f8=&amp;f9=&amp;f10=&amp;f11=&amp;\">AMD Opteron(tm) Processor 2378<\/a> at 2.4 GHz.\u00a0 Each node has 32GB of memory.\u00a0 Nodes have both Infiniband and Gigabit Ethernet for  interconnects.\u00a0 The cluster has a separate 4TB filer acting as an NFS server to  hold user data.\u00a0 User home directories are mounted with NFS.<\/p>\n<p>The AERO department did not have a space with proper power or cooling to operate steger, so they asked us if we could host it for them.\u00a0 We moved it to the Computer Science department machine room in August 2009.\u00a0 So I&#8217;m now the administrator for steger.\u00a0 One of the first things I did was reload steger with <a href=\"https:\/\/www.rocksclusters.org\">Rocks<\/a>.<\/p>\n<div id=\"attachment_881\" style=\"width: 160px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/greg.porter.name\/wordpress\/wp-content\/uploads\/2010\/10\/045.JPG\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-881\" class=\"size-thumbnail wp-image-881\" title=\"tesla cluster\" src=\"https:\/\/greg.porter.name\/wordpress\/wp-content\/uploads\/2010\/10\/045-150x150.jpg\" alt=\"tesla.csc.calpoly.edu\" width=\"150\" height=\"150\" \/><\/a><p id=\"caption-attachment-881\" class=\"wp-caption-text\">tesla.csc.calpoly.edu<\/p><\/div>\n<p><a href=\"https:\/\/users.csc.calpoly.edu\/~clupo\/\">Dr. Chris Lupo<\/a> got a grant to explore using the rendering engines on video cards as compute nodes in a cluster.\u00a0 NVIDIA now sells what were &#8220;video cards&#8221; as <a href=\"https:\/\/en.wikipedia.org\/wiki\/GPGPU\">General Purpose Graphics Processing Units<\/a> (GPGPU or GPU).\u00a0 We wound up buying a workstation from AMAX that has four <a href=\"https:\/\/www.nvidia.com\/object\/product_tesla_C2050_C2070_us.html\">NVIDIA Tesla 2050 GPU cards<\/a> in it.\u00a0 That\u2019s four times 448 cores per card = 1792 GPU cores in a 4U workstation form factor.\u00a0 It came preloaded with Debian on it.\u00a0 We&#8217;re considering putting Rocks on it, too.<\/p>\n<p>I&#8217;m the primary system administrator for all of these systems ( <a href=\"https:\/\/users.csc.calpoly.edu\/%7Eglporter\/\">Greg Porter<\/a>,   glporter @ calpoly. edu).\u00a0 Email me if you have issues.\u00a0 Other  system  administrators might be able to help as well, try   computer-science-sysadmins @ polymail. calpoly. edu.\u00a0  All of these clusters are open for general use by students, faculty,  and  staff.\u00a0 Email Greg Porter or the sysadmins (addresses above) if  you\u2019d  like an account.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cal Poly, SLO, where I work is a teaching university.\u00a0 We don&#8217;t do a lot of research and historically, there hasn&#8217;t been a lot of high performance computing on campus.\u00a0 A number of years ago, Information Technology Services (ITS, the&hellip; <a href=\"https:\/\/greg.porter.name\/wordpress\/?p=876\" class=\"more-link\">Continue Reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-876","post","type-post","status-publish","format-standard","hentry","category-content"],"_links":{"self":[{"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/876","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=876"}],"version-history":[{"count":13,"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/876\/revisions"}],"predecessor-version":[{"id":892,"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/876\/revisions\/892"}],"wp:attachment":[{"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=876"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=876"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/greg.porter.name\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=876"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}