http://blog.gmane.org/gmane.comp.clustering.beowulf.general hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29507 <pre> I know Penguin runs the list, but I'm not sure who to contact, I'll forward it to the list. Hopefully someone will be able to provide an answer. -- Doug URL doesn't work (for me) &gt; either bounce or vanish down a /dev/null hole. On Behalf Of Douglas Eadline Computing To change your subscription (digest mode or unsubscribe) visit To change your subscription (digest mode or unsubscribe) visit designated recipient, please notify the sender immediately, and delete the original and any copies. Any use of the message by you is prohibited. </pre> Douglas Eadline 2012-05-03T12:40:59 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29502 <pre>http://www.theregister.co.uk/2012/05/01/intel_pi_rival_nuc/ Ohhh.... Thinking of how to cool a rack full of these things with 2x16Gbyte DIMMS in each. Looks like you could seal that case and use immersive cooling - partially dip the case in the coolant but leave the top dry??? 2x mini PCIe slots for that fast interconnect Though - does anyone know much about networking over thunderbolt? John Hearns | CFD Hardware Specialist | McLaren Racing Limited McLaren Technology Centre, Chertsey Road, Woking, Surrey GU21 4YH, UK T: +44 (0) 1483 262000 D: +44 (0) 1483 262352 F: +44 (0) 1483 261928 E: john.hearns&lt; at &gt;mclaren.com W: www.mclaren.com &lt;http://www.mclaren.com/&gt; The contents of this email are confidential and for the exclusive use of the intended recipient. If you receive this email in error you should not copy it, retransmit it, use it or disclose its contents but should return it to the sender immediately and delete your copy. </pre> Hearns, John 2012-05-01T15:10:27 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29497 <pre>http://www.eetimes.com/electronics-news/4371639/Cray-sells-interconnect-hardware-unit-to-Intel that's one market where AMD no longer plays eh? </pre> Mark Hahn 2012-04-25T02:58:39 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29494 <pre>Combine this article: "A Cool Place for Cheap Flops" http://www.hpcwire.com/hpcwire/2012-04-11/a_cool_place_for_cheap_flops.html With this paper: "Relativistic Statistical Arbitrage" dspace.mit.edu/openaccess-disseminate/1721.1/62859 And it's looks like Iceland has a new industry: Datacenters for the high-frequency trading (HFT) gang. Just remember - you heard it here first, folks! ;) </pre> Prentice Bisbal 2012-04-20T13:37:34 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29493 <pre>The next release of Open Grid Scheduler/Grid Engine will be released at the Gompute User Group Meeting. The Gompute User Group Meeting is a free, 2-day, HPC event in Gothenburg, Sweden. Register for the event at: http://www.simdi.se/ ** Please let me know if you are interested in a Grid Engine track. Gridcore/Gompute contributed booth space at SC11 for the Grid Engine 2011.11 release (the first major release of open-source Grid Engine after separation from Oracle), and joined the Open Grid Scheduler project in April 2012. Rayson ================================= Open Grid Scheduler / Grid Engine http://gridscheduler.sourceforge.net/ Scalable Grid Engine Support Program http://www.scalablelogic.com/ </pre> Rayson Ho 2012-04-19T18:34:08 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29487 <pre>-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi folks, For hysterical raisins we have an IBM iDataPlex system which is running QDR IB in datagram mode. To that IB network we'll be adding another QDR system which can only run in connected mode. The kicker is that our IB network is used for GPFS over IPoIB and so our NSD's will need to move to connected mode for the new system. I've been Googling without success to find out if you can do such a migration live (i.e. change the servers to connected mode, increase their MTUs and then migrate clients to connected mode (we have enough redundancy in servers to do this) or whether we'll need to schedule an outage and take the whole system down and bring it back up in connected mode. Any thoughts? cheers, Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: samuel&lt; at &gt;unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.unimelb.edu.au/ -----BEGIN PGP SIGNATURE----- Version:</pre> Christopher Samuel 2012-04-19T01:53:51 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29478 <pre>Beowulfers, I'm planning on adding some upgrades to my existing cluster, which has 66 compute nodes pluss the head node. Networking consists of a Cisco 7012 IB switch with 6 out of 12 line cards installed, giving me a capacity of 72 DDR ports, expandable to 144, and two 40-port ethernet switches that have only six extra ports between them. I'd like to add a Lustre filesystem (over InfiniBand) to my cluster, and then begin adding/replacing nodes in the cluster. Obviously, I'll need to increase capacity of both my IB and ethernet networks. The questions I have are about upgrading my InifiniBand. 1. It looks like QLogic is out of the InfiniBand business. Is Mellanox the only game in town these days? 2. Due to the size of my cluster, it looks like buying a just a core/enterprise IB switch with capacity for ~100 ports is the best option (I don't expect my cluster to go much bigger than this in the next 4-5 years). Based on that criteria, it looks like the Mellanox IS5100 is my only option. Am I over looking</pre> Prentice Bisbal 2012-04-18T15:05:05 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29477 <pre>There were 2 security related bugs fixed and released in Grid Engine today: - Code injection via LD_* environment variables - sgepasswd buffer overflow Oracle fixed both of them in their CPU (Critical Patch Update) release for Oracle Grid Engine this afternoon. For Sun Grid Engine (6.2u5) and Open Grid Scheduler/Grid Engine, visit: http://gridscheduler.sourceforge.net/security.html The first one was found by William Hay back in Nov 2011. And the second one was reported by an outside security researcher to Oracle. The details of the bug were passed onto me, and we (all the Grid Engine forks) decided that we should share any security related information instead of putting it in marketing slides. Download patches and pre-compiled binaries for: - SGE 6.2u5, 6.2u5p1, 6.2u5p2 - Open Grid Scheduler/Grid Engine 2011.11 from the URL above. To apply the patches, just replace the older version of the binaries with the newer version. Rayson ================================= Open Grid Scheduler / Grid Engine h</pre> Rayson Ho 2012-04-18T00:06:23 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29475 <pre>I read a ZDnet article on Ubuntu LTS pitching to be your cloud and data centre distribution on choice. It mentions Ubunti Metal-As-A-Service http://www.markshuttleworth.com/archives/1103 https://wiki.ubuntu.com/ServerTeam/MAAS/ I guess this is what clustering types have been doing for a long time with various cluster deployment and management suites. Also note Mark Shuttleworths comment about the cost of the OS per node : "As we enter an era in which ATOM is as important in the data centre as XEON, an operating system like Ubuntu makes even more sense" I guess this chimes with the initial Beowulfery spirit - when you have low-cost nodes, why use an OS (whether it is Windows, Solaris etc) Which is a significant fraction of the nodes cost. John Hearns | CFD Hardware Specialist | McLaren Racing Limited McLaren Technology Centre, Chertsey Road, Woking, Surrey GU21 4YH, UK T: +44 (0) 1483 262000 D: +44 (0) 1483 262352 F: +44 (0) 1483 261928 E: john.hearns&lt; at &gt;mclaren.com W: www.mc</pre> Hearns, John 2012-04-17T15:26:23 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29474 <pre>hi, I'm reading in open mpi 2.2 standards and my eye fell onto something amazing. http://www.mpi-forum.org/docs/mpi-2.2/mpi22-report.pdf chapter 11 "one-sided communications" page 339: "it is erroneous to have concurrent conflicting accesses to the same memory location in a window" Does this mean that each update, either read or write in itself is atomic with infiniband? In computerchess it can happen we simply write and read to the same locations. This can result of course in garbled data. Most don't care, some like me store a CRC and care even less. Odds is relative small it happens, but it happens. About once each 200 billion operations there is an atomic coincidence that 2 writes happen to the same location i measured (at Origin3800 &lt; at &gt; 200 cpu's &lt; at &gt; 120GB ram), resulting in garbage written at that specific cacheline, or 2 consecutive cachelines sharing 20 bytes of data (obviously usually this last case happens - at PC hardware actually only the last case can occur and entries garb</pre> Vincent Diepeveen 2012-04-16T03:26:51 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29473 <pre>hi, Trying to make an new model for infiniband for Diep. I need some advice which functioncalls/libraries to use for fastest possible communication over infiniband (mellanox qdr) from one node to another. There is a lot of possibilities there but what's communicating fastest? I need 2 different types of communication possibly 3 or more. Still can setup the model there how to communicate now so let's test the water: a) each node has a 1.5GB cache. so that's 1.5 GB * n each core of each node is randomly needing 192 bytes. Don't know which node in advance and don't know where in the gigabytes of cache (hashtable) it needs to read. what library and which function call is best to ask for this? Realize all 8 cores are busy, if i need to keep 1 core free handling all requests from all other nodes, that slows down each machine significantly as i lose 1 core then. b) for starting and stopping the difference cores (at all nodes) in a de-centralized manner, some</pre> Vincent Diepeveen 2012-04-10T00:14:52 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29461 <pre>It's been some year or 12 that a genius visited me. His expertise being the same like Einsteins, it's not much of a question what his research topics were. Though not deep into computer hardware he told me that for massive computing, just above the 1Ghz border would prove to be a big barrier as electrons basically move at around 1/3 of the lightspeed, which translates to 1.3Ghz in metals like aluminium. At copper so he said that barrier might be a tad higher than aluminium, yet even then the power needed for such speeds would prove to be massive. At that moment intel's marketing department shouted out loud their P4's would clock 10Ghz by 2010. Well the P4 never got there and we got into the megacore count game for HPC. AMD Now AMD needs 4 PE's for doing double precision, so their core count of 1536 actually wasn't more than the 5000 series with 1600. Their new 7970 gpu with 2048 pe's has the double precision equivalent in core count of 512 compute cores. Actually the 7970 mostly prof</pre> Vincent Diepeveen 2012-03-25T18:47:00 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29447 <pre>Flagging up yet another Register article I'm afraid, but it is interesting http://www.theregister.co.uk/2012/03/20/google_greywater_data_center_coo ling/ The contents of this email are confidential and for the exclusive use of the intended recipient. If you receive this email in error you should not copy it, retransmit it, use it or disclose its contents but should return it to the sender immediately and delete your copy. </pre> Hearns, John 2012-03-21T14:11:51 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29438 <pre> http://www.heise.de/newsticker/meldung/Server-Blades-in-Oel-1471734.html (translation courtesy Google Translate): Server blades in oil Hardcore Computer LSS 200 Photo: Boston The U.S. company has with the hardcore computer Submerged Liquid server developed (LSS 200), a server blade in the format of immersion cooling uses: The entire unit sits in a closed housing which oil flows. This "Core Coolant" is according to the safety of a non-toxic and biodegradable compound based on a synthetic wax. The advantages of this cooling method is called Hardcore Computer eliminated including a more efficient cooling, because the coolant can be for example of a data center transported directly to heat exchangers, and going through cold air. Because no special rack delivers warm air directly into the environment, it can also be operated in locations without air conditioning. The server manufacturer in Boston, the LSS 200 is added to its product line and offers it in Germany. However, neither prices nor called Boston de</pre> Eugen Leitl 2012-03-14T15:22:24 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29418 <pre>http://www.theregister.co.uk/2012/03/08/supercomputing_vs_home_usage/ A rather nice Register article on costs for supercomputers, adjusted to 2010 dollars, And a rather interesting cost per megaflop table on the second page. The contents of this email are confidential and for the exclusive use of the intended recipient. If you receive this email in error you should not copy it, retransmit it, use it or disclose its contents but should return it to the sender immediately and delete your copy. </pre> Hearns, John 2012-03-08T13:43:10 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29413 <pre>Has anyone found an informative description of the Seamicro fabric? various heavily masticated reports on the web say it's a 3d torus, "low latency" and 160 GB/s (per link? bisecection? in-chassis?) thanks, mark. </pre> Mark Hahn 2012-03-04T19:35:59 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29407 <pre>Slightly off topic. Would some kind soul who is running Torque send me some sample output from pbsnodes -x Thanks The contents of this email are confidential and for the exclusive use of the intended recipient. If you receive this email in error you should not copy it, retransmit it, use it or disclose its contents but should return it to the sender immediately and delete your copy. </pre> Hearns, John 2012-03-01T11:37:58 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29406 <pre>On Thu, Mar 1, 2012 at 2:20 AM, Jan Wender &lt;j.wender&lt; at &gt;science-computing.de&gt; wrote: IMO, LSF has the best job preemption &amp; checkpointing support, with the least integration effort needed from the end user &amp; cluster administrator. And resource preemption and license preemption are the more advanced features of LSF. (There are more manual configuration needed for Grid Engine &amp; Open Grid Scheduler and/or other batch systems - not impossible, but needs knowledge on how to tune the scheduler.) There are 3 types of checkpointing supported by LSF: 1) kernel-level 2) user-level 3) application-level Kernel level is easy, the OS kernel handles everything for the user (for interactively processes) &amp; the batch system (for jobs). However, only IRIX, Cray UNICOS, and NEC SUPER-UX support kernel-level checkpointing. On Linux, you usually need to patch the kernel: - "Checkpoint/restart: it's complicated": http://lwn.net/Articles/414264/ - "Kernel-based checkpoint and restart": http://lwn.net/Articles/293575/ (Lot</pre> Rayson Ho 2012-03-01T08:22:16 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29403 <pre>Hi list! Is there any scheduler which has the functionality to automatically put a running job on hold when another job with higher priority is submitted? Preferably the state of the first job should be frozen, and saved to disk, so that it can be restarted again when the higher priority job has finished. Is this at all possible (we are using torque/maui, and I couldn't find this feature there)? Regards, /jon </pre> Jon Tegner 2012-03-01T06:52:36 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29402 <pre>http://www.eetimes.com/electronics-news/4237271/AMD-to-buy-microserver-startup-SeaMicro this is interesting. most of the coverage seems to interpret this as using opterons (which makes some sense, given the direction bulldozer is going, towards lots of space/power-effective cores.) but here's another prospect: a box with lots of APU chips that max out GPU density. lotsa gflops/watt, very compact... seamicro says their interconnect is special, low-lat, high-bw, but it sounds like an onboard 10Gb chip to me. calxeda's onboard distributed switch might be more interesting. regards, mark hahn. </pre> Mark Hahn 2012-03-01T06:16:49 http://comments.gmane.org/gmane.comp.clustering.beowulf.general/29399 <pre>thought some people here should see the Raspberry Pi -- $35 computer with Toronto-designed software sells out worldwide in minutes http://bit.ly/xDVEub [takes you to thestar.com] Say hi to the Raspberry Pi, the $35 computer (with photo) http://bit.ly/xDe8fJ [takes you to csmonitor.com] </pre> Douglas J. Trainor 2012-02-29T21:40:52 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.clustering.beowulf.general