Re: Building a small supercomputer
I have set up a mosix cluster once upon a time, ages ago, maybe 1999?, just for fun. Don't recall too many details though, so I doubt I can be much help. I don't recall it being difficult though.
Also messed around with the SCO Unixware based Compaq/Tandem NonStop clusters, a single-system-image clustering thing mostly used by telcos a little bit -- was right across from the guys demoing it at SCO forum in 2000, iirc. (Wow, SCO went into a tailspin, eh?) I think they used a proprietary interconnect -- Servernet, were moving to infiniband, or something. Not sure what's going on with it now, but, iirc, some of the same guys that worked on the NonStop clustering stuff went on to work on the open source SSI stuff.
IIRC, most of these clustering systems, even the SSI ones have the problem that sockets don't migrate, so if you migrate a process from one machine to another, the network connections which that process are using remain routed through the original NIC in the original host, and it's a bit of a hard problem due to the way internet routing works, iirc. (e.g. Auspex NFS servers solved a similar problem by having special network hardware, iirc.) But it's been years since I last looked at this stuff, so maybe they've figured something out.
Depending on your application, it may not be a concern.
Last edited by Ferrous Lepidoptera; 12-11-2006 at 04:31 PM.