Friday, August 7, 2020

Cluster prep work.

I use Ubuntu as my daily driver, so that it what I will use on the cluster. 
Download Ubuntu to my laptop, and add an ssh file as described at remote-access.

I've setup my network as follows.

An old WIFI router plugged into the Netgear switch.  This will be the gateway and has address 192.168.1.1
The 4GB raspi is assigned static IP 192.168.1.2 and hostname controller1
The 8GB raspis are assigned 192.158.1.3 through .8 and hostnames node1 through node6

The 128GB usb drive is mounted at /data on all nodes.

So now my network looks like this.

gateway        192.168.1.1
controller1    192.168.1.2
node1            192.168.1.3
node2            192.168.1.4
node3            192.168.1.5
node4            192.168.1.6
node5            192.168.1.7
node6            192.168.1.8

I've also plugged a laptop into the switch and it is sitting at
192.168.1.100.

Last thing to do is update all the hosts files and add an SSH key so I can execute commands on the nodes without having to login.





The start of little big things.

Do to the pandemic I'm stuck at home for the foreseeable future.
Might as well start a new project!

I've decided to build a raspberrypi cluster.

Parts for this project are

1x Raspi 4 4GB $55
6x Raspi 4 8GB $75
6x Seagate BarraCuda 4TB $93
7x Samsung FIT Plus USB 3.1 Flash Drive 128GB $25
7x SanDisk Ultra SDSQUNS-016G-GN3MN 16GB $6
6x X835 SATA HDD board from Geekworm $43
1x NETGEAR 10-Port Gigabit/10G Ethernet Unmanaged Switch (GS110MX) $165

Total $1746, plus miscellaneous (cables, power supplies etc) the whole  things is under $2k.

The cluster in total will have.
28 cores
52 GB ram
896 GB of SSD on usb thumb drives
24 TB of storage on spinning drives

I've even come up with a name for this little beasty.
Let me introduce the jaggerbush!

Cluster prep work.

I use Ubuntu as my daily driver, so that it what I will use on the cluster.  Download  Ubuntu  to my laptop, and add an ssh file as describe...