In April 2016, I enrolled in my final module of the JCSE’s Continued Professional Development (CPD) programme. This year’s project was Big Data and Visualisation. Most of the groups opted for cloud-based computing platforms like Azure and Amazon in order to process their data. The group I was in, however, decided to go low-level and …
Category: Apache Spark
Fixing Apache Spark 1.6.x false error message for slave startup
I’ve been setting up an Apache Spark standalone cluster on a bunch of raspberry pi’s for a tertiary education project. When you’re running a slave on the same machine as the master, spinning up a slave instance works without hitch. However, when trying to start up a slave on a remote machine (even after having …