DEV Community

Discussion on: Building a Raspberry Pi Hadoop / Spark Cluster

Collapse
 
pidevi profile image
PiDevi

Hi Andrew, thanks for sharing this with us!

Following your instruction I have managed to run HDFS and YARN on my cluster using openJDK-8 instead of Oracle Java (is not pre-installed on Raspbian Buster and can't be installed via apt).

However, when running the wordcount example.

> yarn jar hadoop-mapreduce-examples-3.2.0.jar wordcount "/books/alice.txt" output
Enter fullscreen mode Exit fullscreen mode

following error occurs

Error: Java heap space
Error: Java heap space
Error: Java heap space
Enter fullscreen mode Exit fullscreen mode

and the job fails.

Do you have any idea what the reason might be?