Tag Archives: setup

Run pyspark on your windows machine

1) Download Spark lib on your local machine and decompress the archive. Then set SPARK_HOME and HADOOP_HOME env variables to point to this decompressed folder location – For example: C:\Users\some_user\PycharmProjects\spark-2.4.4-bin-hadoop2.7 Also lookup the winutils executable online and you need to put it in the spark bin folder. 2) Install Java JDK if you do not […]

Posted on September 13, 2019 by GauZ in Pyspark, spark

Tags: , , , , ,

0  

Install JetBrains IntelliJ IDE with Scala plugin

I recently formatted my machine and have cleanly installed Ubuntu 17.04. I was planning to install JetBrains IntelliJ with Scala plugin and below steps will show you how to do that. 1) Download IntelliJ Community Edition from https://www.jetbrains.com/idea/download. As of today, I’m downloading version: ideaIC-2017.1.2 2) Extract the tarball somewhere or say under /home/{yourhomefolder}/apps and switch […]

Posted on April 27, 2017 by GauZ in Technology

Tags: , , , , , , , , , ,

0