Tag Archives: map reduce

Setup Apache Spark in JetBrains IntelliJ (Scala Version)

Please refer this post to see how to setup JetBrains IntelliJ IDE and Scala on your machine. 1) Download latest version of Apache Spark from http://spark.apache.org/downloads.html 2) Unpack the tarball to /opt/spark folder 3) Launch IntelliJ, create a new Scala project and choose SBT as the Build tool. 4) Once IntelliJ IDE is up and all dependencies […]

Posted on April 27, 2017 by GauZ in Technology

Tags: , , , , , ,

0  

Tinkering with Apache Hadoop – Map Reduce Framework

I have used a Map Reduce based system at my present employer (Bank of America – Merrill Lynch) to process (read “crunch”) extremely large datasets in matter of seconds. Sometimes I used those to price bonds in real-time otherwise it was used for data processing/reporting purposes. It is an in-house product, known as Hugs framework […]

Posted on February 18, 2013 by GauZ in Java, Python, Statistics, Technology

Tags: , , , , , , , , , , , , , , , , , , ,

2