A project to show basic operation using apache spark in scala
If you are new and looking for how to start using apache spark with scala, then you are at the right place to begin with apache spark in scala. Here is the way how to begin:
The following tools need to be installed before using the content
- Java sdk >=7.0
- Maven >=3.0.0
- Scala sdk >=2.11
- Apache spark >=2.0.0 (if you want to submit in spark local machine)
- Install java from here if java is not installed
- Install Maven by following the instructions
- Download and install apache spark
- Open any terminal
- Clone project
git clone [email protected]:shihabuddinbuet/apache-spark-abc.git
- Run
cd apache-spark-abc
- Run
mvn clean -DskipTests package
to build the project - Submit the jar in spark for any of the main apps
- Md shihab uddin - Initial work - shihabuddinbuet
See also the list of contributors who participated in this project.