Install Spark Cluster
Sandbox clusters are single node clusters running on docker containers.
#
Instructions- Once you've created the workspace, its time to create your first cluster. Click on the Add Cluster as shown below. Provide local cluster details as per your requirement.
- Click on the start button to initialize and run the cluster. Once the cluster has been started, you can view the resources allocated and the logs.
#
Open Interactive ShellNow that we have the cluster up and running, we can interact with the cluster by opening an interacting shell from the terminal using the following command
Once you've open the interactive shell for the cluster, you can run
spark-shell
commands to explore Spark.