...
| Code Block |
|---|
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 3.1.1
/_/
Using Scala version 2.12.10 (OpenJDK 64-Bit Server VM, Java 11.0.20.1)
Type in expressions to have them evaluated.
Type :help for more information.
scala> :quit |
Spark Shell Web Browser UI
When Spark Shell is loaded, Spark Shell will setup a Web UI context on the compute node that Spark Shell launches as.
To use the Web UI, the IP address of the compute node would need to be entered as a replacement for the compute node name that Spark Shell provides.
| Code Block |
|---|
Spark context Web UI available at http://cnXX.storrs.hpc.uconn.edu:4040 |
To find the IP address of the assigned compute node, a separate window/terminal session on HPC would need to be opened and the following command entered in the new terminal:
| Code Block |
|---|
nslookup cnXX |
Where XX is the compute node number.
The IP address will be provided with the 137.99.x.x format.
Copy the 137.99.x.x IP address and replace the compute node name in the above link with the IP address for the compute node.
| Code Block |
|---|
http://IPAddressOfComputeNode.storrs.hpc.uconn.edu:4040 |
Once entered in a browser on the local PC, the Apache Spark UI should load and look like the following:
...