Apache Spark includes a web UI that provides detailed information about jobs that are running or completed.
Use the Spark UI when you need more information about a job than what's available in job logs (see View Job Logs).
- Open the cluster console for the cluster. See Access the Big Data Cloud Console.
- Click Jobs.
The Spark Jobs page is displayed.
- From the menu for the job you want to explore, select Spark UI.
The Spark UI window is displayed, from which you can drill down and access details about the job.