Monitor and Troubleshoot Jobs

Apache Spark includes a web UI that provides detailed information about jobs that are running or completed.

Use the Spark UI when you need more information about a job than what's available in job logs (see View Job Logs).

To access the Spark UI:
  1. Open the cluster console for the cluster. See Access the Big Data Cloud Console.
  2. Click Jobs.

    The Spark Jobs page is displayed.

  3. From the Menu icon menu for the job you want to explore, select Spark UI.

    The Spark UI window is displayed, from which you can drill down and access details about the job.

For specific information about the Spark UI, see the Apache Spark documentation.