Clusters

These topics can help you manage your Spark clusters.

• How to Calculate the Number of Cores in a Cluster
• Problem: Cluster Failed to Launch
• Job Fails Due to Cluster Manager Core Instance Request Limit
• Problem: Admin User Cannot Restart Cluster to Run Job
• EBS Leaked Volumes
• Multi-Part Upload Failure
• Set Executor Log Level
• Problem: Apache Spark Job Doesn’t Start
• Unexpected Cluster Termination
• How to Configure Single-Core Executors to Run JNI Libraries
• How to Overwrite log4j Configurations on Databricks Clusters
• Problem: Adding a Configuration Setting Overwrites All Default spark.executor.extraJavaOptions Settings
• Problem: Apache Spark UI Shows Less Than Total Node Memory