Environment

Runtime Information

NameValue
Java Home/opt/java/openjdk
Java Version11.0.23 (Eclipse Adoptium)
Scala Versionversion 2.12.10

Spark Properties

NameValue
dc.app.notification.lockmapdc.app.notification.lockmap
dc.app.notification.urlsredis://dc-redis:6379
spark.app-nameST_CTX_1
spark.app.idlocal-1747414928162
spark.app.initial.jar.urlsspark://localhost:7020/jars/hdh-spark-job-jar-with-dependencies.jar
spark.app.nameST_CTX_1
spark.app.startTime1747414925674
spark.blockManager.port7010
spark.cores.max7
spark.driver.bindAddresslocalhost
spark.driver.hostlocalhost
spark.driver.maxResultSize1g
spark.driver.port7020
spark.executor.iddriver
spark.executor.memory20g
spark.formula.http.timeout.connect200
spark.formula.http.timeout.read200
spark.hadoop.dfs.client.use.datanode.hostnamefalse
spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version2
spark.jars./hdh-spark-job-jar-with-dependencies.jar
spark.local.dir/tmp
spark.masterlocal[7]
spark.scheduler.allocation.file/opt/dev/work/fairScheduler.xml
spark.scheduler.modeFAIR
spark.scheduler.pooldefault
spark.sql.adaptive.enabledtrue
spark.sql.caseSensitivetrue
spark.ui.port4040

Hadoop Properties

System Properties

Classpath Entries