sparkHistory¶
Configuration for the Spark History Server
Type: object
Path: sparkHistory
enabled¶
Specifies whether the Spark History Server should be enabled
Default: false
Type: boolean
Path: sparkHistory.enabled
replicaCount¶
The number of replicas for the Spark History Server if autoscaling is disabled
Default: 1
Type: number
Path: sparkHistory.replicaCount
autoscaling¶
The autoscaling configuration for the Spark History Server
Type: object
Path: sparkHistory.autoscaling
enabled¶
Specifies whether autoscaling should be enabled
Default: false
Type: boolean
Path: sparkHistory.autoscaling.enabled
minReplicas¶
The minimum number of replicas
Default: 1
Type: number
Path: sparkHistory.autoscaling.minReplicas
maxReplicas¶
The maximum number of replicas
Default: 100
Type: number
Path: sparkHistory.autoscaling.maxReplicas
targetCPUUtilizationPercentage¶
The target CPU utilization percentage
Default: 80
Type: number
Path: sparkHistory.autoscaling.targetCPUUtilizationPercentage
image¶
Docker image configuration for the Spark History Server
Type: object
Path: sparkHistory.image
repository¶
The Docker image repository
Default: ghcr.io/hussein-awala/spark-history
Type: string
Path: sparkHistory.image.repository
pullPolicy¶
The deployment docker image pull policy
Default: IfNotPresent
Type: string
Path: sparkHistory.image.pullPolicy
tag¶
Required when enabled unless digest is set; this image has a separate release lifecycle.
Default: ""
Type: string
Path: sparkHistory.image.tag
digest¶
Optional immutable sha256 digest; takes precedence over tag.
Default: ""
Type: string
Path: sparkHistory.image.digest
env¶
A list of environment variables to be added to the Spark History Server container
Default: []
Type: list
Path: sparkHistory.env
resources¶
The resource configuration for the Spark History Server
Default: {}
Type: string
Path: sparkHistory.resources
volumeMounts¶
A list of volume mounts to be added to the Spark History Server pods
Default: []
Type: list
Path: sparkHistory.volumeMounts
volumes¶
A list of volumes to be added to the Spark History Server pods
Default: []
Type: list
Path: sparkHistory.volumes
podAnnotations¶
Annotations to be added to the Spark History Server pods
Default: {}
Type: string
Path: sparkHistory.podAnnotations
podLabels¶
Labels to be added to the Spark History Server pods
Default: {}
Type: string
Path: sparkHistory.podLabels
podSecurityContext¶
The pod security context for the Spark History Server
Default: {}
Type: string
Path: sparkHistory.podSecurityContext
securityContext¶
The security context for the Spark History Server
Default: {}
Type: string
Path: sparkHistory.securityContext
serviceAccount¶
The service account configuration for the Spark History Server
Type: object
Path: sparkHistory.serviceAccount
create¶
Specifies whether a service account should be created
Default: true
Type: boolean
Path: sparkHistory.serviceAccount.create
automount¶
Specifies whether the service account token should be auto mounted
Default: true
Type: boolean
Path: sparkHistory.serviceAccount.automount
annotations¶
Annotations to add to the service account
Default: {}
Type: string
Path: sparkHistory.serviceAccount.annotations
name¶
The name of the service account to use.
Default: ""
Type: string
Path: sparkHistory.serviceAccount.name
service¶
The configuration for the Spark History Server service
Type: object
Path: sparkHistory.service
type¶
The type of service to create
Default: ClusterIP
Type: string
Path: sparkHistory.service.type
port¶
The port to expose the service on
Default: 18080
Type: number
Path: sparkHistory.service.port
nodeSelector¶
The node selector for the Spark History Server pods
Default: {}
Type: string
Path: sparkHistory.nodeSelector
affinity¶
The affinity for the Spark History Server pods
Default: {}
Type: string
Path: sparkHistory.affinity
tolerations¶
The tolerations for the Spark History Server pods
Default: []
Type: list
Path: sparkHistory.tolerations
configuration¶
The Spark configuration for the Spark History Server
Default: ""
Type: string
Path: sparkHistory.configuration
readinessProbe¶
Readiness probe on the History Server UI port; null removes it. To use another handler,
also set httpGet to null.
Type: object
Path: sparkHistory.readinessProbe
httpGet¶
Type: object
Path: sparkHistory.readinessProbe.httpGet
path¶
Default: /api/v1/version
Type: string
Path: sparkHistory.readinessProbe.httpGet.path
port¶
Default: 18080
Type: number
Path: sparkHistory.readinessProbe.httpGet.port
initialDelaySeconds¶
Default: 10
Type: number
Path: sparkHistory.readinessProbe.initialDelaySeconds
periodSeconds¶
Default: 10
Type: number
Path: sparkHistory.readinessProbe.periodSeconds
timeoutSeconds¶
Default: 5
Type: number
Path: sparkHistory.readinessProbe.timeoutSeconds
failureThreshold¶
Default: 3
Type: number
Path: sparkHistory.readinessProbe.failureThreshold
livenessProbe¶
Liveness probe on the History Server UI port; null removes it. It allows two minutes of
failures so slow event-log scans and garbage-collection pauses do not restart the server.
Type: object
Path: sparkHistory.livenessProbe
httpGet¶
Type: object
Path: sparkHistory.livenessProbe.httpGet
path¶
Default: /api/v1/version
Type: string
Path: sparkHistory.livenessProbe.httpGet.path
port¶
Default: 18080
Type: number
Path: sparkHistory.livenessProbe.httpGet.port
initialDelaySeconds¶
Default: 60
Type: number
Path: sparkHistory.livenessProbe.initialDelaySeconds
periodSeconds¶
Default: 20
Type: number
Path: sparkHistory.livenessProbe.periodSeconds
timeoutSeconds¶
Default: 5
Type: number
Path: sparkHistory.livenessProbe.timeoutSeconds
failureThreshold¶
Default: 6
Type: number
Path: sparkHistory.livenessProbe.failureThreshold
podDisruptionBudget¶
PodDisruptionBudget for the History Server pods; same rules as podDisruptionBudget
Type: object
Path: sparkHistory.podDisruptionBudget
enabled¶
Specifies whether the budget should be created
Default: false
Type: boolean
Path: sparkHistory.podDisruptionBudget.enabled
minAvailable¶
Pods that must stay available, as a number or percentage; set this or maxUnavailable
Default: null
Type: string
Path: sparkHistory.podDisruptionBudget.minAvailable
maxUnavailable¶
Pods that may be unavailable, as a number or percentage; 1 when both are null
Default: null
Type: string
Path: sparkHistory.podDisruptionBudget.maxUnavailable
networkPolicy¶
NetworkPolicy for the History Server pods; their egress, such as to event-log storage,
stays unrestricted
Type: object
Path: sparkHistory.networkPolicy
enabled¶
Admit only the API pods and ingress.from to the History Server port
Default: false
Type: boolean
Path: sparkHistory.networkPolicy.enabled
ingress¶
Type: object
Path: sparkHistory.networkPolicy.ingress
from¶
Additional NetworkPolicy peers allowed to reach the History Server port
Default: []
Type: list
Path: sparkHistory.networkPolicy.ingress.from