Skip to content

sparkHistory

Configuration for the Spark History Server

Type: object

Path: sparkHistory


enabled

Specifies whether the Spark History Server should be enabled

Default: false

Type: boolean

Path: sparkHistory.enabled


replicaCount

The number of replicas for the Spark History Server if autoscaling is disabled

Default: 1

Type: number

Path: sparkHistory.replicaCount


autoscaling

The autoscaling configuration for the Spark History Server

Type: object

Path: sparkHistory.autoscaling


enabled

Specifies whether autoscaling should be enabled

Default: false

Type: boolean

Path: sparkHistory.autoscaling.enabled


minReplicas

The minimum number of replicas

Default: 1

Type: number

Path: sparkHistory.autoscaling.minReplicas


maxReplicas

The maximum number of replicas

Default: 100

Type: number

Path: sparkHistory.autoscaling.maxReplicas


targetCPUUtilizationPercentage

The target CPU utilization percentage

Default: 80

Type: number

Path: sparkHistory.autoscaling.targetCPUUtilizationPercentage


image

Docker image configuration for the Spark History Server

Type: object

Path: sparkHistory.image


repository

The Docker image repository

Default: ghcr.io/hussein-awala/spark-history

Type: string

Path: sparkHistory.image.repository


pullPolicy

The deployment docker image pull policy

Default: IfNotPresent

Type: string

Path: sparkHistory.image.pullPolicy


tag

The Docker image tag

Default: latest

Type: string

Path: sparkHistory.image.tag


env

Annotations to be added to the Spark History Server pods

Default: []

Type: list

Path: sparkHistory.env


resources

The resource configuration for the Spark History Server

Default: {}

Type: string

Path: sparkHistory.resources


volumeMounts

A list of volume mounts to be added to the Spark History Server pods

Default: []

Type: list

Path: sparkHistory.volumeMounts


volumes

A list of volumes to be added to the Spark History Server pods

Default: []

Type: list

Path: sparkHistory.volumes


podAnnotations

Annotations to be added to the Spark History Server pods

Default: {}

Type: string

Path: sparkHistory.podAnnotations


podLabels

Labels to be added to the Spark History Server pods

Default: {}

Type: string

Path: sparkHistory.podLabels


podSecurityContext

The pod security context for the Spark History Server

Default: {}

Type: string

Path: sparkHistory.podSecurityContext


securityContext

The security context for the Spark History Server

Default: {}

Type: string

Path: sparkHistory.securityContext


serviceAccount

The service account configuration for the Spark History Server

Type: object

Path: sparkHistory.serviceAccount


create

Specifies whether a service account should be created

Default: true

Type: boolean

Path: sparkHistory.serviceAccount.create


automount

Specifies whether the service account token should be auto mounted

Default: true

Type: boolean

Path: sparkHistory.serviceAccount.automount


annotations

Annotations to add to the service account

Default: {}

Type: string

Path: sparkHistory.serviceAccount.annotations


name

The name of the service account to use.

Default: ""

Type: string

Path: sparkHistory.serviceAccount.name


service

The configuration for the Spark History Server service

Type: object

Path: sparkHistory.service


type

The type of service to create

Default: ClusterIP

Type: string

Path: sparkHistory.service.type


port

The port to expose the service on

Default: 18080

Type: number

Path: sparkHistory.service.port


configuration

The Spark configuration for the Spark History Server

Default: ""

Type: string

Path: sparkHistory.configuration