Skip to content

Chart: spark-on-k8s

A Helm chart for spark-on-k8s API and Web UI.

To deploy the spark-on-k8s API and Web UI, use the following command:

helm repo add spark-on-k8s https://hussein.awala.fr/spark-on-k8s-chart
helm repo update
helm install <release-name> spark-on-k8s/spark-on-k8s --values <path-to-values-file>

Sections

root

alues that are defined in the root of the values file.

image

Docker image configuration for the Spark-on-K8S deployment

serviceAccount

The service account configuration for the Spark-on-K8S deployment

rbac

RBAC ownership is independent of service-account ownership.

podSecurityContext

The pod security context for the Spark-on-K8S deployment. The defaults meet Pod Security "restricted" for the API image's non-root user; set a key to null to remove it.

securityContext

The security context for the Spark-on-K8S deployment container

service

The configuration for the Spark-on-K8S service

ingress

The configuration for the Spark-on-K8S ingress

autoscaling

The autoscaling configuration for the Spark-on-K8S deployment

sparkHistory

Configuration for the Spark History Server

runHistory

Optional operational metadata recorder; separate from Spark History Server event logs.

metrics

Prometheus text endpoint; remote mode requires the same operator bearer token.

remote

Remote job submission. Enabling it also requires the operator bearer token on every API route except /health and /ready. The token is one shared operator credential, not tenant isolation; submissions also need write RBAC (readOnly: false or external grants).

podDisruptionBudget

PodDisruptionBudget for the API pods. A budget that permits no voluntary disruption, such as minAvailable 1 with one replica, fails rendering because it blocks node drains.

networkPolicy

NetworkPolicy for the API pods. It takes effect only with a network plugin that enforces NetworkPolicy; other plugins accept the object and ignore it.


application chart version (0.4.0) running application version (unreleased)