Mount temporary directory

Learn how to mount a temporary directory for the KubernetesPodOperator on Astro.

You can run a task run the KubernetesPodOperator that uses your Deployment’s ephemeral storage, mount an emptyDir volume to the KubernetesPodOperator.

Prerequisites

• Set up the KubernetesPodOperator on Astro.

Setup

1. Mount an emptyDir volume
2. Add the following code example to your KubernetesPodOperator configuration.
3. from airflow.configuration import conf
   from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator
   from kubernetes.client import models as k8s
   
   volume = k8s.V1Volume(
       name="cache-volume",
       emptyDir={},
   )
   
   volume_mounts = [
       k8s.V1VolumeMount(
           mount_path="/cache", name="cache-volume"
       )
   ]
   
   example_volume_test = KubernetesPodOperator(
       namespace=namespace,
       image="<your-docker-image>",
       cmds=["<commands-for-image>"],
       arguments=["<arguments-for-image>"],
       labels={"<pod-label>": "<label-name>"},
       name="<pod-name>",
       task_id="<task-name>",
       get_logs=True,
       in_cluster=True,
       volume_mounts=volume_mounts,
       volumes=[volume],
   )