Paths

Table of Contentst

Differential D3276

Create workspace directory for Airflow pipelines
ClosedPublic
Actions

Authored by dereckson on Jan 13 2024, 18:21.

Details

Reviewers

dereckson

Maniphest Tasks

T1812: Deploy Airflow

Commits

rOPSe584e2dcf7d0: Create workspace directory for Airflow pipelines

Summary

The FANTOIR pipeline requires a working directory. The directory ~/workspace
is mounted in every Airflow container, including airflow <realm> shell
for maintenance purpose.

Ref T1812.

Test Plan

Use that directory with D2754.

Diff Detail

Repository

rOPS Nasqueron Operations

Lint

Lint Not Applicable

Unit

Tests Not Applicable

Event Timeline

dereckson requested review of this revision.Jan 13 2024, 18:21

dereckson created this revision.

Harbormaster completed remote builds in B5172: Diff 8419.Jan 13 2024, 18:21

dereckson added a child revision: D2754: Run fantoir-datasource as Airflow pipeline.Jan 13 2024, 18:21

+wrapper

Harbormaster completed remote builds in B5173: Diff 8420.Jan 13 2024, 18:21

Dwellers

$ airflow nasqueron shell
$ airflow variables get fantoir_directory
/home/airflow/workspace/fantoir
$ ls ~/workspace
fantoir

This revision is now accepted and ready to land.Jan 13 2024, 18:36

Closed by commit rOPSe584e2dcf7d0: Create workspace directory for Airflow pipelines (authored by dereckson). · Explain WhyJan 13 2024, 18:46

This revision was automatically updated to reflect the committed changes.

dereckson added a commit: rOPSe584e2dcf7d0: Create workspace directory for Airflow pipelines.

Revision Contents
Changeset List

Path

Size

roles/

paas-docker/

containers/

airflow.sls

3 lines

files/

airflow/

airflow.sh.jinja

1 line

Diff 8421

View Options

roles/paas-docker/containers/airflow.sls