Paths

Table of Contentst

Differential D3276

Create workspace directory for Airflow pipelines
ClosedPublic
Actions

Authored by dereckson on Jan 13 2024, 18:21.

Details

Reviewers

dereckson

Maniphest Tasks

T1812: Deploy Airflow

Commits

rOPSe584e2dcf7d0: Create workspace directory for Airflow pipelines

Summary

The FANTOIR pipeline requires a working directory. The directory ~/workspace
is mounted in every Airflow container, including airflow <realm> shell
for maintenance purpose.

Ref T1812.

Test Plan

Use that directory with D2754.

Diff Detail

Repository

rOPS Nasqueron Operations

Lint

Lint Passed

Unit

No Test Coverage

Branch

airflow-workspace

Build Status

Buildable 5173
Build 5454: arc lint + arc unit

Event Timeline

dereckson requested review of this revision.Jan 13 2024, 18:21

dereckson created this revision.

Harbormaster completed remote builds in B5172: Diff 8419.Jan 13 2024, 18:21

dereckson added a child revision: D2754: Run fantoir-datasource as Airflow pipeline.Jan 13 2024, 18:21

+wrapper

Harbormaster completed remote builds in B5173: Diff 8420.Jan 13 2024, 18:21

Dwellers

$ airflow nasqueron shell
$ airflow variables get fantoir_directory
/home/airflow/workspace/fantoir
$ ls ~/workspace
fantoir

This revision is now accepted and ready to land.Jan 13 2024, 18:36

Closed by commit rOPSe584e2dcf7d0: Create workspace directory for Airflow pipelines (authored by dereckson). · Explain WhyJan 13 2024, 18:46

This revision was automatically updated to reflect the committed changes.

dereckson added a commit: rOPSe584e2dcf7d0: Create workspace directory for Airflow pipelines.

Revision Contents
Changeset List

Path

Size

roles/

paas-docker/

containers/

airflow.sls

3 lines

files/

airflow/

airflow.sh.jinja

1 line

Diff 8420

View Options

roles/paas-docker/containers/airflow.sls