Page MenuHomeDevCentral
Differential D3281

Provision Airflow DAGs folders
ClosedPublic
Actions

Authored by dereckson on Jan 14 2024, 11:34.
Tags
None
Referenced Files
Unknown Object (File)
Sun, Nov 24, 22:54
Unknown Object (File)
Sun, Nov 24, 22:54
Unknown Object (File)
Sun, Nov 24, 22:54
Unknown Object (File)
Sun, Nov 24, 22:54
Unknown Object (File)
Sun, Nov 24, 22:54
Unknown Object (File)
Sat, Nov 23, 16:44
Unknown Object (File)
Fri, Nov 22, 17:24
Unknown Object (File)
Fri, Nov 22, 16:23
View All Files
Subscribers
None

Details

Reviewers
dereckson
Maniphest Tasks
T1812: Deploy Airflow
Commits
rOPSde2fb22e15a3: Provision Airflow DAGs folders
Summary

Clone DAGs repositories and copy content to /srv/airflow/<realm>/dags,
using if needed a specific branch, revision or tag.

This state is intended to be called when new commit lands,
using Salt Reactor, as defined in D3280.

Ref T1812

Test Plan

salt dwellers state.apply roles/saas-airflow

Diff Detail

Repository
rOPS Nasqueron Operations
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

dereckson requested review of this revision.Jan 14 2024, 11:34
dereckson created this revision.
Harbormaster completed remote builds in B5187: Diff 8440.Jan 14 2024, 11:34
dereckson updated this revision to Diff 8441.Jan 14 2024, 11:35

Make directory src/

Harbormaster completed remote builds in B5188: Diff 8441.Jan 14 2024, 11:35
dereckson updated this revision to Diff 8442.Jan 14 2024, 11:38

Hunt insecable spaces

Harbormaster completed remote builds in B5189: Diff 8442.Jan 14 2024, 11:38
dereckson updated this revision to Diff 8443.Jan 14 2024, 11:47

Fix state through Complector test deployment

Harbormaster completed remote builds in B5190: Diff 8443.Jan 14 2024, 11:47
dereckson mentioned this in D3280: Configure Salt reactor to provision Airflow pipeline for datasources.Jan 14 2024, 11:49
dereckson added a comment.Jan 14 2024, 17:05

Works fine. https://airflow.nasqueron.org/dags/fantoir_fetch/grid for example

dereckson accepted this revision.Jan 14 2024, 17:05
This revision is now accepted and ready to land.Jan 14 2024, 17:05
Closed by commit rOPSde2fb22e15a3: Provision Airflow DAGs folders (authored by dereckson). · Explain WhyJan 14 2024, 17:06
This revision was automatically updated to reflect the committed changes.
dereckson added a commit: rOPSde2fb22e15a3: Provision Airflow DAGs folders.

Revision Contents
Changeset List

PathSize
pillar/
saas/
27 lines
1 line
roles/
saas-airflow/
dags/
36 lines
9 lines
1 line

Diff 8446

View Options

pillar/saas/airflow.sls

Loading...
View Options

pillar/top.sls

Loading...
View Options

roles/saas-airflow/dags/init.sls

Loading...
View Options

roles/saas-airflow/init.sls

Loading...
View Options

top.sls

Loading...
Nasqueron DevCentral · If it had been much bigger the moon would have had a core of ice. · Powered by Phabricator