Page MenuHomeDevCentral
Feed All Stories

Jan 15 2024

dereckson moved T1944: Ensure portsnap is available where we use ports from Backlog to Servers config on the Salt board.
Jan 15 2024, 21:50 · Salt, Servers
dereckson triaged T1944: Ensure portsnap is available where we use ports as Normal priority.
Jan 15 2024, 21:50 · Salt, Servers
dereckson added a comment to D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.

For example, when ICU was updated:

Jan 15 2024, 21:44
dereckson updated the diff for D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.

packages_prefixes

Jan 15 2024, 21:41
dereckson updated the diff for D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.

black

Jan 15 2024, 21:39
dereckson added a revision to T1888: Add XML support on db-A PostgreSQL: D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Jan 15 2024, 21:37 · upstream, DBA, Servers
dereckson requested review of D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Jan 15 2024, 21:37
dereckson added a revision to T1943: Orbeon Forms trigger an error after application is submit: D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Jan 15 2024, 21:37 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson committed rOPS6cde786b66e2: Update leap seconds file for NTP (authored by dereckson).
Update leap seconds file for NTP
Jan 15 2024, 20:00
dereckson closed D3289: Update leap seconds file for NTP.
Jan 15 2024, 20:00
dereckson accepted D3289: Update leap seconds file for NTP.
Jan 15 2024, 20:00
dereckson requested review of D3289: Update leap seconds file for NTP.
Jan 15 2024, 19:59
dereckson committed rOPSe822d8546deb: Provide Python 3 interpreter as python3 executable (authored by dereckson).
Provide Python 3 interpreter as python3 executable
Jan 15 2024, 19:57
dereckson closed D3288: Provide Python 3 interpreter as python3 executable.
Jan 15 2024, 19:57
dereckson accepted D3288: Provide Python 3 interpreter as python3 executable.
Jan 15 2024, 19:56
dereckson updated the diff for D3288: Provide Python 3 interpreter as python3 executable.

shellcheck

Jan 15 2024, 19:56
dereckson requested review of D3288: Provide Python 3 interpreter as python3 executable.
Jan 15 2024, 19:55
dereckson closed T1943: Orbeon Forms trigger an error after application is submit as Resolved.
Jan 15 2024, 00:21 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson closed T1888: Add XML support on db-A PostgreSQL, a subtask of T1943: Orbeon Forms trigger an error after application is submit, as Resolved.
Jan 15 2024, 00:21 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson closed T1888: Add XML support on db-A PostgreSQL as Resolved.
Jan 15 2024, 00:21 · upstream, DBA, Servers
dereckson closed T1888: Add XML support on db-A PostgreSQL, a subtask of T1884: Deploy Orbeon Forms, as Resolved.
Jan 15 2024, 00:21 · Nasqueron Docker deployment squad, Docker images, Product evaluation
dereckson closed D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:20
dereckson committed rOPS5db68870099b: Fix PostgreSQL 15 build instructions (authored by dereckson).
Fix PostgreSQL 15 build instructions
Jan 15 2024, 00:20
dereckson accepted D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19
dereckson updated the test plan for D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19
dereckson requested review of D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19
dereckson added a revision to T1888: Add XML support on db-A PostgreSQL: D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19 · upstream, DBA, Servers
dereckson added a comment to T1888: Add XML support on db-A PostgreSQL.

I've added documentation to https://agora.nasqueron.org/Operations_grimoire/FreeBSD#PostgreSQL without real conviction.

Jan 15 2024, 00:16 · upstream, DBA, Servers
dereckson lowered the priority of T1943: Orbeon Forms trigger an error after application is submit from High to Normal.

Fixed. Form works again.

Jan 15 2024, 00:13 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson moved T1943: Orbeon Forms trigger an error after application is submit from Backlog to Working on on the Nasqueron Docker deployment squad board.
Jan 15 2024, 00:06 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson moved T1943: Orbeon Forms trigger an error after application is submit from Backlog to Working on on the Servers board.

I'm rebuilding PostgreSQL 15.4 with XML support on db-A-001.

Jan 15 2024, 00:06 · Servers, Nasqueron Docker deployment squad, Launch community

Jan 14 2024

dereckson added a revision to T1812: Deploy Airflow: D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:27 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a task to D3286: Force Airflow DAGs repository update: T1812: Deploy Airflow.
Jan 14 2024, 23:27
dereckson closed D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:26
dereckson committed rOPS79583a13e893: Force Airflow DAGs repository update (authored by dereckson).
Force Airflow DAGs repository update
Jan 14 2024, 23:26
dereckson accepted D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:26
dereckson requested review of D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:26
dereckson added a subtask for T1943: Orbeon Forms trigger an error after application is submit: T1888: Add XML support on db-A PostgreSQL.
Jan 14 2024, 23:19 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson added a parent task for T1888: Add XML support on db-A PostgreSQL: T1943: Orbeon Forms trigger an error after application is submit.
Jan 14 2024, 23:19 · upstream, DBA, Servers
dereckson added a comment to T1943: Orbeon Forms trigger an error after application is submit.

Jan 14 23:13:52 db-A-001 postgres[35351]: [7-1] 2024-01-14 23:13:52.659 UTC [35351] ERROR: unsupported XML feature

Jan 14 2024, 23:19 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson reopened T1888: Add XML support on db-A PostgreSQL as "Open".

When upgraded to FreeBSD 14, we lost this.

Jan 14 2024, 23:18 · upstream, DBA, Servers
dereckson reopened T1888: Add XML support on db-A PostgreSQL, a subtask of T1884: Deploy Orbeon Forms, as Open.
Jan 14 2024, 23:18 · Nasqueron Docker deployment squad, Docker images, Product evaluation
dereckson updated subscribers of T1943: Orbeon Forms trigger an error after application is submit.

When clicking to Save Progress:

Jan 14 2024, 23:17 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson updated the task description for T1943: Orbeon Forms trigger an error after application is submit.
Jan 14 2024, 22:55 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson triaged T1943: Orbeon Forms trigger an error after application is submit as High priority.
Jan 14 2024, 22:55 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson added a comment to D2754: Run fantoir-datasource as Airflow pipeline.

Notification successfully reached the Notifications Center. Here an extract of the event through Sentry discover:

Jan 14 2024, 22:50
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

task_ids for task_instance.xcom_pull

Jan 14 2024, 22:21
dereckson planned changes to D2754: Run fantoir-datasource as Airflow pipeline.

Currently, the fetch pipeline fails at the notify step:

Jan 14 2024, 22:16
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

Rebase

Jan 14 2024, 22:10
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

Rebase. Bump Airflow version.

Jan 14 2024, 21:58
dereckson closed D3285: Check FANTOIR filename using FANTOIRMMYY format.
Jan 14 2024, 21:57
dereckson committed rDS6cf1892e0e44: Check FANTOIR filename using FANTOIRMMYY format (authored by dereckson).
Check FANTOIR filename using FANTOIRMMYY format
Jan 14 2024, 21:57
dereckson accepted D3285: Check FANTOIR filename using FANTOIRMMYY format.
Jan 14 2024, 21:57
dereckson requested review of D3285: Check FANTOIR filename using FANTOIRMMYY format.
Jan 14 2024, 21:57
dereckson closed D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 21:25
dereckson committed rOPSb4dc5820ee6b: Mount Airflow volumes in maintenance container too (authored by dereckson).
Mount Airflow volumes in maintenance container too
Jan 14 2024, 21:25
dereckson accepted D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 21:25
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.
  • Notification gate is singular
  • Get FANTOIR connection from secret back-end
  • Inject PATH in environment so we can find fantoir-datasource in /usr/local/bin
  • Decode bytes and split lines into a list for stdout, stderr
Jan 14 2024, 21:24
dereckson added a revision to T1812: Deploy Airflow: D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson updated the summary of D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50
dereckson requested review of D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50
dereckson committed rDAF0ad3018bf03a: Inject fantoir-datasource in Airflow image (authored by dereckson).
Inject fantoir-datasource in Airflow image
Jan 14 2024, 19:12
dereckson closed D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:12
dereckson accepted D3283: Inject fantoir-datasource in Airflow image.

Both fantoir-datasource fetch and fantoir-datasource import work correctly in airflow nasqueron shell: rows are correctly imported into PostgreSQL database.

Jan 14 2024, 19:12
dereckson added a revision to T1812: Deploy Airflow: D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:10 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson requested review of D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:10
dereckson closed D3282: Provide build instructions and Docker image.
Jan 14 2024, 18:53
dereckson committed rDS77691169e3a7: Provide build instructions and Docker image (authored by dereckson).
Provide build instructions and Docker image
Jan 14 2024, 18:53
dereckson updated the diff for D3282: Provide build instructions and Docker image.

Improve Makefile

Jan 14 2024, 18:52
dereckson accepted D3282: Provide build instructions and Docker image.
Jan 14 2024, 18:49
dereckson requested review of D3282: Provide build instructions and Docker image.
Jan 14 2024, 18:48
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

Create table if it doesn't exist

Jan 14 2024, 18:41
dereckson committed rOPSde2fb22e15a3: Provision Airflow DAGs folders (authored by dereckson).
Provision Airflow DAGs folders
Jan 14 2024, 17:06
dereckson closed D3281: Provision Airflow DAGs folders.
Jan 14 2024, 17:06
dereckson accepted D3281: Provision Airflow DAGs folders.
Jan 14 2024, 17:05
dereckson added a comment to D3281: Provision Airflow DAGs folders.

Works fine. https://airflow.nasqueron.org/dags/fantoir_fetch/grid for example

Jan 14 2024, 17:05
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

TaskFlow DAGs are defined by a function, but that function needs to be called.

Jan 14 2024, 17:04
dereckson added a comment to D2754: Run fantoir-datasource as Airflow pipeline.

At the end of the TaskFlow DAG, function should be called, for example at the end of fantoir_fetch.py we need to add fantoir_fetch_dag().

Jan 14 2024, 11:59
dereckson updated the diff for D3280: Configure Salt reactor to provision Airflow pipeline for datasources.

s/dag/dags/g to be coherent with D3281

Jan 14 2024, 11:49
dereckson updated the diff for D3281: Provision Airflow DAGs folders.

Fix state through Complector test deployment

Jan 14 2024, 11:47
dereckson updated the diff for D3281: Provision Airflow DAGs folders.

Hunt insecable spaces

Jan 14 2024, 11:38
dereckson updated the diff for D3281: Provision Airflow DAGs folders.

Make directory src/

Jan 14 2024, 11:35
dereckson added a revision to T1812: Deploy Airflow: D3281: Provision Airflow DAGs folders.
Jan 14 2024, 11:34 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson requested review of D3281: Provision Airflow DAGs folders.
Jan 14 2024, 11:34
dereckson added a revision to T1750: Import FANTOIR database: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Nasqueron Databases
dereckson added a revision to T1942: Allow Jenkins to trigger deployment through Salt: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Continous integration and delivery, Salt
dereckson added a revision to T1812: Deploy Airflow: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson requested review of D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06
dereckson closed D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:05
dereckson committed rOPS9c0b161cdbc4: Configure reactor on Salt primary server (authored by dereckson).
Configure reactor on Salt primary server
Jan 14 2024, 11:05
dereckson added a comment to D3279: Configure reactor on Salt primary server.

Tested successfully on Complector, behaves like as defined in the test plan.

Jan 14 2024, 11:04
dereckson accepted D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:04
dereckson requested review of D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:04
dereckson added a revision to T1942: Allow Jenkins to trigger deployment through Salt: D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:04 · Continous integration and delivery, Salt
dereckson closed D3251: Provide TLS 1.3 only nginx configuration.
Jan 14 2024, 10:31
dereckson committed rOPSe691945ff036: Provide TLS 1.3 only nginx configuration (authored by dereckson).
Provide TLS 1.3 only nginx configuration
Jan 14 2024, 10:31
dereckson closed D3250: Update cipher suites.
Jan 14 2024, 10:30
dereckson committed rOPS61ced979c184: Update cipher suites (authored by dereckson).
Update cipher suites
Jan 14 2024, 10:30
dereckson accepted D3250: Update cipher suites.
Jan 14 2024, 10:30
dereckson accepted D3251: Provide TLS 1.3 only nginx configuration.
Jan 14 2024, 10:28