Page MenuHomeDevCentral
Feed All Stories

Jan 16 2024

dereckson added a revision to T1902: Do we want Iodine back?: D3291: Deploy Iodine.
Jan 16 2024, 00:37 · DNS, discussion, Product evaluation

Jan 15 2024

dereckson added a comment to D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Complector
$ salt db-A-001 state.apply roles/dbserver-pgsql/monitoring
db-A-001:
----------
          ID: postgresql_monitoring_dependencies
    Function: pkg.installed
      Result: True
     Comment: The following packages were installed/updated: py39-pip
     Started: 21:40:59.667353
    Duration: 2132.32 ms
     Changes:
              ----------
              py39-pip:
                  ----------
                  new:
                      23.3.2
                  old:
----------
          ID: postgresql_monitoring_dependencies
    Function: pip.installed
        Name: lddcollect
      Result: True
     Comment: All packages were successfully installed
     Started: 21:41:02.873383
    Duration: 4538.261 ms
     Changes:
              ----------
              lddcollect==0.2.0:
                  Installed
----------
          ID: /usr/local/bin/check-postgresql-dependencies
    Function: file.managed
      Result: True
     Comment: File /usr/local/bin/check-postgresql-dependencies updated
     Started: 21:41:07.415152
    Duration: 35.588 ms
     Changes:
              ----------
              diff:
                  New file
              mode:
                  0755
----------
          ID: /usr/local/bin/check-postgresql-xml-support
    Function: file.managed
      Result: True
     Comment: File /usr/local/bin/check-postgresql-xml-support updated
     Started: 21:41:07.450907
    Duration: 32.835 ms
     Changes:
              ----------
              diff:
                  New file
              mode:
                  0755
Jan 15 2024, 21:55
dereckson claimed T1902: Do we want Iodine back?.

Iodine is still maintained, and the DNS is already configured for Ysul, so why not reevaluate it with a live demo?

Jan 15 2024, 21:53 · DNS, discussion, Product evaluation
dereckson added a comment to T1877: Evaluate Alcali - Salt front-end.

Alcali is still alive.

Jan 15 2024, 21:50 · security, Salt, Servers, Product evaluation
dereckson moved T1942: Allow Jenkins to trigger deployment through Salt from Backlog to Services to add on the Salt board.
Jan 15 2024, 21:50 · Continous integration and delivery, Salt
dereckson moved T1944: Ensure portsnap is available where we use ports from Backlog to Servers config on the Salt board.
Jan 15 2024, 21:50 · Salt, Servers
dereckson triaged T1944: Ensure portsnap is available where we use ports as Normal priority.
Jan 15 2024, 21:50 · Salt, Servers
dereckson added a comment to D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.

For example, when ICU was updated:

Jan 15 2024, 21:44
dereckson updated the diff for D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.

packages_prefixes

Jan 15 2024, 21:41
dereckson updated the diff for D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.

black

Jan 15 2024, 21:39
dereckson added a revision to T1888: Add XML support on db-A PostgreSQL: D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Jan 15 2024, 21:37 · upstream, DBA, Servers
dereckson requested review of D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Jan 15 2024, 21:37
dereckson added a revision to T1943: Orbeon Forms trigger an error after application is submit: D3290: Ensure PostgreSQL port is still up-to-date on FreeBSD.
Jan 15 2024, 21:37 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson committed rOPS6cde786b66e2: Update leap seconds file for NTP (authored by dereckson).
Update leap seconds file for NTP
Jan 15 2024, 20:00
dereckson closed D3289: Update leap seconds file for NTP.
Jan 15 2024, 20:00
dereckson accepted D3289: Update leap seconds file for NTP.
Jan 15 2024, 20:00
dereckson requested review of D3289: Update leap seconds file for NTP.
Jan 15 2024, 19:59
dereckson committed rOPSe822d8546deb: Provide Python 3 interpreter as python3 executable (authored by dereckson).
Provide Python 3 interpreter as python3 executable
Jan 15 2024, 19:57
dereckson closed D3288: Provide Python 3 interpreter as python3 executable.
Jan 15 2024, 19:57
dereckson accepted D3288: Provide Python 3 interpreter as python3 executable.
Jan 15 2024, 19:56
dereckson updated the diff for D3288: Provide Python 3 interpreter as python3 executable.

shellcheck

Jan 15 2024, 19:56
dereckson requested review of D3288: Provide Python 3 interpreter as python3 executable.
Jan 15 2024, 19:55
dereckson closed T1943: Orbeon Forms trigger an error after application is submit as Resolved.
Jan 15 2024, 00:21 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson closed T1888: Add XML support on db-A PostgreSQL, a subtask of T1943: Orbeon Forms trigger an error after application is submit, as Resolved.
Jan 15 2024, 00:21 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson closed T1888: Add XML support on db-A PostgreSQL as Resolved.
Jan 15 2024, 00:21 · upstream, DBA, Servers
dereckson closed T1888: Add XML support on db-A PostgreSQL, a subtask of T1884: Deploy Orbeon Forms, as Resolved.
Jan 15 2024, 00:21 · Nasqueron Docker deployment squad, Docker images, Product evaluation
dereckson closed D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:20
dereckson committed rOPS5db68870099b: Fix PostgreSQL 15 build instructions (authored by dereckson).
Fix PostgreSQL 15 build instructions
Jan 15 2024, 00:20
dereckson accepted D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19
dereckson updated the test plan for D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19
dereckson requested review of D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19
dereckson added a revision to T1888: Add XML support on db-A PostgreSQL: D3287: Fix PostgreSQL 15 build instructions.
Jan 15 2024, 00:19 · upstream, DBA, Servers
dereckson added a comment to T1888: Add XML support on db-A PostgreSQL.

I've added documentation to https://agora.nasqueron.org/Operations_grimoire/FreeBSD#PostgreSQL without real conviction.

Jan 15 2024, 00:16 · upstream, DBA, Servers
dereckson lowered the priority of T1943: Orbeon Forms trigger an error after application is submit from High to Normal.

Fixed. Form works again.

Jan 15 2024, 00:13 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson moved T1943: Orbeon Forms trigger an error after application is submit from Backlog to Working on on the Nasqueron Docker deployment squad board.
Jan 15 2024, 00:06 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson moved T1943: Orbeon Forms trigger an error after application is submit from Backlog to Working on on the Servers board.

I'm rebuilding PostgreSQL 15.4 with XML support on db-A-001.

Jan 15 2024, 00:06 · Servers, Nasqueron Docker deployment squad, Launch community

Jan 14 2024

dereckson added a revision to T1812: Deploy Airflow: D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:27 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a task to D3286: Force Airflow DAGs repository update: T1812: Deploy Airflow.
Jan 14 2024, 23:27
dereckson closed D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:26
dereckson committed rOPS79583a13e893: Force Airflow DAGs repository update (authored by dereckson).
Force Airflow DAGs repository update
Jan 14 2024, 23:26
dereckson accepted D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:26
dereckson requested review of D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:26
dereckson added a subtask for T1943: Orbeon Forms trigger an error after application is submit: T1888: Add XML support on db-A PostgreSQL.
Jan 14 2024, 23:19 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson added a parent task for T1888: Add XML support on db-A PostgreSQL: T1943: Orbeon Forms trigger an error after application is submit.
Jan 14 2024, 23:19 · upstream, DBA, Servers
dereckson added a comment to T1943: Orbeon Forms trigger an error after application is submit.

Jan 14 23:13:52 db-A-001 postgres[35351]: [7-1] 2024-01-14 23:13:52.659 UTC [35351] ERROR: unsupported XML feature

Jan 14 2024, 23:19 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson reopened T1888: Add XML support on db-A PostgreSQL as "Open".

When upgraded to FreeBSD 14, we lost this.

Jan 14 2024, 23:18 · upstream, DBA, Servers
dereckson reopened T1888: Add XML support on db-A PostgreSQL, a subtask of T1884: Deploy Orbeon Forms, as Open.
Jan 14 2024, 23:18 · Nasqueron Docker deployment squad, Docker images, Product evaluation
dereckson updated subscribers of T1943: Orbeon Forms trigger an error after application is submit.

When clicking to Save Progress:

Jan 14 2024, 23:17 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson updated the task description for T1943: Orbeon Forms trigger an error after application is submit.
Jan 14 2024, 22:55 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson triaged T1943: Orbeon Forms trigger an error after application is submit as High priority.
Jan 14 2024, 22:55 · Servers, Nasqueron Docker deployment squad, Launch community
dereckson added a comment to D2754: Run fantoir-datasource as Airflow pipeline.

Notification successfully reached the Notifications Center. Here an extract of the event through Sentry discover:

Jan 14 2024, 22:50
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

task_ids for task_instance.xcom_pull

Jan 14 2024, 22:21
dereckson planned changes to D2754: Run fantoir-datasource as Airflow pipeline.

Currently, the fetch pipeline fails at the notify step:

Jan 14 2024, 22:16
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

Rebase

Jan 14 2024, 22:10
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

Rebase. Bump Airflow version.

Jan 14 2024, 21:58
dereckson closed D3285: Check FANTOIR filename using FANTOIRMMYY format.
Jan 14 2024, 21:57
dereckson committed rDS6cf1892e0e44: Check FANTOIR filename using FANTOIRMMYY format (authored by dereckson).
Check FANTOIR filename using FANTOIRMMYY format
Jan 14 2024, 21:57
dereckson accepted D3285: Check FANTOIR filename using FANTOIRMMYY format.
Jan 14 2024, 21:57
dereckson requested review of D3285: Check FANTOIR filename using FANTOIRMMYY format.
Jan 14 2024, 21:57
dereckson closed D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 21:25
dereckson committed rOPSb4dc5820ee6b: Mount Airflow volumes in maintenance container too (authored by dereckson).
Mount Airflow volumes in maintenance container too
Jan 14 2024, 21:25
dereckson accepted D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 21:25
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.
  • Notification gate is singular
  • Get FANTOIR connection from secret back-end
  • Inject PATH in environment so we can find fantoir-datasource in /usr/local/bin
  • Decode bytes and split lines into a list for stdout, stderr
Jan 14 2024, 21:24
dereckson added a revision to T1812: Deploy Airflow: D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson updated the summary of D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50
dereckson requested review of D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50
dereckson committed rDAF0ad3018bf03a: Inject fantoir-datasource in Airflow image (authored by dereckson).
Inject fantoir-datasource in Airflow image
Jan 14 2024, 19:12
dereckson closed D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:12
dereckson accepted D3283: Inject fantoir-datasource in Airflow image.

Both fantoir-datasource fetch and fantoir-datasource import work correctly in airflow nasqueron shell: rows are correctly imported into PostgreSQL database.

Jan 14 2024, 19:12
dereckson added a revision to T1812: Deploy Airflow: D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:10 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson requested review of D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:10
dereckson closed D3282: Provide build instructions and Docker image.
Jan 14 2024, 18:53
dereckson committed rDS77691169e3a7: Provide build instructions and Docker image (authored by dereckson).
Provide build instructions and Docker image
Jan 14 2024, 18:53
dereckson updated the diff for D3282: Provide build instructions and Docker image.

Improve Makefile

Jan 14 2024, 18:52
dereckson accepted D3282: Provide build instructions and Docker image.
Jan 14 2024, 18:49
dereckson requested review of D3282: Provide build instructions and Docker image.
Jan 14 2024, 18:48
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

Create table if it doesn't exist

Jan 14 2024, 18:41
dereckson committed rOPSde2fb22e15a3: Provision Airflow DAGs folders (authored by dereckson).
Provision Airflow DAGs folders
Jan 14 2024, 17:06
dereckson closed D3281: Provision Airflow DAGs folders.
Jan 14 2024, 17:06
dereckson accepted D3281: Provision Airflow DAGs folders.
Jan 14 2024, 17:05
dereckson added a comment to D3281: Provision Airflow DAGs folders.

Works fine. https://airflow.nasqueron.org/dags/fantoir_fetch/grid for example

Jan 14 2024, 17:05
dereckson updated the diff for D2754: Run fantoir-datasource as Airflow pipeline.

TaskFlow DAGs are defined by a function, but that function needs to be called.

Jan 14 2024, 17:04
dereckson added a comment to D2754: Run fantoir-datasource as Airflow pipeline.

At the end of the TaskFlow DAG, function should be called, for example at the end of fantoir_fetch.py we need to add fantoir_fetch_dag().

Jan 14 2024, 11:59
dereckson updated the diff for D3280: Configure Salt reactor to provision Airflow pipeline for datasources.

s/dag/dags/g to be coherent with D3281

Jan 14 2024, 11:49
dereckson updated the diff for D3281: Provision Airflow DAGs folders.

Fix state through Complector test deployment

Jan 14 2024, 11:47
dereckson updated the diff for D3281: Provision Airflow DAGs folders.

Hunt insecable spaces

Jan 14 2024, 11:38
dereckson updated the diff for D3281: Provision Airflow DAGs folders.

Make directory src/

Jan 14 2024, 11:35
dereckson added a revision to T1812: Deploy Airflow: D3281: Provision Airflow DAGs folders.
Jan 14 2024, 11:34 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson requested review of D3281: Provision Airflow DAGs folders.
Jan 14 2024, 11:34
dereckson added a revision to T1750: Import FANTOIR database: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Nasqueron Databases
dereckson added a revision to T1942: Allow Jenkins to trigger deployment through Salt: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Continous integration and delivery, Salt
dereckson added a revision to T1812: Deploy Airflow: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson requested review of D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06
dereckson closed D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:05
dereckson committed rOPS9c0b161cdbc4: Configure reactor on Salt primary server (authored by dereckson).
Configure reactor on Salt primary server
Jan 14 2024, 11:05
dereckson added a comment to D3279: Configure reactor on Salt primary server.

Tested successfully on Complector, behaves like as defined in the test plan.

Jan 14 2024, 11:04
dereckson accepted D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:04
dereckson requested review of D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:04
dereckson added a revision to T1942: Allow Jenkins to trigger deployment through Salt: D3279: Configure reactor on Salt primary server.
Jan 14 2024, 11:04 · Continous integration and delivery, Salt
dereckson closed D3251: Provide TLS 1.3 only nginx configuration.
Jan 14 2024, 10:31