Both fantoir-datasource fetch and fantoir-datasource import work correctly in airflow nasqueron shell: rows are correctly imported into PostgreSQL database.

Improve Makefile

Create table if it doesn't exist

Works fine. https://airflow.nasqueron.org/dags/fantoir_fetch/grid for example

TaskFlow DAGs are defined by a function, but that function needs to be called.

At the end of the TaskFlow DAG, function should be called, for example at the end of fantoir_fetch.py we need to add fantoir_fetch_dag().

s/dag/dags/g to be coherent with D3281

Fix state through Complector test deployment

Hunt insecable spaces

Make directory src/

Tested successfully on Complector, behaves like as defined in the test plan.

Reorder pillar/services/table.sls

Declare Salt API in services table so Jenkins can know what URL to use without hardcoding it

+service

hunt-insecable-spaces sponsored by I can't use a MacBook Pro (tm)

Fix spaces. Add kludge to remove contextvars from egg info about Salt.

Current status

Ready to test.

Two lines after import

2.8.0 / add header / Notification singular / database_url

Rebased against D3277.

In D3277#49947, @dereckson wrote:

WindRiver

$ cd /tmp/fantoir
$ rm FANTOIR0423
$ fantoir-datasource fetch
FANTOIR_FILE=FANTOIR0423
FANTOIR_TABLE=fantoir_202304

Use fantoir_YYYMM format to suggest FANTOIR table name

The crc32fast is a dependency of reqwest, it can be built in version 1.3.2 for reqwest 0.11.17.

+wrapper

Previous status from 2023 installation:

In D3275#49866, @dereckson wrote:

The AIRFLOW__DATABASE__SQL_ALCHEMY_CONN environment variable will be removed later, allowing faster container spawn time, but that's for D3273.

Policy validated during D3273 tests: read is enough.

Tests passed. Works well, but fail silently if the password contains special characters as such we can't parse the DSN as a valid URL.

Use airflow.cfg for service containers too

Correct database schemes for the PostgreSQLdatabase

When deployed to Dwellers, code is no-op regarding the code tested there, so looks good to me.