The FANTOIR database is provided in a fixed width record format.
This change transforms it into a JSON document, ready to be parsed
by any tool for database import.
Differential D2379
Parse FANTOIR database dereckson on Jun 9 2021, 23:25. Authored by Tags None Referenced Files
Subscribers None
Details
The FANTOIR database is provided in a fixed width record format. This change transforms it into a JSON document, ready to be parsed make clean all
Diff Detail
Event TimelineComment Actions https://about.staging.gitlab.com/blog/2016/03/18/fast-search-using-postgresql-trigram-indexes/ makes me think a Postgresql table with with those GIN trigram indexes would be a better idea than json documents 🤔 Comment Actions Draft implementation: rFANTDB59128e4bfd41 (needs to add all FANTOIR field). Plan is to build a DAG "check nouvelle version > télécharger db > unzip > extraire version et lancer fantoir2db > modifier config > notifier qu'on a une nouvelle version déployée" |