The FANTOIR database is provided in a fixed width record format.
This change transforms it into a JSON document, ready to be parsed
by any tool for database import.
Details
Details
- Reviewers
dereckson
make clean all
Diff Detail
Diff Detail
- Repository
- rDBVOIES Nasqueron Databases :: Datasources :: Voies
- Lint
Lint Passed - Unit
No Test Coverage - Branch
- parse-fantoir
- Build Status
Buildable 3691 Build 3941: arc lint + arc unit
Event Timeline
Comment Actions
https://about.staging.gitlab.com/blog/2016/03/18/fast-search-using-postgresql-trigram-indexes/ makes me think a Postgresql table with with those GIN trigram indexes would be a better idea than json documents 🤔
Comment Actions
Draft implementation: rFANTDB59128e4bfd41 (needs to add all FANTOIR field).
Plan is to build a DAG "check nouvelle version > télécharger db > unzip > extraire version et lancer fantoir2db > modifier config > notifier qu'on a une nouvelle version déployée"