Page MenuHomeDevCentral
Feed Advanced Search

Sep 20 2024

dereckson closed T1752: Publish SPARQL client in Rust as Resolved.
Sep 20 2024, 23:15 · Wikimedia, Nasqueron Databases
dereckson added a comment to T1752: Publish SPARQL client in Rust.

Published ds-http-client and sparql-client:

Sep 20 2024, 23:15 · Wikimedia, Nasqueron Databases

Aug 31 2024

dereckson added a comment to T1752: Publish SPARQL client in Rust.

Crate seems ready for publishing with D3425, but ds-http-client needs to be published first.

Aug 31 2024, 15:14 · Wikimedia, Nasqueron Databases
dereckson added a revision to T1752: Publish SPARQL client in Rust: D3425: Document sparql-client release.
Aug 31 2024, 15:14 · Wikimedia, Nasqueron Databases
dereckson added a comment to T2012: fantoir-datasource promote fails if Wikidata table contains entry missing from fantoir table to promote.

The field detail is nice as it shows a user-friendly message explaining what's happening: "Key (code_fantoir)=(9300277130E) is not present in table \"fantoir_202304\"."

Aug 31 2024, 14:25 · Nasqueron Databases
dereckson triaged T2012: fantoir-datasource promote fails if Wikidata table contains entry missing from fantoir table to promote as Low priority.
Aug 31 2024, 14:23 · Nasqueron Databases
dereckson added a comment to T1752: Publish SPARQL client in Rust.

refactor query to get an iterator, so we can directly apply HOF to HashMap<Variable, Term> to another item

Aug 31 2024, 11:02 · Wikimedia, Nasqueron Databases

Aug 29 2024

dereckson added a revision to T1752: Publish SPARQL client in Rust: D3424: Extract SPARQL client.
Aug 29 2024, 23:41 · Wikimedia, Nasqueron Databases
dereckson moved T1751: Enrich FANTOIR database with Wikidata information from Backlog to Wikidata on the Wikimedia board.
Aug 29 2024, 21:22 · Wikimedia, Nasqueron Databases
dereckson moved T1752: Publish SPARQL client in Rust from Backlog to Wikidata on the Wikimedia board.
Aug 29 2024, 21:21 · Wikimedia, Nasqueron Databases
dereckson claimed T1752: Publish SPARQL client in Rust.

The SPARQL client also depends of our HTTP client, so plan is to:

Aug 29 2024, 21:21 · Wikimedia, Nasqueron Databases

Jul 23 2024

dereckson triaged T1979: Migrate from FANTOIR to TOPO as Low priority.
Jul 23 2024, 06:13 · Dæghrefn, Nasqueron Databases
dereckson created T1979: Migrate from FANTOIR to TOPO.
Jul 23 2024, 06:13 · Dæghrefn, Nasqueron Databases

Jan 14 2024

dereckson added a revision to T1812: Deploy Airflow: D3286: Force Airflow DAGs repository update.
Jan 14 2024, 23:27 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3284: Mount Airflow volumes in maintenance container too.
Jan 14 2024, 20:50 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3283: Inject fantoir-datasource in Airflow image.
Jan 14 2024, 19:10 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3281: Provision Airflow DAGs folders.
Jan 14 2024, 11:34 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1750: Import FANTOIR database: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3280: Configure Salt reactor to provision Airflow pipeline for datasources.
Jan 14 2024, 11:06 · Product evaluation, Continous integration and delivery, Nasqueron Databases

Jan 13 2024

dereckson added a comment to T1941: Zerofill FANTOIR_TABLE information.
WindRiver
$ cd /tmp/fantoir
$ rm FANTOIR0423
$ fantoir-datasource fetch
FANTOIR_FILE=FANTOIR0423
FANTOIR_TABLE=fantoir_202304
Jan 13 2024, 20:09 · Nasqueron Databases
dereckson closed T1941: Zerofill FANTOIR_TABLE information as Resolved by committing rDSfc13adda27ce: Use fantoir_YYYMM format to suggest FANTOIR table name.
Jan 13 2024, 20:08 · Nasqueron Databases
dereckson added a revision to T1941: Zerofill FANTOIR_TABLE information: D3277: Use fantoir_YYYMM format to suggest FANTOIR table name.
Jan 13 2024, 20:05 · Nasqueron Databases
dereckson claimed T1941: Zerofill FANTOIR_TABLE information.
Jan 13 2024, 19:49 · Nasqueron Databases
dereckson moved T1941: Zerofill FANTOIR_TABLE information from Backlog to Working on on the Nasqueron Databases board.
Jan 13 2024, 19:49 · Nasqueron Databases
dereckson triaged T1941: Zerofill FANTOIR_TABLE information as Normal priority.
Jan 13 2024, 19:49 · Nasqueron Databases
dereckson closed T1940: Can't compile crc32fast on FreeBSD with current datasources dependencies as Resolved.

The crc32fast is a dependency of reqwest, it can be built in version 1.3.2 for reqwest 0.11.17.

Jan 13 2024, 19:25 · Regression, Nasqueron Databases
dereckson triaged T1940: Can't compile crc32fast on FreeBSD with current datasources dependencies as High priority.
Jan 13 2024, 19:19 · Regression, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3276: Create workspace directory for Airflow pipelines.
Jan 13 2024, 18:21 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson moved T1751: Enrich FANTOIR database with Wikidata information from Working on to Backlog on the Nasqueron Databases board.
Jan 13 2024, 18:16 · Wikimedia, Nasqueron Databases
dereckson moved T1875: Refresh RFC entries from Working on to Backlog on the Nasqueron Databases board.
Jan 13 2024, 18:15 · Nasqueron Databases, Odderon
dereckson moved T1131: Populate language codes from Working on to Backlog on the Nasqueron Databases board.
Jan 13 2024, 18:15 · Nasqueron Databases, Odderon
dereckson moved T1812: Deploy Airflow from Backlog to Working on on the Nasqueron Databases board.
Jan 13 2024, 18:15 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a comment to T1812: Deploy Airflow.

Previous status from 2023 installation:

Jan 13 2024, 16:46 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3275: Allow to enter a shell for Airflow maintenance operations.
Jan 13 2024, 13:30 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3273: Allow Airflow to connect to Vault.
Jan 13 2024, 00:03 · Product evaluation, Continous integration and delivery, Nasqueron Databases

Jan 12 2024

dereckson added a revision to T1812: Deploy Airflow: D3271: Add Nasqueron Vault CA certificate to image.
Jan 12 2024, 22:47 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3270: Create Vault policy for Airflow.
Jan 12 2024, 20:26 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a comment to T1812: Deploy Airflow.

DNS -> airflow.nasqueron.org. 172800 IN CNAME app2.nasqueron.org.

Jan 12 2024, 19:10 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3269: Use nasqueron/airflow image for Airflow command wrapper too.
Jan 12 2024, 19:00 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D3266: Create custom Docker image with Sentry.
Jan 12 2024, 18:36 · Product evaluation, Continous integration and delivery, Nasqueron Databases

Sep 21 2023

dereckson closed T1876: Upgrade mockito code to 1.x as Resolved.

Code merged, thanks for the contribution :)

Sep 21 2023, 21:22 · good-first-issue, Technical debt, Nasqueron Databases

Sep 10 2023

dereckson added a revision to T1876: Upgrade mockito code to 1.x: D3244: Update mockito to latest version.
Sep 10 2023, 18:28 · good-first-issue, Technical debt, Nasqueron Databases
EshaanAgg added a comment to T1876: Upgrade mockito code to 1.x.

Thanks @dereckson! I cloned, made some changes locally, and then ran the arc diff command after committing them to a new branch. I tried opening the differentials page but couldn't find anything specific to my changes there. Can you let me know how do I have to get them reviewed?

Sep 10 2023, 18:25 · good-first-issue, Technical debt, Nasqueron Databases
dereckson added a comment to T1876: Upgrade mockito code to 1.x.

There is a guide / mémento available at https://agora.nasqueron.org/How_to_contribute_code - it explains how to clone the repository and send the code to review, the equivalent of pull request.

Sep 10 2023, 15:01 · good-first-issue, Technical debt, Nasqueron Databases
EshaanAgg added a comment to T1876: Upgrade mockito code to 1.x.

I want to work on this issue. I have worked with Rust before, and it seems like a good place to start contributing to Nasqueron.
This is my first time on Devcentral (I have previously worked on GitHub only). So, can anyone also link me to a beginner's guide so that I can figure out how to see the project's source code and set it up locally?

Sep 10 2023, 13:20 · good-first-issue, Technical debt, Nasqueron Databases

Jun 18 2023

dereckson added a revision to T1131: Populate language codes: D3199: Remove lang command.
Jun 18 2023, 13:12 · Nasqueron Databases, Odderon

Jun 13 2023

dereckson added a comment to T1131: Populate language codes.

Conflict with a command lang/language to tell in what language it has been compiled.

Jun 13 2023, 21:42 · Nasqueron Databases, Odderon

May 30 2023

dereckson added a revision to T1131: Populate language codes: D3156: Fetch IANA language subtag registry and format it.
May 30 2023, 19:00 · Nasqueron Databases, Odderon
dereckson moved T1131: Populate language codes from Data to Next to deploy on the Odderon board.
May 30 2023, 18:49 · Nasqueron Databases, Odderon
dereckson added a revision to T1891: Document RFC and language-subtag-registry datasources: D3156: Fetch IANA language subtag registry and format it.
May 30 2023, 18:30 · documentation, Nasqueron Databases
dereckson added a comment to T1131: Populate language codes.
In T1131#27720, @fauve wrote:

This list highly seams to be the IETF tag language. A full list can be founded here https://www.iana.org/assignments/language-subtag-registry/language-subtag-registry

May 30 2023, 18:11 · Nasqueron Databases, Odderon
dereckson renamed T1131: Populate language codes from Populate ISO 639 codes to Populate language codes.
May 30 2023, 18:10 · Nasqueron Databases, Odderon

May 29 2023

dereckson added a parent task for T1891: Document RFC and language-subtag-registry datasources: T1131: Populate language codes.
May 29 2023, 21:38 · documentation, Nasqueron Databases
dereckson added a subtask for T1131: Populate language codes: T1891: Document RFC and language-subtag-registry datasources.
May 29 2023, 21:38 · Nasqueron Databases, Odderon
dereckson added a subtask for T1875: Refresh RFC entries: T1891: Document RFC and language-subtag-registry datasources.
May 29 2023, 21:38 · Nasqueron Databases, Odderon
dereckson added a parent task for T1891: Document RFC and language-subtag-registry datasources: T1875: Refresh RFC entries.
May 29 2023, 21:38 · documentation, Nasqueron Databases
dereckson triaged T1891: Document RFC and language-subtag-registry datasources as Normal priority.
May 29 2023, 21:38 · documentation, Nasqueron Databases
dereckson added a comment to T1131: Populate language codes.

This README quickly written in the train between Charleroi and Nivelles gives an overview of the options we can provide:

May 29 2023, 20:32 · Nasqueron Databases, Odderon
dereckson created P337 README for language-subtag-registry-datasource.
May 29 2023, 20:31 · documentation, Nasqueron Databases
dereckson moved T1131: Populate language codes from Backlog to Working on on the Nasqueron Databases board.
May 29 2023, 20:08 · Nasqueron Databases, Odderon
dereckson claimed T1131: Populate language codes.

Let's do the same thing than for rfc-datasource: create a small language-subtag-registry-datasource utility in rDS to fetch the IANA list and allow to transform it.

May 29 2023, 20:08 · Nasqueron Databases, Odderon
dereckson added a comment to T1875: Refresh RFC entries.

Next step is to deploy the new info2.db

May 29 2023, 18:33 · Nasqueron Databases, Odderon
dereckson added a comment to T1875: Refresh RFC entries.

New database produced by D3112 code is available at P336.

May 29 2023, 18:26 · Nasqueron Databases, Odderon

May 27 2023

dereckson edited Description on Nasqueron Databases.
May 27 2023, 18:59
dereckson moved T1876: Upgrade mockito code to 1.x from Backlog to Dev on the good-first-issue board.
May 27 2023, 18:54 · good-first-issue, Technical debt, Nasqueron Databases
dereckson renamed T1876: Upgrade mockito code to 1.x from Upgrade mockito code to Upgrade mockito code to 1.x.
May 27 2023, 18:54 · good-first-issue, Technical debt, Nasqueron Databases

May 23 2023

dereckson moved T1875: Refresh RFC entries from Data to Next to deploy on the Odderon board.
May 23 2023, 18:55 · Nasqueron Databases, Odderon

May 20 2023

dereckson added a project to T1876: Upgrade mockito code to 1.x: Technical debt.
May 20 2023, 02:07 · good-first-issue, Technical debt, Nasqueron Databases
dereckson triaged T1876: Upgrade mockito code to 1.x as Low priority.
May 20 2023, 02:07 · good-first-issue, Technical debt, Nasqueron Databases
dereckson added a revision to T1875: Refresh RFC entries: D3112: Fetch RFC index and format it.
May 20 2023, 01:59 · Nasqueron Databases, Odderon
dereckson moved T1875: Refresh RFC entries from Backlog to Working on on the Nasqueron Databases board.
May 20 2023, 01:48 · Nasqueron Databases, Odderon
dereckson triaged T1875: Refresh RFC entries as Low priority.
May 20 2023, 01:48 · Nasqueron Databases, Odderon

May 6 2023

dereckson moved T1812: Deploy Airflow from Backlog to RC / beta / virtually adopted on the Product evaluation board.
May 6 2023, 16:01 · Product evaluation, Continous integration and delivery, Nasqueron Databases

Mar 31 2023

dereckson added a revision to T1812: Deploy Airflow: D2953: Use Python boolean format for Airflow configuration.
Mar 31 2023, 00:16 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D2952: Report Airflow errors to Sentry.
Mar 31 2023, 00:09 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D2950: Remove in-container healthchecks for Airflow.
Mar 31 2023, 00:00 · Product evaluation, Continous integration and delivery, Nasqueron Databases

Mar 30 2023

dereckson added a revision to T1812: Deploy Airflow: D2941: Create airflow PostgreSQL database.
Mar 30 2023, 23:47 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson added a revision to T1812: Deploy Airflow: D2943: Deploy Airflow to Dwellers.
Mar 30 2023, 23:47 · Product evaluation, Continous integration and delivery, Nasqueron Databases
dereckson triaged T1812: Deploy Airflow as Normal priority.
Mar 30 2023, 23:46 · Product evaluation, Continous integration and delivery, Nasqueron Databases

Mar 29 2023

dereckson added a comment to T1750: Import FANTOIR database.

Airflow deployed, so we can test D2754.

Mar 29 2023, 21:18 · Nasqueron Databases
dereckson added a revision to T1750: Import FANTOIR database: D2943: Deploy Airflow to Dwellers.
Mar 29 2023, 19:58 · Nasqueron Databases
dereckson added a revision to T1750: Import FANTOIR database: D2942: Allow external connections to PostgreSQL.
Mar 29 2023, 18:08 · Nasqueron Databases
dereckson added a revision to T1750: Import FANTOIR database: D2941: Create airflow PostgreSQL database.
Mar 29 2023, 15:55 · Nasqueron Databases

Mar 25 2023

dereckson added a comment to T1750: Import FANTOIR database.

To configure Airflow, we can need a PostgreSQL DSN.

Mar 25 2023, 09:46 · Nasqueron Databases

Jan 26 2023

dereckson added a revision to T1750: Import FANTOIR database: D2760: Provision PostgreSQL cluster.
Jan 26 2023, 17:50 · Nasqueron Databases

Jan 24 2023

dereckson added a revision to T1750: Import FANTOIR database: D2754: Run fantoir-datasource as Airflow pipeline.
Jan 24 2023, 01:09 · Nasqueron Databases

Jan 19 2023

dereckson added a revision to T1750: Import FANTOIR database: D2753: Suggest FANTOIR_TABLE value in fetch command.
Jan 19 2023, 01:25 · Nasqueron Databases
dereckson added a comment to T1750: Import FANTOIR database.

rDS has now a comprehensive fantoir-datasource tool.

Jan 19 2023, 00:48 · Nasqueron Databases
dereckson added a parent task for T1750: Import FANTOIR database: T771: Allow to send notifications from the command line.
Jan 19 2023, 00:40 · Nasqueron Databases
dereckson added a comment to T1751: Enrich FANTOIR database with Wikidata information.

Wikidata uses local files, with codes not always in national FANTOIR schema. Should we use them too?

Jan 19 2023, 00:33 · Wikimedia, Nasqueron Databases

Jan 18 2023

dereckson added a revision to T1750: Import FANTOIR database: D2749: Don't require PostgreSQL schema at build time.
Jan 18 2023, 20:24 · Nasqueron Databases

Jan 17 2023

dereckson added a revision to T1750: Import FANTOIR database: D2745: Consume Opendatasoft Explore API.
Jan 17 2023, 21:03 · Nasqueron Databases
dereckson added a revision to T1750: Import FANTOIR database: D2744: Switch repository to monorepo organization.
Jan 17 2023, 20:57 · Nasqueron Databases

Jan 15 2023

dereckson added a revision to T1750: Import FANTOIR database: D2738: Fetch last FANTOIR file.
Jan 15 2023, 05:57 · Nasqueron Databases
dereckson updated the task description for T1752: Publish SPARQL client in Rust.
Jan 15 2023, 01:22 · Wikimedia, Nasqueron Databases

Jan 14 2023

dereckson triaged T1753: Rust syntax highlighting on DevCentral as High priority.
Jan 14 2023, 21:13 · Nasqueron API, Nasqueron Databases, DevCentral
dereckson placed T1752: Publish SPARQL client in Rust up for grabs.
Jan 14 2023, 21:10 · Wikimedia, Nasqueron Databases
dereckson triaged T1752: Publish SPARQL client in Rust as Wishlist priority.
Jan 14 2023, 21:10 · Wikimedia, Nasqueron Databases
dereckson added a comment to P308 Transform sparql module from fantoir-datasource in standalone crate.

To avoid match/let ... = ...() in the middle of a HOF chain, I've prepared helper methods to read the inner content of an enum:

Jan 14 2023, 19:04 · Nasqueron Databases
dereckson created P308 Transform sparql module from fantoir-datasource in standalone crate.
Jan 14 2023, 19:02 · Nasqueron Databases