Page MenuHomeDevCentral
Feed Advanced Search

Mon, Dec 15

dereckson triaged T2197: Fix router-001 info for WindRiver tunnel as High priority.
Mon, Dec 15, 10:10 · Salt, Drake network, Servers, Operations sprints (Echoes in the Void)

Mon, Dec 1

dereckson triaged T2195: FreeBSD setups still use both /home and /usr/home as High priority.
Mon, Dec 1, 20:53 · Operations sprints (Echoes in the Void), Salt, Servers

Fri, Nov 28

dereckson moved T2193: Investigate Anubis from Backlog to Current focus on the Product evaluation board.
Fri, Nov 28, 17:18 · Operations sprints (Echoes in the Void), Product evaluation, Alkane, DevCentral
dereckson moved T2193: Investigate Anubis from Backlog to Config on the DevCentral board.
Fri, Nov 28, 17:17 · Operations sprints (Echoes in the Void), Product evaluation, Alkane, DevCentral
dereckson triaged T2193: Investigate Anubis as High priority.
Fri, Nov 28, 17:17 · Operations sprints (Echoes in the Void), Product evaluation, Alkane, DevCentral
dereckson added a revision to T2139: Deploy Zulip: D3894: Deploy chat.nasqueron.org nginx vhost on Dwellers.
Fri, Nov 28, 12:38 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
ptdradmin closed T2191: Mail from wikis aren't sent to Hotmail and Gmail as Resolved.

Mail bien reçu : `
ARC-Authentication-Results: i=1; mx.google.com;

spf=pass (google.com: domain of mediawiki-saas-no-reply@nasqueron.org designates 2001:41d0:303:d971::517e:c0de as permitted sender) smtp.mailfrom=mediawiki-saas-no-reply@nasqueron.org

Return-Path: <mediawiki-saas-no-reply@nasqueron.org>
Received: from web-001.nasqueron.drake (www-alkane.nasqueron.org. [2001:41d0:303:d971::517e:c0de])

by mx.google.com with ESMTP id ffacd0b85a97d-42e1ca54633si1934360f8f.947.2025.11.28.03.09.59
for <doba.guimartinien@gmail.com>;
Fri, 28 Nov 2025 03:10:00 -0800 (PST)

Received-SPF: pass (google.com: domain of mediawiki-saas-no-reply@nasqueron.org designates 2001:41d0:303:d971::517e:c0de as permitted sender) client-ip=2001:41d0:303:d971::517e:c0de;
Authentication-Results: mx.google.com;

spf=pass (google.com: domain of mediawiki-saas-no-reply@nasqueron.org designates 2001:41d0:303:d971::517e:c0de as permitted sender) smtp.mailfrom=mediawiki-saas-no-reply@nasqueron.org

Received: from mediawiki (uid 3004) (envelope-from mediawiki-saas-no-reply@nasqueron.org) id 1fd73 by web-001.nasqueron.drake (DragonFly Mail Agent v0.13+ on web-001.nasqueron.drake); Fri, 28 Nov 2025 11:09:58 +0000

Fri, Nov 28, 11:13 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson added a comment to T2191: Mail from wikis aren't sent to Hotmail and Gmail.

SPF updated for nasqueron.org domain to allow web-001:

Fri, Nov 28, 11:12 · Operations sprints (Echoes in the Void), Agora, Mail
ptdradmin closed T2192: Default NTP configuration leads to connection refused as Resolved.

https://agora.nasqueron.org/Operations_grimoire/NTP#FreeBSD

Fri, Nov 28, 09:36 · Operations sprints (Echoes in the Void), Servers
dereckson moved T2192: Default NTP configuration leads to connection refused from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Fri, Nov 28, 08:56 · Operations sprints (Echoes in the Void), Servers
dereckson moved T2192: Default NTP configuration leads to connection refused from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Fri, Nov 28, 08:56 · Operations sprints (Echoes in the Void), Servers

Thu, Nov 27

dereckson updated the task description for T2192: Default NTP configuration leads to connection refused.
Thu, Nov 27, 14:40 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

Deployed on all FreeBSE servers with salt -G 'os:FreeBSD' state.apply roles/core/ntp

Thu, Nov 27, 14:39 · Operations sprints (Echoes in the Void), Servers
dereckson added a revision to T2192: Default NTP configuration leads to connection refused: D3893: Start ntpd.
Thu, Nov 27, 14:38 · Operations sprints (Echoes in the Void), Servers

Wed, Nov 26

dereckson assigned T2192: Default NTP configuration leads to connection refused to ptdradmin.
Wed, Nov 26, 13:14 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

Action plan

Wed, Nov 26, 13:13 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

Activer ntpd : nécessaire si le serveur doit aussi servir de source horaire à d'autres machines.

Let's go for that road, even if it's only for the local machine.

Wed, Nov 26, 12:58 · Operations sprints (Echoes in the Void), Servers
dereckson moved T2191: Mail from wikis aren't sent to Hotmail and Gmail from To review/deploy to Working on on the Operations sprints (Echoes in the Void) board.
Wed, Nov 26, 12:11 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson moved T2191: Mail from wikis aren't sent to Hotmail and Gmail from Backlog to To review/deploy on the Operations sprints (Echoes in the Void) board.
Wed, Nov 26, 12:10 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson moved T2191: Mail from wikis aren't sent to Hotmail and Gmail from Working on to Pending review on the Mail board.
Wed, Nov 26, 12:10 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson moved T2191: Mail from wikis aren't sent to Hotmail and Gmail from Next to Working on on the Mail board.
Wed, Nov 26, 12:10 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson moved T2191: Mail from wikis aren't sent to Hotmail and Gmail from Backlog (config) to Working on on the Agora board.
Wed, Nov 26, 12:10 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson claimed T2191: Mail from wikis aren't sent to Hotmail and Gmail.
Wed, Nov 26, 12:10 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson added a comment to T2191: Mail from wikis aren't sent to Hotmail and Gmail.

DNS record for SPF, TXT version, didn't include the IPs of web-001, now it's the case with D3892 (propagation still pending to nsX.he.net)

Wed, Nov 26, 12:10 · Operations sprints (Echoes in the Void), Agora, Mail
dereckson added a revision to T2191: Mail from wikis aren't sent to Hotmail and Gmail: D3892: Sync SPF records for @nasqueron.org.
Wed, Nov 26, 11:22 · Operations sprints (Echoes in the Void), Agora, Mail

Nov 25 2025

ptdradmin added a comment to T2192: Default NTP configuration leads to connection refused.

Dans le cadre de mes activités du jour, j'ai travaillé avec mon maître de scène sur un problème de synchronisation horaire détecté sur le serveur db-B-001, qui présentait un décalage de deux heures.
Ce problème a été documenté dans le rapport d'incident suivant :
https://agora.nasqueron.org/Operations_grimoire/Incidents/2025-11-25-MariaDB
Nous avons analysé la configuration actuelle : la synchronisation NTP est gérée par les scripts périodiques situés dans :

Nov 25 2025, 11:55 · Operations sprints (Echoes in the Void), Servers
ptdradmin added a comment to T2192: Default NTP configuration leads to connection refused.
Nov 25 2025, 11:50 · Operations sprints (Echoes in the Void), Servers
dereckson updated the task description for T2192: Default NTP configuration leads to connection refused.
Nov 25 2025, 11:09 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

ntpq log shows it only works to print statistics when ntpd is launched.

Nov 25 2025, 11:09 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

ntpq log: https://termbin.com/1vu4

Nov 25 2025, 11:02 · Operations sprints (Echoes in the Void), Servers
dereckson added a project to T2192: Default NTP configuration leads to connection refused: Operations sprints (Echoes in the Void).
Nov 25 2025, 10:39 · Operations sprints (Echoes in the Void), Servers

Nov 23 2025

dereckson added a project to T2191: Mail from wikis aren't sent to Hotmail and Gmail: Operations sprints (Echoes in the Void).
Nov 23 2025, 12:56 · Operations sprints (Echoes in the Void), Agora, Mail

Nov 21 2025

dereckson updated subscribers of T2129: Rotate nginx logs on FreeBSD servers.

Configuration is ready.

Nov 21 2025, 23:56 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2129: Rotate nginx logs on FreeBSD servers from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Nov 21 2025, 23:52 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
sandrined added a revision to T2129: Rotate nginx logs on FreeBSD servers: D3889: Rotate nginx logs on PaaS Alkane.
Nov 21 2025, 09:28 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers

Nov 19 2025

dereckson added a comment to T2130: Rotate nginx logs on PaaS Docker.

Next step: deploy to docker-002, and ensure D3622 is already deployed there too.

Nov 19 2025, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson moved T2139: Deploy Zulip from Backlog to Working on on the Nasqueron Docker deployment squad board.
Nov 19 2025, 23:18 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson moved T2139: Deploy Zulip from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 19 2025, 23:18 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson moved T2139: Deploy Zulip from Backlog to Current focus on the Product evaluation board.
Nov 19 2025, 23:17 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson added a project to T2139: Deploy Zulip: Operations sprints (Echoes in the Void).
Nov 19 2025, 23:17 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson assigned T2129: Rotate nginx logs on FreeBSD servers to sandrined.

@sandrined Could you publish the commit for this change for review?

Nov 19 2025, 23:16 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2129: Rotate nginx logs on FreeBSD servers from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 19 2025, 23:15 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2130: Rotate nginx logs on PaaS Docker from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Nov 19 2025, 23:15 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson added a comment to T2130: Rotate nginx logs on PaaS Docker.

Current status: deployed to Dwellers

Nov 19 2025, 23:14 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson closed T2181: Onboard Sandrine in Nasqueron Operations SIG as Resolved.
Nov 19 2025, 23:01 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad

Nov 15 2025

dereckson updated the task description for T2129: Rotate nginx logs on FreeBSD servers.
Nov 15 2025, 11:38 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson updated the task description for T2129: Rotate nginx logs on FreeBSD servers.
Nov 15 2025, 11:37 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
sandrined added a project to T2129: Rotate nginx logs on FreeBSD servers: Operations sprints (Echoes in the Void).
Nov 15 2025, 11:01 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers

Nov 13 2025

sandrined added a revision to T2130: Rotate nginx logs on PaaS Docker: D3884: Rotate nginx logs on PaaS Docker.
Nov 13 2025, 09:00 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Nov 12 2025

dereckson added a comment to T2181: Onboard Sandrine in Nasqueron Operations SIG.

Wiki account created. Password should have been sent by e-mail.

Nov 12 2025, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad
dereckson updated the task description for T2181: Onboard Sandrine in Nasqueron Operations SIG.
Nov 12 2025, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad
dereckson moved T2181: Onboard Sandrine in Nasqueron Operations SIG from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 12 2025, 22:59 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad
dereckson added a project to T2181: Onboard Sandrine in Nasqueron Operations SIG: Operations sprints (Echoes in the Void).
Nov 12 2025, 22:59 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad
sandrined moved T2130: Rotate nginx logs on PaaS Docker from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 12 2025, 13:09 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
sandrined claimed T2130: Rotate nginx logs on PaaS Docker.
Nov 12 2025, 12:52 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Nov 11 2025

dereckson closed T2083: Drop PostgreSQL custom build with XML support on dbserver-role as Resolved.
Nov 11 2025, 18:37 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson added a revision to T2083: Drop PostgreSQL custom build with XML support on dbserver-role: D3882: Revert "Build PostgreSQL with XML support on FreeBSD".
Nov 11 2025, 18:22 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson moved T2186: Upgrade to PostgreSQL 17 from Working on to Next on the Operations sprints (Echoes in the Void) board.
Nov 11 2025, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2186: Upgrade to PostgreSQL 17.
Nov 11 2025, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2186: Upgrade to PostgreSQL 17.
Nov 11 2025, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson lowered the priority of T2186: Upgrade to PostgreSQL 17 from Unbreak Now! to High.

Deployed for WindRiver, server now runs on 17.6.

Nov 11 2025, 16:06 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson claimed T2083: Drop PostgreSQL custom build with XML support on dbserver-role.

Confirmed for recent package:

Nov 11 2025, 13:57 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson added a revision to T2186: Upgrade to PostgreSQL 17: D3874: Upgrade PostgreSQL version to 17.
Nov 11 2025, 13:53 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson moved T2186: Upgrade to PostgreSQL 17 from Next to Working on on the Operations sprints (Echoes in the Void) board.
Nov 11 2025, 13:50 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson claimed T2186: Upgrade to PostgreSQL 17.

Taking this, we've PostgreSQL deinstalled on WindRiver; as we're on a UNIX system, it still runs without any issue as long as it doesn't need to load dynamically a library, accepts connection, serves traffic but software isn't there anymore.

Nov 11 2025, 13:50 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson added a comment to T2187: Create a separate PostgreSQL log.

Each test run produces this:

Nov 11 02:29:33 windriver postgres[63389]: [19-1] 2025-11-11 02:29:33.804 UTC [63389] ERROR:  relation "nonexisting" does not exist at character 13
Nov 11 02:29:33 windriver postgres[63389]: [19-2] 2025-11-11 02:29:33.804 UTC [63389] STATEMENT:  DELETE FROM nonexisting
Nov 11 02:29:34 windriver postgres[63402]: [19-1] 2025-11-11 02:29:34.181 UTC [63402] ERROR:  relation "nonexisting" does not exist at character 15
Nov 11 02:29:34 windriver postgres[63402]: [19-2] 2025-11-11 02:29:34.181 UTC [63402] STATEMENT:  SELECT * FROM nonexisting
Nov 11 02:29:34 windriver postgres[63403]: [19-1] 2025-11-11 02:29:34.209 UTC [63403] ERROR:  relation "nonexisting" does not exist at character 15
Nov 11 02:29:34 windriver postgres[63403]: [19-2] 2025-11-11 02:29:34.209 UTC [63403] STATEMENT:  SELECT * FROM nonexisting
Nov 11 02:29:34 windriver postgres[63408]: [19-1] 2025-11-11 02:29:34.357 UTC [63408] ERROR:  relation "not_existing_table" does not exist
Nov 11 02:29:34 windriver postgres[63408]: [19-2] 2025-11-11 02:29:34.357 UTC [63408] STATEMENT:  TRUNCATE not_existing_table
Nov 11 02:29:34 windriver postgres[63409]: [19-1] 2025-11-11 02:29:34.385 UTC [63409] ERROR:  relation "not_existing" does not exist
Nov 11 02:29:34 windriver postgres[63409]: [19-2] 2025-11-11 02:29:34.385 UTC [63409] STATEMENT:  TRUNCATE not_existing
Nov 11 02:29:34 windriver postgres[63416]: [19-1] 2025-11-11 02:29:34.591 UTC [63416] FATAL:  password authentication failed for user "notexisting"
Nov 11 02:29:34 windriver postgres[63416]: [19-2] 2025-11-11 02:29:34.591 UTC [63416] DETAIL:  Role "notexisting" does not exist.
Nov 11 02:29:34 windriver postgres[63416]: [19-3]       Connection matched pg_hba.conf line 22: "host    all             all             127.0.0.1/32            scram-sha-256"

I guess we could avoid to post PostgreSQL logs directly in /var/log/messages.

Nov 11 2025, 02:33 · DBA, Servers, Salt, Operations sprints (Echoes in the Void)
dereckson triaged T2187: Create a separate PostgreSQL log as Normal priority.
Nov 11 2025, 02:33 · DBA, Servers, Salt, Operations sprints (Echoes in the Void)
dereckson added projects to T2186: Upgrade to PostgreSQL 17: Servers, DBA.
Nov 11 2025, 02:13 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson triaged T2186: Upgrade to PostgreSQL 17 as High priority.
Nov 11 2025, 02:13 · DBA, Servers, Operations sprints (Echoes in the Void)

Nov 10 2025

dereckson added a comment to T2183: Detect legacy SHA-1 RSA keys.

Bruteforce attack scenario possible, so we're only interested by usernames defined in users.sls, not by "root" (can't login by SSH) or generic accounts like "docker" (doesn't exist):

Nov 10 2025, 01:57 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Nov 10 2025, 01:55 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Nov 10 2025, 01:47 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Nov 10 2025, 01:16 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson added a project to T2183: Detect legacy SHA-1 RSA keys: Python.
Nov 10 2025, 00:47 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson moved T1633: Collect metrics from RabbitMQ from Backlog to Next on the Servers board.
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson moved T1633: Collect metrics from RabbitMQ from Backlog to Prometheus on the Monitoring and reporting board.
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson edited projects for T1633: Collect metrics from RabbitMQ, added: Operations sprints (Echoes in the Void), Python, Monitoring and reporting; removed Operations sprints (Consolidate them all).
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson edited Description on Operations sprints (Echoes in the Void).
Nov 10 2025, 00:10
dereckson edited Description on Operations sprints (Echoes in the Void).
Nov 10 2025, 00:10
dereckson edited Description on Operations sprints (Echoes in the Void).
Nov 10 2025, 00:09

Nov 9 2025

dereckson triaged T2183: Detect legacy SHA-1 RSA keys as Wishlist priority.
Nov 9 2025, 23:59 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson edited projects for T1251: Create an hardware group with sudo permission to run SMART and other hardware checking tools, added: Operations sprints (Echoes in the Void); removed Operations sprints (The Dreadnought will produce new officers).
Nov 9 2025, 23:52 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad, Servers
dereckson set the image for Operations sprints (Echoes in the Void) to F12532276: profile.
Nov 9 2025, 23:52
dereckson created Operations sprints (Echoes in the Void).
Nov 9 2025, 23:32