Page MenuHomeDevCentral
Feed Advanced Search

Nov 25 2025

ptdradmin added a comment to T2192: Default NTP configuration leads to connection refused.

Dans le cadre de mes activités du jour, j'ai travaillé avec mon maître de stage sur un problème de synchronisation horaire détecté sur le serveur db-B-001, qui présentait un décalage de deux heures.
Ce problème a été documenté dans le rapport d'incident suivant :
https://agora.nasqueron.org/Operations_grimoire/Incidents/2025-11-25-MariaDB
Nous avons analysé la configuration actuelle : la synchronisation NTP est gérée par les scripts périodiques situés dans :

Nov 25 2025, 11:55 · Operations sprints (Echoes in the Void), Servers
ptdradmin added a comment to T2192: Default NTP configuration leads to connection refused.
Nov 25 2025, 11:50 · Operations sprints (Echoes in the Void), Servers
dereckson updated the task description for T2192: Default NTP configuration leads to connection refused.
Nov 25 2025, 11:09 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

ntpq log shows it only works to print statistics when ntpd is launched.

Nov 25 2025, 11:09 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2192: Default NTP configuration leads to connection refused.

ntpq log: https://termbin.com/1vu4

Nov 25 2025, 11:02 · Operations sprints (Echoes in the Void), Servers
dereckson added a project to T2192: Default NTP configuration leads to connection refused: Operations sprints (Echoes in the Void).
Nov 25 2025, 10:39 · Operations sprints (Echoes in the Void), Servers
dereckson triaged T2192: Default NTP configuration leads to connection refused as High priority.
Nov 25 2025, 10:39 · Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T2074: Mount mysql-innodb-data and mysql-innodb-logs ZFS datasets outside /var/db/mysql.

Deployed on WindRiver.

Nov 25 2025, 10:06 · good-first-issue, DBA, Servers

Nov 24 2025

ptdradmin added a comment to T2074: Mount mysql-innodb-data and mysql-innodb-logs ZFS datasets outside /var/db/mysql.

Avancement sur T2074

Nov 24 2025, 15:46 · good-first-issue, DBA, Servers
dereckson added a revision to T2074: Mount mysql-innodb-data and mysql-innodb-logs ZFS datasets outside /var/db/mysql: D3890: Mount MySQL root ZFS dataset as /var/db/mysql/data.
Nov 24 2025, 14:30 · good-first-issue, DBA, Servers
dereckson moved T2074: Mount mysql-innodb-data and mysql-innodb-logs ZFS datasets outside /var/db/mysql from Backlog to Working on on the Servers board.
Nov 24 2025, 14:07 · good-first-issue, DBA, Servers
dereckson assigned T2074: Mount mysql-innodb-data and mysql-innodb-logs ZFS datasets outside /var/db/mysql to ptdradmin.
Nov 24 2025, 14:07 · good-first-issue, DBA, Servers

Nov 21 2025

dereckson updated subscribers of T2129: Rotate nginx logs on FreeBSD servers.

Configuration is ready.

Nov 21 2025, 23:56 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2129: Rotate nginx logs on FreeBSD servers from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Nov 21 2025, 23:52 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
sandrined added a revision to T2129: Rotate nginx logs on FreeBSD servers: D3889: Rotate nginx logs on PaaS Alkane.
Nov 21 2025, 09:28 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers

Nov 19 2025

dereckson added a comment to T2130: Rotate nginx logs on PaaS Docker.

Next step: deploy to docker-002, and ensure D3622 is already deployed there too.

Nov 19 2025, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson moved T2139: Deploy Zulip from Backlog to Working on on the Nasqueron Docker deployment squad board.
Nov 19 2025, 23:18 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson moved T2139: Deploy Zulip from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 19 2025, 23:18 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson moved T2139: Deploy Zulip from Backlog to Current focus on the Product evaluation board.
Nov 19 2025, 23:17 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson added a project to T2139: Deploy Zulip: Operations sprints (Echoes in the Void).
Nov 19 2025, 23:17 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson assigned T2129: Rotate nginx logs on FreeBSD servers to sandrined.

@sandrined Could you publish the commit for this change for review?

Nov 19 2025, 23:16 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2129: Rotate nginx logs on FreeBSD servers from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 19 2025, 23:15 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2130: Rotate nginx logs on PaaS Docker from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Nov 19 2025, 23:15 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson added a comment to T2130: Rotate nginx logs on PaaS Docker.

Current status: deployed to Dwellers

Nov 19 2025, 23:14 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Nov 18 2025

sandrined added a revision to T2139: Deploy Zulip: D3887: Add CNAME chat.nasqueron.org to www3.nasqueron.org.
Nov 18 2025, 15:35 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation

Nov 17 2025

sandrined claimed T2139: Deploy Zulip.

Deployment on Dwellers

Nov 17 2025, 15:59 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation

Nov 15 2025

dereckson updated the task description for T2129: Rotate nginx logs on FreeBSD servers.
Nov 15 2025, 11:38 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson updated the task description for T2129: Rotate nginx logs on FreeBSD servers.
Nov 15 2025, 11:37 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
sandrined added a project to T2129: Rotate nginx logs on FreeBSD servers: Operations sprints (Echoes in the Void).
Nov 15 2025, 11:01 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers

Nov 13 2025

sandrined added a revision to T2130: Rotate nginx logs on PaaS Docker: D3884: Rotate nginx logs on PaaS Docker.
Nov 13 2025, 09:00 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Nov 12 2025

sandrined moved T2130: Rotate nginx logs on PaaS Docker from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Nov 12 2025, 13:09 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
sandrined claimed T2130: Rotate nginx logs on PaaS Docker.
Nov 12 2025, 12:52 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Nov 11 2025

dereckson closed T2083: Drop PostgreSQL custom build with XML support on dbserver-role as Resolved.
Nov 11 2025, 18:37 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson added a revision to T2083: Drop PostgreSQL custom build with XML support on dbserver-role: D3882: Revert "Build PostgreSQL with XML support on FreeBSD".
Nov 11 2025, 18:22 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson moved T2186: Upgrade to PostgreSQL 17 from Working on to Next on the Operations sprints (Echoes in the Void) board.
Nov 11 2025, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2186: Upgrade to PostgreSQL 17.
Nov 11 2025, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2186: Upgrade to PostgreSQL 17.
Nov 11 2025, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson lowered the priority of T2186: Upgrade to PostgreSQL 17 from Unbreak Now! to High.

Deployed for WindRiver, server now runs on 17.6.

Nov 11 2025, 16:06 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson claimed T2083: Drop PostgreSQL custom build with XML support on dbserver-role.

Confirmed for recent package:

Nov 11 2025, 13:57 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson added a revision to T2186: Upgrade to PostgreSQL 17: D3874: Upgrade PostgreSQL version to 17.
Nov 11 2025, 13:53 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson moved T2186: Upgrade to PostgreSQL 17 from Next to Working on on the Operations sprints (Echoes in the Void) board.
Nov 11 2025, 13:50 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson claimed T2186: Upgrade to PostgreSQL 17.

Taking this, we've PostgreSQL deinstalled on WindRiver; as we're on a UNIX system, it still runs without any issue as long as it doesn't need to load dynamically a library, accepts connection, serves traffic but software isn't there anymore.

Nov 11 2025, 13:50 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson closed T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database as Resolved.
Nov 11 2025, 02:43 · Servers, DBA, Keruald
dereckson added a revision to T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database: D3872: Create PostgreSQL database for Keruald tests.
Nov 11 2025, 02:37 · Servers, DBA, Keruald
dereckson added a comment to T2187: Create a separate PostgreSQL log.

Each test run produces this:

Nov 11 02:29:33 windriver postgres[63389]: [19-1] 2025-11-11 02:29:33.804 UTC [63389] ERROR:  relation "nonexisting" does not exist at character 13
Nov 11 02:29:33 windriver postgres[63389]: [19-2] 2025-11-11 02:29:33.804 UTC [63389] STATEMENT:  DELETE FROM nonexisting
Nov 11 02:29:34 windriver postgres[63402]: [19-1] 2025-11-11 02:29:34.181 UTC [63402] ERROR:  relation "nonexisting" does not exist at character 15
Nov 11 02:29:34 windriver postgres[63402]: [19-2] 2025-11-11 02:29:34.181 UTC [63402] STATEMENT:  SELECT * FROM nonexisting
Nov 11 02:29:34 windriver postgres[63403]: [19-1] 2025-11-11 02:29:34.209 UTC [63403] ERROR:  relation "nonexisting" does not exist at character 15
Nov 11 02:29:34 windriver postgres[63403]: [19-2] 2025-11-11 02:29:34.209 UTC [63403] STATEMENT:  SELECT * FROM nonexisting
Nov 11 02:29:34 windriver postgres[63408]: [19-1] 2025-11-11 02:29:34.357 UTC [63408] ERROR:  relation "not_existing_table" does not exist
Nov 11 02:29:34 windriver postgres[63408]: [19-2] 2025-11-11 02:29:34.357 UTC [63408] STATEMENT:  TRUNCATE not_existing_table
Nov 11 02:29:34 windriver postgres[63409]: [19-1] 2025-11-11 02:29:34.385 UTC [63409] ERROR:  relation "not_existing" does not exist
Nov 11 02:29:34 windriver postgres[63409]: [19-2] 2025-11-11 02:29:34.385 UTC [63409] STATEMENT:  TRUNCATE not_existing
Nov 11 02:29:34 windriver postgres[63416]: [19-1] 2025-11-11 02:29:34.591 UTC [63416] FATAL:  password authentication failed for user "notexisting"
Nov 11 02:29:34 windriver postgres[63416]: [19-2] 2025-11-11 02:29:34.591 UTC [63416] DETAIL:  Role "notexisting" does not exist.
Nov 11 02:29:34 windriver postgres[63416]: [19-3]       Connection matched pg_hba.conf line 22: "host    all             all             127.0.0.1/32            scram-sha-256"

I guess we could avoid to post PostgreSQL logs directly in /var/log/messages.

Nov 11 2025, 02:33 · DBA, Servers, Salt, Operations sprints (Echoes in the Void)
dereckson triaged T2187: Create a separate PostgreSQL log as Normal priority.
Nov 11 2025, 02:33 · DBA, Servers, Salt, Operations sprints (Echoes in the Void)
dereckson added a comment to T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database.

Each test run produces this:

Nov 11 2025, 02:30 · Servers, DBA, Keruald
dereckson added projects to T2186: Upgrade to PostgreSQL 17: Servers, DBA.
Nov 11 2025, 02:13 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson added a comment to T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database.

Actually, we use the same database name than for MariaDB / MySQl:

Nov 11 2025, 01:47 · Servers, DBA, Keruald
dereckson triaged T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database as Normal priority.
Nov 11 2025, 01:41 · Servers, DBA, Keruald

Nov 10 2025

dereckson removed a project from T1600: Automate staging commit craft: good-first-issue.
Nov 10 2025, 14:18 · documentation, Salt, Operations sprints (Consolidate them all), Servers
dereckson added a comment to T2183: Detect legacy SHA-1 RSA keys.

Bruteforce attack scenario possible, so we're only interested by usernames defined in users.sls, not by "root" (can't login by SSH) or generic accounts like "docker" (doesn't exist):

Nov 10 2025, 01:57 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Nov 10 2025, 01:55 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Nov 10 2025, 01:47 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Nov 10 2025, 01:16 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson added a project to T2183: Detect legacy SHA-1 RSA keys: Python.
Nov 10 2025, 00:47 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson moved T1633: Collect metrics from RabbitMQ from Backlog to Next on the Servers board.
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson moved T1633: Collect metrics from RabbitMQ from Backlog to Prometheus on the Monitoring and reporting board.
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson edited projects for T1633: Collect metrics from RabbitMQ, added: Operations sprints (Echoes in the Void), Python, Monitoring and reporting; removed Operations sprints (Consolidate them all).
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Checking the RabbitMQ Monitoring with Prometheus guide:

  • we're OK for cluster name
  • to get sensible values for rate() in Grafana, we need to configure Prometheus to scrape RabbitMQ every 15s ; according Prometheus configuration, the value scrape_interval can be set at job level
Nov 10 2025, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson updated the task description for T1633: Collect metrics from RabbitMQ.
Nov 10 2025, 00:32 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson updated the task description for T1633: Collect metrics from RabbitMQ.
Nov 10 2025, 00:28 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Grafana dashboard was full N/A.

Nov 10 2025, 00:22 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers

Nov 9 2025

dereckson triaged T2183: Detect legacy SHA-1 RSA keys as Wishlist priority.
Nov 9 2025, 23:59 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson edited projects for T1251: Create an hardware group with sudo permission to run SMART and other hardware checking tools, added: Operations sprints (Echoes in the Void); removed Operations sprints (The Dreadnought will produce new officers).
Nov 9 2025, 23:52 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad, Servers
dereckson updated the task description for T1251: Create an hardware group with sudo permission to run SMART and other hardware checking tools.
Nov 9 2025, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad, Servers

Nov 6 2025

dereckson moved T1372: Clean spam on Utopia wiki from Backlog to Operations on the Mediawiki SaaS board.
Nov 6 2025, 20:45 · Mediawiki SaaS, Servers

Oct 30 2025

dereckson triaged T2167: Implement Common Address Redundancy Protocol (CARP) as Normal priority.
Oct 30 2025, 01:26 · Servers, Drake network, Workshop

Oct 29 2025

dereckson closed T2147: Create development area for obsidian51.nasqueron.org as Resolved.
Oct 29 2025, 21:28 · Servers, Obsidian
dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3824: Provide alternative configuration file for obsidian51.n.o.
Oct 29 2025, 21:27 · Servers, Obsidian

Oct 27 2025

dereckson moved T2161: Fix all privileges permissions for mailManagement PostgreSQL user from Backlog - On hold pending T1475 to Next on the Mail board.
Oct 27 2025, 22:20 · Mail, Servers
dereckson triaged T2161: Fix all privileges permissions for mailManagement PostgreSQL user as High priority.
Oct 27 2025, 22:20 · Mail, Servers

Oct 26 2025

dereckson closed T1098: Install sbnc on Eglide as Resolved.
Oct 26 2025, 00:07 · Salt, debian-package-needed, Eglide, Servers
dereckson added a comment to T1098: Install sbnc on Eglide.

Here we are with D3812 build:

Oct 26 2025, 00:05 · Salt, debian-package-needed, Eglide, Servers

Oct 25 2025

dereckson added a revision to T1098: Install sbnc on Eglide: D3812: Build manually shroudBNC.
Oct 25 2025, 23:52 · Salt, debian-package-needed, Eglide, Servers
dereckson updated the task description for T1098: Install sbnc on Eglide.
Oct 25 2025, 23:39 · Salt, debian-package-needed, Eglide, Servers
dereckson added a comment to T1098: Install sbnc on Eglide.

That builds properly:

Oct 25 2025, 23:38 · Salt, debian-package-needed, Eglide, Servers
dereckson added a revision to T1098: Install sbnc on Eglide: D3811: Install dependencies to build shroudbnc.
Oct 25 2025, 23:35 · Salt, debian-package-needed, Eglide, Servers
dereckson added a comment to T1098: Install sbnc on Eglide.

Tested a build manually successfully with:

$ git clone https://github.com/Learath2/sBNC.git
$ cd sBNC
$ cc *.c -o sbnc
$ sudo cp sbnc /usr/local/bin
Oct 25 2025, 23:27 · Salt, debian-package-needed, Eglide, Servers
dereckson closed T357: Validate cyrus-sasl installation on Ysul as Wontfix.

Mail solution currently use Dovecot.

Oct 25 2025, 23:20 · Servers

Oct 24 2025

dereckson added a comment to T2155: Review rotation for acme.sh logs.

Same issue for rhyne-wyse.log. Configuration was copied from acme.sh one.

Oct 24 2025, 23:05 · TLS certificates, Restricted Project, security, Servers

Oct 21 2025

dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3796: Read database configuration from environment.
Oct 21 2025, 21:12 · Servers, Obsidian
dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3795: Define Application, Environment and Session as framework key parts.
Oct 21 2025, 21:06 · Servers, Obsidian

Oct 20 2025

dereckson added a parent task for T2155: Review rotation for acme.sh logs: T2043: Switch to acme.sh instead of certbot.
Oct 20 2025, 23:06 · TLS certificates, Restricted Project, security, Servers
dereckson added a subtask for T2043: Switch to acme.sh instead of certbot: T2155: Review rotation for acme.sh logs.
Oct 20 2025, 23:06 · TLS certificates, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson triaged T2155: Review rotation for acme.sh logs as Normal priority.
Oct 20 2025, 22:52 · TLS certificates, Restricted Project, security, Servers
dereckson moved T2154: IPv6 support for ns1.nasqueron.org from Backlog to Next on the Servers board.
Oct 20 2025, 22:49 · Servers, IPv6, DNS
dereckson added a project to T2154: IPv6 support for ns1.nasqueron.org: Servers.
Oct 20 2025, 22:49 · Servers, IPv6, DNS

Oct 19 2025

dereckson moved T1693: Evaluate Sensu for monitoring from Backlog to Nope / later on the Product evaluation board.
Oct 19 2025, 17:19 · Servers, Monitoring and reporting, Product evaluation
dereckson added a comment to T461: Set up a Tahoe grid.

It's somewhat still maintained:

Oct 19 2025, 17:18 · Backups, Product evaluation, Retz, Servers
dereckson closed T1390: Test tikv as Wontfix.

tikv is marketed as a distributed, solid, high-performant key/value store.

Oct 19 2025, 17:02 · Product evaluation, Servers
dereckson added a project to T1390: Test tikv: Product evaluation.
Oct 19 2025, 17:00 · Product evaluation, Servers
dereckson added a comment to T1390: Test tikv.

sys-info support for FreeBSD has been added if it was previously a blocker.

Oct 19 2025, 16:36 · Product evaluation, Servers
dereckson closed T1391: Add FreeBSD support to sys-info crate, a subtask of T1390: Test tikv, as Resolved.
Oct 19 2025, 16:36 · Product evaluation, Servers
dereckson closed T1391: Add FreeBSD support to sys-info crate as Resolved.

May 2020 - https://github.com/FillZpp/sys-info-rs/blob/master/c/freebsd.c

Oct 19 2025, 16:36 · Servers
dereckson placed T1561: Improve igal2 compatibility with ImageMagick 7 up for grabs.
Oct 19 2025, 16:35 · upstream, Operations sprints (Consolidate them all), Technical debt, Servers, freebsd-port-wanted
dereckson placed T1239: FreeBSD port for sphinx-autobuild up for grabs.
Oct 19 2025, 16:34 · freebsd-port-wanted, Servers
dereckson closed T1239: FreeBSD port for sphinx-autobuild as Resolved.

Package has been added in January 2022.

Oct 19 2025, 16:33 · freebsd-port-wanted, Servers
dereckson added a comment to T2147: Create development area for obsidian51.nasqueron.org.

Two blockers at app-level:

  • .env support is missing from application code.
  • code need to be upgraded to test MySQL connectivity
Oct 19 2025, 07:59 · Servers, Obsidian
dereckson moved T2147: Create development area for obsidian51.nasqueron.org from Working on to Deployed on the Obsidian board.
Oct 19 2025, 07:57 · Servers, Obsidian