Page MenuHomeDevCentral
Feed Advanced Search

Fri, Nov 21

dereckson updated subscribers of T2129: Rotate nginx logs on FreeBSD servers.

Configuration is ready.

Fri, Nov 21, 23:56 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2129: Rotate nginx logs on FreeBSD servers from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Fri, Nov 21, 23:52 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
sandrined added a revision to T2129: Rotate nginx logs on FreeBSD servers: D3889: Rotate nginx logs on PaaS Alkane.
Fri, Nov 21, 09:28 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers

Wed, Nov 19

dereckson added a comment to T2130: Rotate nginx logs on PaaS Docker.

Next step: deploy to docker-002, and ensure D3622 is already deployed there too.

Wed, Nov 19, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson moved T2139: Deploy Zulip from Backlog to Working on on the Nasqueron Docker deployment squad board.
Wed, Nov 19, 23:18 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson moved T2139: Deploy Zulip from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Wed, Nov 19, 23:18 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson moved T2139: Deploy Zulip from Backlog to Current focus on the Product evaluation board.
Wed, Nov 19, 23:17 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson added a project to T2139: Deploy Zulip: Operations sprints (Echoes in the Void).
Wed, Nov 19, 23:17 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation
dereckson assigned T2129: Rotate nginx logs on FreeBSD servers to sandrined.

@sandrined Could you publish the commit for this change for review?

Wed, Nov 19, 23:16 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2129: Rotate nginx logs on FreeBSD servers from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Wed, Nov 19, 23:15 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson moved T2130: Rotate nginx logs on PaaS Docker from Working on to To review/deploy on the Operations sprints (Echoes in the Void) board.
Wed, Nov 19, 23:15 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
dereckson added a comment to T2130: Rotate nginx logs on PaaS Docker.

Current status: deployed to Dwellers

Wed, Nov 19, 23:14 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Tue, Nov 18

sandrined added a revision to T2139: Deploy Zulip: D3887: Add CNAME chat.nasqueron.org to www3.nasqueron.org.
Tue, Nov 18, 15:35 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation

Mon, Nov 17

sandrined claimed T2139: Deploy Zulip.

Deployment on Dwellers

Mon, Nov 17, 15:59 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers, Grand Unified Theory, Product evaluation

Sat, Nov 15

dereckson updated the task description for T2129: Rotate nginx logs on FreeBSD servers.
Sat, Nov 15, 11:38 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
dereckson updated the task description for T2129: Rotate nginx logs on FreeBSD servers.
Sat, Nov 15, 11:37 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers
sandrined added a project to T2129: Rotate nginx logs on FreeBSD servers: Operations sprints (Echoes in the Void).
Sat, Nov 15, 11:01 · Operations sprints (Echoes in the Void), privacy, Alkane, Servers

Thu, Nov 13

sandrined added a revision to T2130: Rotate nginx logs on PaaS Docker: D3884: Rotate nginx logs on PaaS Docker.
Thu, Nov 13, 09:00 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Wed, Nov 12

sandrined moved T2130: Rotate nginx logs on PaaS Docker from Backlog to Working on on the Operations sprints (Echoes in the Void) board.
Wed, Nov 12, 13:09 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers
sandrined claimed T2130: Rotate nginx logs on PaaS Docker.
Wed, Nov 12, 12:52 · Operations sprints (Echoes in the Void), Nasqueron Docker deployment squad, Servers

Tue, Nov 11

dereckson closed T2083: Drop PostgreSQL custom build with XML support on dbserver-role as Resolved.
Tue, Nov 11, 18:37 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson added a revision to T2083: Drop PostgreSQL custom build with XML support on dbserver-role: D3882: Revert "Build PostgreSQL with XML support on FreeBSD".
Tue, Nov 11, 18:22 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson moved T2186: Upgrade to PostgreSQL 17 from Working on to Next on the Operations sprints (Echoes in the Void) board.
Tue, Nov 11, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2186: Upgrade to PostgreSQL 17.
Tue, Nov 11, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2186: Upgrade to PostgreSQL 17.
Tue, Nov 11, 16:07 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson lowered the priority of T2186: Upgrade to PostgreSQL 17 from Unbreak Now! to High.

Decreasing priority as no wheelwar will exist on db-A: php83-pdo_pgsql isn't declared there.

Tue, Nov 11, 16:06 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson claimed T2083: Drop PostgreSQL custom build with XML support on dbserver-role.

Confirmed for recent package:

Tue, Nov 11, 13:57 · Operations sprints (Echoes in the Void), Salt, Servers
dereckson added a revision to T2186: Upgrade to PostgreSQL 17: D3874: Upgrade PostgreSQL version to 17.
Tue, Nov 11, 13:53 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson moved T2186: Upgrade to PostgreSQL 17 from Next to Working on on the Operations sprints (Echoes in the Void) board.
Tue, Nov 11, 13:50 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson claimed T2186: Upgrade to PostgreSQL 17.

Taking this, we've PostgreSQL deinstalled on WindRiver; as we're on a UNIX system, it still runs without any issue as long as it doesn't need to load dynamically a library, accepts connection, serves traffic but software isn't there anymore.

Tue, Nov 11, 13:50 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson closed T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database as Resolved.
Tue, Nov 11, 02:43 · Servers, DBA, Keruald
dereckson added a revision to T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database: D3872: Create PostgreSQL database for Keruald tests.
Tue, Nov 11, 02:37 · Servers, DBA, Keruald
dereckson added a comment to T2187: Create a separate PostgreSQL log.

Each test run produces this:

Nov 11 02:29:33 windriver postgres[63389]: [19-1] 2025-11-11 02:29:33.804 UTC [63389] ERROR:  relation "nonexisting" does not exist at character 13
Nov 11 02:29:33 windriver postgres[63389]: [19-2] 2025-11-11 02:29:33.804 UTC [63389] STATEMENT:  DELETE FROM nonexisting
Nov 11 02:29:34 windriver postgres[63402]: [19-1] 2025-11-11 02:29:34.181 UTC [63402] ERROR:  relation "nonexisting" does not exist at character 15
Nov 11 02:29:34 windriver postgres[63402]: [19-2] 2025-11-11 02:29:34.181 UTC [63402] STATEMENT:  SELECT * FROM nonexisting
Nov 11 02:29:34 windriver postgres[63403]: [19-1] 2025-11-11 02:29:34.209 UTC [63403] ERROR:  relation "nonexisting" does not exist at character 15
Nov 11 02:29:34 windriver postgres[63403]: [19-2] 2025-11-11 02:29:34.209 UTC [63403] STATEMENT:  SELECT * FROM nonexisting
Nov 11 02:29:34 windriver postgres[63408]: [19-1] 2025-11-11 02:29:34.357 UTC [63408] ERROR:  relation "not_existing_table" does not exist
Nov 11 02:29:34 windriver postgres[63408]: [19-2] 2025-11-11 02:29:34.357 UTC [63408] STATEMENT:  TRUNCATE not_existing_table
Nov 11 02:29:34 windriver postgres[63409]: [19-1] 2025-11-11 02:29:34.385 UTC [63409] ERROR:  relation "not_existing" does not exist
Nov 11 02:29:34 windriver postgres[63409]: [19-2] 2025-11-11 02:29:34.385 UTC [63409] STATEMENT:  TRUNCATE not_existing
Nov 11 02:29:34 windriver postgres[63416]: [19-1] 2025-11-11 02:29:34.591 UTC [63416] FATAL:  password authentication failed for user "notexisting"
Nov 11 02:29:34 windriver postgres[63416]: [19-2] 2025-11-11 02:29:34.591 UTC [63416] DETAIL:  Role "notexisting" does not exist.
Nov 11 02:29:34 windriver postgres[63416]: [19-3]       Connection matched pg_hba.conf line 22: "host    all             all             127.0.0.1/32            scram-sha-256"

I guess we could avoid to post PostgreSQL logs directly in /var/log/messages.

Tue, Nov 11, 02:33 · DBA, Servers, Salt, Operations sprints (Echoes in the Void)
dereckson triaged T2187: Create a separate PostgreSQL log as Normal priority.
Tue, Nov 11, 02:33 · DBA, Servers, Salt, Operations sprints (Echoes in the Void)
dereckson added a comment to T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database.

Each test run produces this:

Tue, Nov 11, 02:30 · Servers, DBA, Keruald
dereckson added projects to T2186: Upgrade to PostgreSQL 17: Servers, DBA.
Tue, Nov 11, 02:13 · DBA, Servers, Operations sprints (Echoes in the Void)
dereckson added a comment to T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database.

Actually, we use the same database name than for MariaDB / MySQl:

Tue, Nov 11, 01:47 · Servers, DBA, Keruald
dereckson triaged T2185: Create PostgreSQL database on WindRiver to test keruald Keruald Database as Normal priority.
Tue, Nov 11, 01:41 · Servers, DBA, Keruald

Mon, Nov 10

dereckson removed a project from T1600: Automate staging commit craft: good-first-issue.
Mon, Nov 10, 14:18 · documentation, Salt, Operations sprints (Consolidate them all), Servers
dereckson added a comment to T2183: Detect legacy SHA-1 RSA keys.

Bruteforce attack scenario possible, so we're only interested by usernames defined in users.sls, not by "root" (can't login by SSH) or generic accounts like "docker" (doesn't exist):

Mon, Nov 10, 01:57 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Mon, Nov 10, 01:55 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Mon, Nov 10, 01:47 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson updated the task description for T2183: Detect legacy SHA-1 RSA keys.
Mon, Nov 10, 01:16 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson added a project to T2183: Detect legacy SHA-1 RSA keys: Python.
Mon, Nov 10, 00:47 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson moved T1633: Collect metrics from RabbitMQ from Backlog to Next on the Servers board.
Mon, Nov 10, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson moved T1633: Collect metrics from RabbitMQ from Backlog to Prometheus on the Monitoring and reporting board.
Mon, Nov 10, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson edited projects for T1633: Collect metrics from RabbitMQ, added: Operations sprints (Echoes in the Void), Python, Monitoring and reporting; removed Operations sprints (Consolidate them all).
Mon, Nov 10, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Checking the RabbitMQ Monitoring with Prometheus guide:

  • we're OK for cluster name
  • to get sensible values for rate() in Grafana, we need to configure Prometheus to scrape RabbitMQ every 15s ; according Prometheus configuration, the value scrape_interval can be set at job level
Mon, Nov 10, 00:45 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson updated the task description for T1633: Collect metrics from RabbitMQ.
Mon, Nov 10, 00:32 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson updated the task description for T1633: Collect metrics from RabbitMQ.
Mon, Nov 10, 00:28 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Grafana dashboard was full N/A.

Mon, Nov 10, 00:22 · Monitoring and reporting, Python, Operations sprints (Echoes in the Void), Servers

Sun, Nov 9

dereckson triaged T2183: Detect legacy SHA-1 RSA keys as Wishlist priority.
Sun, Nov 9, 23:59 · security, Python, Eglide, Servers, Operations sprints (Echoes in the Void)
dereckson edited projects for T1251: Create an hardware group with sudo permission to run SMART and other hardware checking tools, added: Operations sprints (Echoes in the Void); removed Operations sprints (The Dreadnought will produce new officers).
Sun, Nov 9, 23:52 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad, Servers
dereckson updated the task description for T1251: Create an hardware group with sudo permission to run SMART and other hardware checking tools.
Sun, Nov 9, 23:19 · Operations sprints (Echoes in the Void), Nasqueron Operations Squad, Servers

Thu, Nov 6

dereckson moved T1372: Clean spam on Utopia wiki from Backlog to Operations on the Mediawiki SaaS board.
Thu, Nov 6, 20:45 · Mediawiki SaaS, Servers

Thu, Oct 30

dereckson triaged T2167: Implement Common Address Redundancy Protocol (CARP) as Normal priority.
Thu, Oct 30, 01:26 · Servers, Drake network, Workshop

Wed, Oct 29

dereckson closed T2147: Create development area for obsidian51.nasqueron.org as Resolved.
Wed, Oct 29, 21:28 · Servers, Obsidian
dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3824: Provide alternative configuration file for obsidian51.n.o.
Wed, Oct 29, 21:27 · Servers, Obsidian

Mon, Oct 27

dereckson moved T2161: Fix all privileges permissions for mailManagement PostgreSQL user from Backlog - On hold pending T1475 to Next on the Mail board.
Mon, Oct 27, 22:20 · Mail, Servers
dereckson triaged T2161: Fix all privileges permissions for mailManagement PostgreSQL user as High priority.
Mon, Oct 27, 22:20 · Mail, Servers

Sun, Oct 26

dereckson closed T1098: Install sbnc on Eglide as Resolved.
Sun, Oct 26, 00:07 · Salt, debian-package-needed, Eglide, Servers
dereckson added a comment to T1098: Install sbnc on Eglide.

Here we are with D3812 build:

Sun, Oct 26, 00:05 · Salt, debian-package-needed, Eglide, Servers

Sat, Oct 25

dereckson added a revision to T1098: Install sbnc on Eglide: D3812: Build manually shroudBNC.
Sat, Oct 25, 23:52 · Salt, debian-package-needed, Eglide, Servers
dereckson updated the task description for T1098: Install sbnc on Eglide.
Sat, Oct 25, 23:39 · Salt, debian-package-needed, Eglide, Servers
dereckson added a comment to T1098: Install sbnc on Eglide.

That builds properly: https://eglide.org/~dereckson/shroudbnc.log

Sat, Oct 25, 23:38 · Salt, debian-package-needed, Eglide, Servers
dereckson added a revision to T1098: Install sbnc on Eglide: D3811: Install dependencies to build shroudbnc.
Sat, Oct 25, 23:35 · Salt, debian-package-needed, Eglide, Servers
dereckson added a comment to T1098: Install sbnc on Eglide.

Tested a build manually successfully with:

$ git clone https://github.com/Learath2/sBNC.git
$ cd sBNC
$ cc *.c -o sbnc
$ sudo cp sbnc /usr/local/bin
Sat, Oct 25, 23:27 · Salt, debian-package-needed, Eglide, Servers
dereckson closed T357: Validate cyrus-sasl installation on Ysul as Wontfix.

Mail solution currently use Dovecot.

Sat, Oct 25, 23:20 · Servers

Fri, Oct 24

dereckson added a comment to T2155: Review rotation for acme.sh logs.

Same issue for rhyne-wyse.log. Configuration was copied from acme.sh one.

Fri, Oct 24, 23:05 · Restricted Project, security, Servers

Oct 21 2025

dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3796: Read database configuration from environment.
Oct 21 2025, 21:12 · Servers, Obsidian
dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3795: Define Application, Environment and Session as framework key parts.
Oct 21 2025, 21:06 · Servers, Obsidian

Oct 20 2025

dereckson added a parent task for T2155: Review rotation for acme.sh logs: T2043: Switch to acme.sh instead of certbot.
Oct 20 2025, 23:06 · Restricted Project, security, Servers
dereckson added a subtask for T2043: Switch to acme.sh instead of certbot: T2155: Review rotation for acme.sh logs.
Oct 20 2025, 23:06 · Operations sprints (Ignite Alkane Propulsion), Servers
dereckson triaged T2155: Review rotation for acme.sh logs as Normal priority.
Oct 20 2025, 22:52 · Restricted Project, security, Servers
dereckson moved T2154: IPv6 support for ns1.nasqueron.org from Backlog to Next on the Servers board.
Oct 20 2025, 22:49 · Servers, IPv6, DNS
dereckson added a project to T2154: IPv6 support for ns1.nasqueron.org: Servers.
Oct 20 2025, 22:49 · Servers, IPv6, DNS

Oct 19 2025

dereckson moved T1693: Evaluate Sensu for monitoring from Backlog to Nope / later on the Product evaluation board.
Oct 19 2025, 17:19 · Servers, Monitoring and reporting, Product evaluation
dereckson added a comment to T461: Set up a Tahoe grid.

It's somewhat still maintained:

Oct 19 2025, 17:18 · Backups, Product evaluation, Retz, Servers
dereckson closed T1390: Test tikv as Wontfix.

tikv is marketed as a distributed, solid, high-performant key/value store.

Oct 19 2025, 17:02 · Product evaluation, Servers
dereckson added a project to T1390: Test tikv: Product evaluation.
Oct 19 2025, 17:00 · Product evaluation, Servers
dereckson added a comment to T1390: Test tikv.

sys-info support for FreeBSD has been added if it was previously a blocker.

Oct 19 2025, 16:36 · Product evaluation, Servers
dereckson closed T1391: Add FreeBSD support to sys-info crate, a subtask of T1390: Test tikv, as Resolved.
Oct 19 2025, 16:36 · Product evaluation, Servers
dereckson closed T1391: Add FreeBSD support to sys-info crate as Resolved.

May 2020 - https://github.com/FillZpp/sys-info-rs/blob/master/c/freebsd.c

Oct 19 2025, 16:36 · Servers
dereckson placed T1561: Improve igal2 compatibility with ImageMagick 7 up for grabs.
Oct 19 2025, 16:35 · upstream, Operations sprints (Consolidate them all), Technical debt, Servers, freebsd-port-wanted
dereckson placed T1239: FreeBSD port for sphinx-autobuild up for grabs.
Oct 19 2025, 16:34 · freebsd-port-wanted, Servers
dereckson closed T1239: FreeBSD port for sphinx-autobuild as Resolved.

Package has been added in January 2022.

Oct 19 2025, 16:33 · freebsd-port-wanted, Servers
dereckson added a comment to T2147: Create development area for obsidian51.nasqueron.org.

Two blockers at app-level:

  • .env support is missing from application code.
  • code need to be upgraded to test MySQL connectivity
Oct 19 2025, 07:59 · Servers, Obsidian
dereckson moved T2147: Create development area for obsidian51.nasqueron.org from Working on to Deployed on the Obsidian board.
Oct 19 2025, 07:57 · Servers, Obsidian

Oct 18 2025

dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3770: Serve obsidian51.nasqueron.org on WindRiver: php-fpm, nginx.
Oct 18 2025, 23:07 · Servers, Obsidian
dereckson added a comment to T2147: Create development area for obsidian51.nasqueron.org.

Credentials
Password created in ops/secrets/dbserver/cluster-B/users/obsidian51

Oct 18 2025, 23:03 · Servers, Obsidian
dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3769: Create obsidian51 database.
Oct 18 2025, 22:56 · Servers, Obsidian
dereckson added a revision to T2147: Create development area for obsidian51.nasqueron.org: D3766: Serve obsidian51.nasqueron.org on WindRiver.
Oct 18 2025, 20:45 · Servers, Obsidian
dereckson triaged T2147: Create development area for obsidian51.nasqueron.org as Normal priority.
Oct 18 2025, 20:39 · Servers, Obsidian

Oct 14 2025

dereckson closed T2123: Fix tests for operations repository as Resolved.
Oct 14 2025, 17:09 · Technical debt, Servers
dereckson added a revision to T2043: Switch to acme.sh instead of certbot: D3756: Update Certbot helper file path in tests.
Oct 14 2025, 16:58 · Operations sprints (Ignite Alkane Propulsion), Servers
dereckson added a revision to T2123: Fix tests for operations repository: D3756: Update Certbot helper file path in tests.
Oct 14 2025, 16:58 · Technical debt, Servers

Oct 13 2025

DorianWinty closed T2098: acme.sh configure provisionning of the nginx check and reload as Resolved.
Oct 13 2025, 18:56 · Servers

Oct 12 2025

dereckson added a comment to T2103: Upgrade servers to FreeBSD 14.3.

web-001 upgrade ready, next step: reboot and run again freebsd-update install

Oct 12 2025, 13:52 · Servers
dereckson moved T2074: Mount mysql-innodb-data and mysql-innodb-logs ZFS datasets outside /var/db/mysql from Backlog to Servers on the DBA board.
Oct 12 2025, 10:40 · good-first-issue, DBA, Servers

Oct 11 2025

dereckson added a subtask for T2123: Fix tests for operations repository: T1817: Update pillar path for paas_docker.get_subnets.
Oct 11 2025, 13:24 · Technical debt, Servers