Page MenuHomeDevCentral
Feed All Stories

Aug 4 2024

dereckson updated the diff for D3402: Deploy Salt policy properly.

Enable onchanges

Aug 4 2024, 11:14
dereckson updated the diff for D3402: Deploy Salt policy properly.

hunt-insecable-spaces

Aug 4 2024, 11:13
dereckson requested review of D3402: Deploy Salt policy properly.
Aug 4 2024, 11:13
dereckson merged T1976: Update Salt to 3007 on FreeBSD servers into T1993: Salt migration to 3007, 3008 and extensions.
Aug 4 2024, 09:58 · Nasqueron Operations Squad, discussion, Salt
dereckson merged task T1976: Update Salt to 3007 on FreeBSD servers into T1993: Salt migration to 3007, 3008 and extensions.
Aug 4 2024, 09:58 · Salt, Vault
dereckson placed T1693: Evaluate Sensu for monitoring up for grabs.

Just a small note this product becomes more and more open core, and we're less in favour of that one "specifically".

Aug 4 2024, 09:54 · Servers, Monitoring and reporting, Product evaluation
dereckson moved T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration from Working on to Pending review on the Servers board.
Aug 4 2024, 09:53 · Vault, Servers, Salt, Eglide
dereckson requested review of D3401: Resolve conflict for Salt Vault configuration.
Aug 4 2024, 09:50
dereckson added a revision to T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration: D3401: Resolve conflict for Salt Vault configuration.
Aug 4 2024, 09:50 · Vault, Servers, Salt, Eglide
dereckson moved T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration from Backlog to Working on on the Servers board.
Aug 4 2024, 09:29 · Vault, Servers, Salt, Eglide
dereckson claimed T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration.
Aug 4 2024, 09:29 · Vault, Servers, Salt, Eglide

Aug 3 2024

dereckson requested review of D3400: Cleanup LXC-specific mailserver units.
Aug 3 2024, 21:17
dereckson added a revision to T1475: Provision a mail server: D3400: Cleanup LXC-specific mailserver units.
Aug 3 2024, 21:17 · Mail, Restricted Project, Servers
dereckson committed rVIPERa5893bc48e55: Improve inclusive terminology (authored by dereckson).
Improve inclusive terminology
Aug 3 2024, 21:11
dereckson closed D3399: Improve inclusive terminology.
Aug 3 2024, 21:11
dereckson accepted D3399: Improve inclusive terminology.
Aug 3 2024, 21:11
dereckson added a revision to T1668: Improve inclusive terminology: D3399: Improve inclusive terminology.
Aug 3 2024, 21:10 · User-Dereckson, documentation, We are Nasqueron, discussion
dereckson requested review of D3399: Improve inclusive terminology.
Aug 3 2024, 21:10
dereckson requested review of D3398: Improve inclusive terminology.
Aug 3 2024, 21:02
dereckson added a revision to T1668: Improve inclusive terminology: D3398: Improve inclusive terminology.
Aug 3 2024, 21:02 · User-Dereckson, documentation, We are Nasqueron, discussion
dereckson committed rVIPER8151d15529b0: Improve inclusive terminology (authored by dereckson).
Improve inclusive terminology
Aug 3 2024, 20:57
dereckson closed D3397: Improve inclusive terminology.
Aug 3 2024, 20:57
dereckson accepted D3397: Improve inclusive terminology.
Aug 3 2024, 20:57
dereckson requested review of D3397: Improve inclusive terminology.
Aug 3 2024, 20:56
dereckson added a revision to T1668: Improve inclusive terminology: D3397: Improve inclusive terminology.
Aug 3 2024, 20:56 · User-Dereckson, documentation, We are Nasqueron, discussion
dereckson closed D3396: Avoid insecable spaces.
Aug 3 2024, 20:49
dereckson committed rVIPER64c8ee4c34a0: Avoid insecable spaces (authored by dereckson).
Avoid insecable spaces
Aug 3 2024, 20:49
dereckson accepted D3396: Avoid insecable spaces.
Aug 3 2024, 20:49
dereckson requested review of D3396: Avoid insecable spaces.
Aug 3 2024, 20:48
dereckson closed D3395: Harmonize attribution.
Aug 3 2024, 20:47
dereckson committed rVIPERdcf7a4ec7acb: Harmonize attribution (authored by dereckson).
Harmonize attribution
Aug 3 2024, 20:47
dereckson accepted D3395: Harmonize attribution.
Aug 3 2024, 20:47
dereckson updated subscribers of D3395: Harmonize attribution.
Aug 3 2024, 20:46
dereckson requested review of D3395: Harmonize attribution.
Aug 3 2024, 20:46
dereckson attached a referenced file: F3335166: eb-2021-00288-001-INCITS-Inclusive-Terminology-Guidelines.pdf.
Aug 3 2024, 20:27 · User-Dereckson, documentation, We are Nasqueron, discussion
dereckson added a comment to T1668: Improve inclusive terminology.

https://www.incits.org/dotAsset/29643f45-86d8-4137-987e-9685b944d1e0.pdf can now be used instead.

Aug 3 2024, 20:12 · User-Dereckson, documentation, We are Nasqueron, discussion
dereckson updated the task description for T1668: Improve inclusive terminology.
Aug 3 2024, 20:11 · User-Dereckson, documentation, We are Nasqueron, discussion
dereckson moved T1678: Health check and reporting library from In progress to Next on the User-Dereckson board.
Aug 3 2024, 19:50 · User-Dereckson, Keruald, Zed
dereckson moved T1693: Evaluate Sensu for monitoring from In progress to Backlog on the User-Dereckson board.
Aug 3 2024, 19:50 · Servers, Monitoring and reporting, Product evaluation
dereckson closed T1989: Merge Nasqueron infrastructure reference into ops grimoire as Resolved.
Aug 3 2024, 19:49 · Mail, Nasqueron Operations Squad, Servers, documentation
dereckson added a comment to T1989: Merge Nasqueron infrastructure reference into ops grimoire.

https://agora.nasqueron.org/Nasqueron_infrastructure_reference -> https://agora.nasqueron.org/Operations_grimoire
https://agora.nasqueron.org/Nasqueron_infrastructure_reference/Mail -> https://agora.nasqueron.org/Operations_grimoire/Mail

Aug 3 2024, 19:49 · Mail, Nasqueron Operations Squad, Servers, documentation
dereckson claimed T1989: Merge Nasqueron infrastructure reference into ops grimoire.
Aug 3 2024, 19:45 · Mail, Nasqueron Operations Squad, Servers, documentation
dereckson added a comment to D3394: Downgrade to Salt 3006 on Fedora-downstream servers.

I've saved test run log earlier this afternoon, here it is:

Aug 3 2024, 18:41
dereckson added a comment to D3394: Downgrade to Salt 3006 on Fedora-downstream servers.

Works fine.

Aug 3 2024, 18:31
dereckson added a revision to T1993: Salt migration to 3007, 3008 and extensions: D3394: Downgrade to Salt 3006 on Fedora-downstream servers.
Aug 3 2024, 17:36 · Nasqueron Operations Squad, discussion, Salt
dereckson requested review of D3394: Downgrade to Salt 3006 on Fedora-downstream servers.
Aug 3 2024, 17:36
dereckson added a comment to T1993: Salt migration to 3007, 3008 and extensions.

Per previous comment, I'd advice to downgrade to 3006 LTS for paas-docker servers too.

Aug 3 2024, 17:33 · Nasqueron Operations Squad, discussion, Salt
dereckson planned changes to D3392: Avoid egrep in Salt code base.

We're downgrading to Salt 3006 on Linux servers to still be able to distribute credentials from 3006 server.

Aug 3 2024, 17:32
dereckson raised the priority of T1993: Salt migration to 3007, 3008 and extensions from Normal to High.

I've also discovered we can't deploy secrets to Salt 3007+ anymore from a Salt 3006 server:

Aug 3 2024, 16:53 · Nasqueron Operations Squad, discussion, Salt
dereckson moved T1991: Context has again been lost on /var/log/www from Backlog to To check again on the upstream board.
Aug 3 2024, 16:32 · upstream, Regression, Servers, Salt
dereckson moved T1991: Context has again been lost on /var/log/www from Working on to Pending review on the Servers board.
Aug 3 2024, 16:32 · upstream, Regression, Servers, Salt
dereckson moved T1992: Install patch on redhat family as part of core from Working on to Pending review on the Servers board.
Aug 3 2024, 16:32 · Servers
dereckson moved T1994: Upgrade Salt repository on Debian from Backlog to Pending review on the Servers board.
Aug 3 2024, 16:32 · Eglide, Servers, Salt
dereckson moved T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration from Backlog to Bug and issues on the Salt board.
Aug 3 2024, 16:26 · Vault, Servers, Salt, Eglide
dereckson moved T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration from Backlog to Server config on the Eglide board.
Aug 3 2024, 16:26 · Vault, Servers, Salt, Eglide
dereckson added a comment to D3393: Update Salt repository on Debian.

Unit wanted to overwrite Eglide-specific Vault Salt configuration, I've opened T1998 for follow-up.

Aug 3 2024, 16:26
dereckson added a comment to D3393: Update Salt repository on Debian.
Eglide
$ salt-call --local state.apply roles/core/salt test=True
[…]
----------
          ID: /etc/apt/keyrings/salt-archive-keyring-2023.gpg
    Function: file.managed
      Result: True
     Comment: The file /etc/apt/keyrings/salt-archive-keyring-2023.gpg is in the correct state
     Started: 16:25:09.653065
    Duration: 7.356 ms
     Changes:
----------
          ID: /etc/apt/sources.list.d/salt.list
    Function: file.managed
      Result: True
     Comment: The file /etc/apt/sources.list.d/salt.list is in the correct state
     Started: 16:25:09.660512
    Duration: 1.221 ms
     Changes:
[…]
Aug 3 2024, 16:25
dereckson added projects to T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration: Servers, Vault.
Aug 3 2024, 16:24 · Vault, Servers, Salt, Eglide
dereckson triaged T1998: Resolve conflict between core and shellserver roles for Vault in Salt configuration as Low priority.
Aug 3 2024, 16:23 · Vault, Servers, Salt, Eglide
dereckson added a comment to D3392: Avoid egrep in Salt code base.
Complector
$ salt dwellers state.apply hotfixes/salt
dwellers:
----------
          ID: T1991_egrep_patch
    Function: file.patch
        Name: /opt/saltstack/salt/lib/python3.10/site-packages/salt
      Result: True
     Comment: Patch successfully applied
     Started: 16:15:53.189797
    Duration: 45.172 ms
     Changes:
              ----------
              pid:
                  4123780
              retcode:
                  0
              stderr:
              stdout:
                  patching file modules/csf.py
                  patching file modules/selinux.py
Aug 3 2024, 16:17
dereckson added a revision to T1994: Upgrade Salt repository on Debian: D3393: Update Salt repository on Debian.
Aug 3 2024, 15:44 · Eglide, Servers, Salt
dereckson requested review of D3393: Update Salt repository on Debian.
Aug 3 2024, 15:44
dereckson renamed T1994: Upgrade Salt repository on Debian from Upgrade Salt on Eglide to Upgrade Salt repository on Debian.
Aug 3 2024, 15:17 · Eglide, Servers, Salt
dereckson added a comment to T1996: Servers on hyper-001 have network issues.

From router-001 network looks good:

Aug 3 2024, 13:59 · security, Servers
dereckson added a comment to T1996: Servers on hyper-001 have network issues.

Stopped currently not needed salt and node-exporter on router-001 to see if that helps.

Aug 3 2024, 13:58 · security, Servers
dereckson renamed T1996: Servers on hyper-001 have network issues from Server outage: complector to Servers on hyper-001 have network issues.
Aug 3 2024, 13:23 · security, Servers
dereckson shifted T1996: Servers on hyper-001 have network issues from the S1 Nasqueron space to the Restricted Space space.
Aug 3 2024, 13:23 · security, Servers
dereckson lowered the priority of T1996: Servers on hyper-001 have network issues from Unbreak Now! to High.

Could be at hypervisor level. SSH failed until 13:22 where it worked immediately.

Aug 3 2024, 13:23 · security, Servers
dereckson added a comment to T1996: Servers on hyper-001 have network issues.

As of 13:18 UTC, SSH access works.

Aug 3 2024, 13:19 · security, Servers
dereckson added a comment to T1996: Servers on hyper-001 have network issues.

Also, at the same time, DevCentral is slow for arc diff or to publish this task. This delay behavior is similar as when DNS resolution timeouts occur.

Aug 3 2024, 13:14 · security, Servers
dereckson triaged T1996: Servers on hyper-001 have network issues as Unbreak Now! priority.
Aug 3 2024, 13:13 · security, Servers
dereckson requested review of D3392: Avoid egrep in Salt code base.
Aug 3 2024, 13:10
dereckson added a revision to T1991: Context has again been lost on /var/log/www: D3392: Avoid egrep in Salt code base.
Aug 3 2024, 13:09 · upstream, Regression, Servers, Salt
dereckson added a comment to T1994: Upgrade Salt repository on Debian.
Eglide
$ salt-minion --versions
Salt Version:
          Salt: 3007.1
Aug 3 2024, 13:01 · Eglide, Servers, Salt
dereckson added a subtask for T1950: Deploy PHP 8.3: T1995: PHP 8.2 and PHP 8.3 seems both to be installed on Eglide.
Aug 3 2024, 12:59 · Servers, PHP 8.x support
dereckson added a parent task for T1995: PHP 8.2 and PHP 8.3 seems both to be installed on Eglide: T1950: Deploy PHP 8.3.
Aug 3 2024, 12:59 · PHP 8.x support, Eglide
dereckson moved T1995: PHP 8.2 and PHP 8.3 seems both to be installed on Eglide from Backlog to Servers on the PHP 8.x support board.
Aug 3 2024, 12:59 · PHP 8.x support, Eglide
dereckson triaged T1995: PHP 8.2 and PHP 8.3 seems both to be installed on Eglide as Low priority.
Aug 3 2024, 12:59 · PHP 8.x support, Eglide
dereckson edited projects for T1994: Upgrade Salt repository on Debian, added: Servers, Eglide; removed Nasqueron Operations Squad, discussion.
Aug 3 2024, 12:56 · Eglide, Servers, Salt
dereckson triaged T1994: Upgrade Salt repository on Debian as Normal priority.
Aug 3 2024, 12:52 · Eglide, Servers, Salt
dereckson requested review of D3391: Bump Sphinx package name to use Python3.11.
Aug 3 2024, 12:18
dereckson added a revision to T1982: Upgrade from Python 3.9 to Python 3.11+: D3391: Bump Sphinx package name to use Python3.11.
Aug 3 2024, 12:18 · Servers
dereckson claimed T1991: Context has again been lost on /var/log/www.

We can actually provide P352 as hotfix.

Aug 3 2024, 12:13 · upstream, Regression, Servers, Salt
dereckson added a comment to D3390: Install patch on RHEL-family servers.

Ok, with wget/wget2 transition still problematic (unrelated to patch package).

Aug 3 2024, 12:13
dereckson added a revision to T1992: Install patch on redhat family as part of core: D3390: Install patch on RHEL-family servers.
Aug 3 2024, 12:08 · Servers
dereckson requested review of D3390: Install patch on RHEL-family servers.
Aug 3 2024, 12:08
dereckson added a comment to T1992: Install patch on redhat family as part of core.

patch is available on Eglide as part of build-essential, so presumed OK for Debian

Aug 3 2024, 12:06 · Servers
dereckson added a parent task for T1992: Install patch on redhat family as part of core: T1991: Context has again been lost on /var/log/www.
Aug 3 2024, 12:04 · Servers
dereckson added a subtask for T1991: Context has again been lost on /var/log/www: T1992: Install patch on redhat family as part of core.
Aug 3 2024, 12:04 · upstream, Regression, Servers, Salt
dereckson requested changes to D3387: Expose metrics for dovecot.

Logic looks good to me. Tested working fine on Prometheus.

Aug 3 2024, 11:58
dereckson updated the test plan for D3388: Scrape Dovecot metrics into Prometheus.
Aug 3 2024, 11:55
dereckson updated the test plan for D3388: Scrape Dovecot metrics into Prometheus.
Aug 3 2024, 11:54
dereckson retitled D3387: Expose metrics for dovecot from Init metrics for dovecot to Expose metrics for dovecot.
Aug 3 2024, 11:53
dereckson added a comment to T1987: Dovecot Metrics.

Live on Hervil.

Aug 3 2024, 11:51 · Restricted Project, Mail
dereckson accepted D3388: Scrape Dovecot metrics into Prometheus.

I can query from Prometheus the metrics.

Aug 3 2024, 11:50
dereckson added a comment to D3388: Scrape Dovecot metrics into Prometheus.
WindRiver
$ arc patch D3388
[…]
Aug 3 2024, 11:49
dereckson added a comment to T1982: Upgrade from Python 3.9 to Python 3.11+.

certbot against Python 3.11 should be checked on dwellers and docker-002

Aug 3 2024, 11:45 · Servers
dereckson committed rOPS7d32f4cfeeb2: Bump default versions to build ports (authored by dereckson).
Bump default versions to build ports
Aug 3 2024, 11:43
dereckson closed D3368: Bump default versions to build ports.
Aug 3 2024, 11:43
dereckson closed D3371: Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines".
Aug 3 2024, 11:42