Page MenuHomeDevCentral
Feed All Stories

Aug 3 2024

dereckson committed rOPS67fecad1cda9: Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines" (authored by dereckson).
Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines"
Aug 3 2024, 11:42
dereckson added a reverting change for D2609: Install Python 3.9 on CentOS/Rocky 8.5 machines: rOPS67fecad1cda9: Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines".
Aug 3 2024, 11:42
dereckson added a reverting change for rOPSe509029a4712: Install Python 3.9 on CentOS/Rocky 8.5 machines: rOPS67fecad1cda9: Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines".
Aug 3 2024, 11:42
dereckson closed D3385: Switch from fixes to flags in node pillar.
Aug 3 2024, 11:37
dereckson committed rOPSe0d579362756: Switch from fixes to flags in node pillar (authored by dereckson).
Switch from fixes to flags in node pillar
Aug 3 2024, 11:37
dereckson requested review of D3389: Refresh known issues.
Aug 3 2024, 11:36
dereckson moved T1992: Install patch on redhat family as part of core from Backlog to Working on on the Servers board.
Aug 3 2024, 11:30 · Servers
dereckson triaged T1993: Salt migration to 3007, 3008 and extensions as Normal priority.
Aug 3 2024, 11:16 · Nasqueron Operations Squad, discussion, Salt
dereckson lowered the priority of T1991: Context has again been lost on /var/log/www from High to Normal.
Aug 3 2024, 10:11 · upstream, Regression, Servers, Salt
dereckson added a comment to T1991: Context has again been lost on /var/log/www.

I've applied P352 to replace egrep by grep -E on dwellers and docker-002.

Aug 3 2024, 10:11 · upstream, Regression, Servers, Salt
dereckson added a comment to T1992: Install patch on redhat family as part of core.

I wanted to apply P354 to fix Salt SELinux issue with patch -p1 < ~/egrep.patch on docker-002.

Aug 3 2024, 10:09 · Servers
dereckson updated the task description for T1992: Install patch on redhat family as part of core.
Aug 3 2024, 10:08 · Servers
dereckson triaged T1992: Install patch on redhat family as part of core as Normal priority.
Aug 3 2024, 10:08 · Servers
dereckson claimed T1992: Install patch on redhat family as part of core.
Aug 3 2024, 10:07 · Servers
dereckson created P354 Salt patch to supersede egrep by grep -E.
Aug 3 2024, 10:04

Jul 31 2024

DorianWinty added a revision to T1987: Dovecot Metrics: D3388: Scrape Dovecot metrics into Prometheus.
Jul 31 2024, 17:51 · Restricted Project, Mail
DorianWinty requested review of D3388: Scrape Dovecot metrics into Prometheus.
Jul 31 2024, 17:51
DorianWinty updated the diff for D3387: Expose metrics for dovecot.

uncomment all default metrics

Jul 31 2024, 17:40
DorianWinty added a comment to D3387: Expose metrics for dovecot.
# HELP process_start_time_seconds Timestamp of service start
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1722447303
# HELP dovecot_build Dovecot build information
# TYPE dovecot_build info
dovecot_build_info{version="2.3.21",revision="47349e2482"} 1
# EOF
Jul 31 2024, 17:37
DorianWinty requested review of D3387: Expose metrics for dovecot.
Jul 31 2024, 17:37
DorianWinty added a revision to T1987: Dovecot Metrics: D3387: Expose metrics for dovecot.
Jul 31 2024, 17:37 · Restricted Project, Mail
DorianWinty closed D3386: Scrape Postfix metrics into Prometheus.
Jul 31 2024, 16:33
DorianWinty committed rOPSe8b486d9e75b: Scrape Postfix metrics into Prometheus (authored by DorianWinty).
Scrape Postfix metrics into Prometheus
Jul 31 2024, 16:33
dereckson moved T1991: Context has again been lost on /var/log/www from Backlog to Bug and issues on the Salt board.
Jul 31 2024, 16:30 · upstream, Regression, Servers, Salt
dereckson added a project to T1991: Context has again been lost on /var/log/www: upstream.
Jul 31 2024, 16:30 · upstream, Regression, Servers, Salt
dereckson added a comment to T1991: Context has again been lost on /var/log/www.

Already reported upstream: https://github.com/saltstack/salt/issues/65608

Jul 31 2024, 16:30 · upstream, Regression, Servers, Salt
dereckson added a comment to T1991: Context has again been lost on /var/log/www.
Complector
$ cd /opt/salt/nasqueron-operations
$ salt dwellers state.apply roles/webserver-core/nginx/config
[…]
----------                                                                                                                                                                                                                                    [3/295]
          ID: selinux_context_nginx_logs
    Function: selinux.fcontext_policy_present
        Name: /var/log/www
      Result: False
     Comment: An exception occurred in this state: Traceback (most recent call last):
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/state.py", line 2428, in call
                  ret = self.states[cdata["full"]](
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 160, in __call__
                  ret = self.loader.run(run_func, *args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 1269, in run
                  return self._last_context.run(self._run_as, _func_or_method, *args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 1284, in _run_as
                  return _func_or_method(*args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 1317, in wrapper
                  return f(*args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/states/selinux.py", line 326, in fcontext_policy_present
                  current_state = __salt__["selinux.fcontext_get_policy"](
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 160, in __call__
                  ret = self.loader.run(run_func, *args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 1269, in run
                  return self._last_context.run(self._run_as, _func_or_method, *args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/loader/lazy.py", line 1284, in _run_as
                  return _func_or_method(*args, **kwargs)
                File "/opt/saltstack/salt/lib/python3.10/site-packages/salt/modules/selinux.py", line 507, in fcontext_get_policy
                  "filespec": parts.group(1).strip(),
              AttributeError: 'NoneType' object has no attribute 'group'
     Started: 16:25:51.413301
    Duration: 391.186 ms
     Changes:
----------
          ID: selinux_context_nginx_logs_applied
    Function: selinux.fcontext_policy_applied
        Name: /var/log/www
      Result: True
     Comment: SElinux policies are already applied for filespec "/var/log/www"
     Started: 16:25:51.804764
    Duration: 6.322 ms
     Changes:
----------
[…]
Jul 31 2024, 16:27 · upstream, Regression, Servers, Salt
DorianWinty added a comment to T1505: Automate Let's Encrypt TLS certificates management for every server.

31/07/2024 at 12h the devcentral.nasqueron.org certificate expired

Jul 31 2024, 16:24 · Servers
dereckson added a comment to T1991: Context has again been lost on /var/log/www.

Issue can be repro on Dwellers:

Jul 31 2024, 16:23 · upstream, Regression, Servers, Salt
dereckson edited Description on Regression.
Jul 31 2024, 16:22
dereckson added a project to T1991: Context has again been lost on /var/log/www: Regression.
Jul 31 2024, 16:22 · upstream, Regression, Servers, Salt
dereckson triaged T1991: Context has again been lost on /var/log/www as High priority.
Jul 31 2024, 16:21 · upstream, Regression, Servers, Salt

Jul 30 2024

dereckson accepted D3386: Scrape Postfix metrics into Prometheus.
Jul 30 2024, 21:32
dereckson assigned T1990: Export metrics for Postfix to DorianWinty.

Author seems to report issues with the exporter and uses mtail.

Jul 30 2024, 21:30 · Mail, Monitoring and reporting
DorianWinty added a revision to T1990: Export metrics for Postfix: D3386: Scrape Postfix metrics into Prometheus.
Jul 30 2024, 21:00 · Mail, Monitoring and reporting
DorianWinty requested review of D3386: Scrape Postfix metrics into Prometheus.
Jul 30 2024, 21:00
DorianWinty added a subtask for T1930: Postfix Provisioning: T1990: Export metrics for Postfix.
Jul 30 2024, 20:59 · Mail, Restricted Project, Servers
DorianWinty added a parent task for T1990: Export metrics for Postfix: T1930: Postfix Provisioning.
Jul 30 2024, 20:59 · Mail, Monitoring and reporting
DorianWinty updated the diff for D3242: Install postfix.

update depending of the hand made changes

Jul 30 2024, 17:23
DorianWinty accepted D3385: Switch from fixes to flags in node pillar.
Jul 30 2024, 16:11

Jul 29 2024

dereckson triaged T1990: Export metrics for Postfix as Normal priority.
Jul 29 2024, 20:33 · Mail, Monitoring and reporting
DorianWinty updated the diff for D3242: Install postfix.

update

Jul 29 2024, 20:02
dereckson added inline comments to D3242: Install postfix.
Jul 29 2024, 19:54
DorianWinty closed D3364: Provisioning Dovecot Config.
Jul 29 2024, 19:03
DorianWinty committed rOPSf6419f2b78d8: Provisioning Dovecot Config (authored by DorianWinty).
Provisioning Dovecot Config
Jul 29 2024, 19:03
dereckson accepted D3364: Provisioning Dovecot Config.
Jul 29 2024, 19:01
dereckson moved T1989: Merge Nasqueron infrastructure reference into ops grimoire from Backlog - On hold pending T1475 to Checks after T1475 on the Mail board.
Jul 29 2024, 18:58 · Mail, Nasqueron Operations Squad, Servers, documentation
dereckson triaged T1989: Merge Nasqueron infrastructure reference into ops grimoire as Normal priority.
Jul 29 2024, 18:58 · Mail, Nasqueron Operations Squad, Servers, documentation
DorianWinty updated the diff for D3364: Provisioning Dovecot Config.

remove unused password use

Jul 29 2024, 18:57
dereckson edited reviewers for D3385: Switch from fixes to flags in node pillar, added: DorianWinty; removed: dereckson.
Jul 29 2024, 18:47

Jul 28 2024

DorianWinty accepted D3368: Bump default versions to build ports.
Jul 28 2024, 19:56
DorianWinty accepted D3371: Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines".
Jul 28 2024, 19:55

Jul 27 2024

dereckson requested review of D3385: Switch from fixes to flags in node pillar.
Jul 27 2024, 23:19
dereckson added a revision to T1762: Deploy NetBox: D3385: Switch from fixes to flags in node pillar.
Jul 27 2024, 23:19 · Restricted Project, Servers, Restricted Project
dereckson added a comment to D2790: WIP: Generate a pillar from NetBox information.

Also missing: "ipv6_dhcp_duid" flag for windriver

Jul 27 2024, 23:12
dereckson closed D3384: Split IPv6 network configuration.
Jul 27 2024, 22:45
dereckson committed rOPS8a20be8f6ce1: Split IPv6 network configuration (authored by dereckson).
Split IPv6 network configuration
Jul 27 2024, 22:45
dereckson accepted D3384: Split IPv6 network configuration.
Jul 27 2024, 22:44
dereckson requested review of D3384: Split IPv6 network configuration.
Jul 27 2024, 22:17
dereckson raised the priority of T1939: Implement blue/green deployment or immutable artefacts for router-001 from Low to Normal.

Increasing priority as FreeBSD 13.2 is now EOL for one month (2024-06-30).

Jul 27 2024, 20:38 · Servers, Restricted Project
dereckson moved T1757: docker-001 routing for drake doesn't work on boot from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jul 27 2024, 20:33 · Operations sprints (Ignite Alkane Propulsion), Salt, Restricted Project, Servers, Nasqueron Docker deployment squad
dereckson triaged T1988: Revert NetBox tunnel glitch as High priority.
Jul 27 2024, 20:33 · Restricted Project
dereckson closed D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24
dereckson committed rOPSa76814b5d55c: Drop network:ipv6_native from node pillar (authored by dereckson).
Drop network:ipv6_native from node pillar
Jul 27 2024, 19:24
dereckson accepted D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24
dereckson requested review of D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24
dereckson added a revision to T1762: Deploy NetBox: D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24 · Restricted Project, Servers, Restricted Project
dereckson committed rOPSe4d8358b29a3: Exclude reserved addresses from /etc/hosts Drake entries (authored by dereckson).
Exclude reserved addresses from /etc/hosts Drake entries
Jul 27 2024, 18:35
dereckson closed D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35
dereckson accepted D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35
dereckson added a revision to T1767: Provision /etc/hosts: D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35 · Salt, Restricted Project
dereckson requested review of D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35
dereckson committed rOPS3dec771810b4: Configure Docker metrics service in firewalld (authored by dereckson).
Configure Docker metrics service in firewalld
Jul 27 2024, 17:08
dereckson closed D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:08
dereckson accepted D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:07
dereckson requested review of D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:07
dereckson added a revision to T1623: Deploy Prometheus to gain observability: D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:07 · Monitoring and reporting, Operations sprints (Consolidate them all), Servers
dereckson closed D3380: Set correct Grafana URL.
Jul 27 2024, 13:59
dereckson committed rOPS44ae63bb6b2f: Set correct Grafana URL (authored by dereckson).
Set correct Grafana URL
Jul 27 2024, 13:59
dereckson accepted D3380: Set correct Grafana URL.
Jul 27 2024, 13:58
dereckson added a revision to T651: Deploy Grafana: D3380: Set correct Grafana URL.
Jul 27 2024, 13:57 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson requested review of D3380: Set correct Grafana URL.
Jul 27 2024, 13:57
dereckson closed D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:52
dereckson committed rOPS91ddc5cc0a67: Move Grafana plugins directory to default location (authored by dereckson).
Move Grafana plugins directory to default location
Jul 27 2024, 13:52
dereckson accepted D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:52
dereckson requested review of D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:51
dereckson added a revision to T651: Deploy Grafana: D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:51 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson committed rOPSe7a3480a4443: Expose RabbitMQ metrics on port 15692 (authored by dereckson).
Expose RabbitMQ metrics on port 15692
Jul 27 2024, 12:15
dereckson closed D3374: Expose RabbitMQ metrics on port 15692.
Jul 27 2024, 12:15
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Dashboard: https://grafana.nasqueron.org/d/Kn5xm-gZk/rabbitmq-overview?orgId=1&refresh=15s

Jul 27 2024, 12:14 · Operations sprints (Consolidate them all), Servers
dereckson committed rOPSd17f23473772: Scrape RabbitMQ metrics into Prometheus (authored by dereckson).
Scrape RabbitMQ metrics into Prometheus
Jul 27 2024, 12:11
dereckson closed D3376: Scrape RabbitMQ metrics into Prometheus.
Jul 27 2024, 12:11
dereckson closed D3370: Deploy Prometheus on WindRiver.
Jul 27 2024, 12:10
dereckson committed rOPSf2455785f16d: Deploy Prometheus on WindRiver (authored by dereckson).
Deploy Prometheus on WindRiver
Jul 27 2024, 12:10
dereckson accepted D3370: Deploy Prometheus on WindRiver.
Jul 27 2024, 12:10
dereckson published D3370: Deploy Prometheus on WindRiver for review.
Jul 27 2024, 12:09
dereckson closed D3378: Declare libexec to dirs map.
Jul 27 2024, 12:01
dereckson committed rOPSbc4be357c9ec: Declare libexec to dirs map (authored by dereckson).
Declare libexec to dirs map
Jul 27 2024, 12:01
dereckson accepted D3378: Declare libexec to dirs map.
Jul 27 2024, 12:01
dereckson requested review of D3378: Declare libexec to dirs map.
Jul 27 2024, 12:00