Page MenuHomeDevCentral
Feed All Stories

Jul 29 2024

DorianWinty updated the diff for D3364: Provisioning Dovecot Config.

remove unused password use

Jul 29 2024, 18:57
dereckson edited reviewers for D3385: Switch from fixes to flags in node pillar, added: DorianWinty; removed: dereckson.
Jul 29 2024, 18:47

Jul 28 2024

DorianWinty accepted D3368: Bump default versions to build ports.
Jul 28 2024, 19:56
DorianWinty accepted D3371: Revert "Install Python 3.9 on CentOS/Rocky 8.5 machines".
Jul 28 2024, 19:55

Jul 27 2024

dereckson requested review of D3385: Switch from fixes to flags in node pillar.
Jul 27 2024, 23:19
dereckson added a revision to T1762: Deploy NetBox: D3385: Switch from fixes to flags in node pillar.
Jul 27 2024, 23:19 · Restricted Project, Servers, Drake network
dereckson added a comment to D2790: WIP: Generate a pillar from NetBox information.

Also missing: "ipv6_dhcp_duid" flag for windriver

Jul 27 2024, 23:12
dereckson closed D3384: Split IPv6 network configuration.
Jul 27 2024, 22:45
dereckson committed rOPS8a20be8f6ce1: Split IPv6 network configuration (authored by dereckson).
Split IPv6 network configuration
Jul 27 2024, 22:45
dereckson accepted D3384: Split IPv6 network configuration.
Jul 27 2024, 22:44
dereckson requested review of D3384: Split IPv6 network configuration.
Jul 27 2024, 22:17
dereckson raised the priority of T1939: Implement blue/green deployment or immutable artefacts for router-001 from Low to Normal.

Increasing priority as FreeBSD 13.2 is now EOL for one month (2024-06-30).

Jul 27 2024, 20:38 · Servers, Drake network
dereckson moved T1757: docker-001 routing for drake doesn't work on boot from IntraNought to IntraNought / GRE tunnels on the Drake network board.
Jul 27 2024, 20:33 · Operations sprints (Ignite Alkane Propulsion), Salt, Drake network, Servers, Nasqueron Docker deployment squad
dereckson triaged T1988: Revert NetBox tunnel glitch as High priority.
Jul 27 2024, 20:33 · Drake network
dereckson closed D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24
dereckson committed rOPSa76814b5d55c: Drop network:ipv6_native from node pillar (authored by dereckson).
Drop network:ipv6_native from node pillar
Jul 27 2024, 19:24
dereckson accepted D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24
dereckson requested review of D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24
dereckson added a revision to T1762: Deploy NetBox: D3383: Drop network:ipv6_native from node pillar.
Jul 27 2024, 19:24 · Restricted Project, Servers, Drake network
dereckson committed rOPSe4d8358b29a3: Exclude reserved addresses from /etc/hosts Drake entries (authored by dereckson).
Exclude reserved addresses from /etc/hosts Drake entries
Jul 27 2024, 18:35
dereckson closed D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35
dereckson accepted D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35
dereckson added a revision to T1767: Provision /etc/hosts: D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35 · Salt, Drake network
dereckson requested review of D3382: Exclude reserved addresses from /etc/hosts Drake entries.
Jul 27 2024, 18:35
dereckson committed rOPS3dec771810b4: Configure Docker metrics service in firewalld (authored by dereckson).
Configure Docker metrics service in firewalld
Jul 27 2024, 17:08
dereckson closed D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:08
dereckson accepted D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:07
dereckson requested review of D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:07
dereckson added a revision to T1623: Deploy Prometheus to gain observability: D3381: Configure Docker metrics service in firewalld.
Jul 27 2024, 17:07 · Monitoring and reporting, Operations sprints (Consolidate them all), Servers
dereckson closed D3380: Set correct Grafana URL.
Jul 27 2024, 13:59
dereckson committed rOPS44ae63bb6b2f: Set correct Grafana URL (authored by dereckson).
Set correct Grafana URL
Jul 27 2024, 13:59
dereckson accepted D3380: Set correct Grafana URL.
Jul 27 2024, 13:58
dereckson added a revision to T651: Deploy Grafana: D3380: Set correct Grafana URL.
Jul 27 2024, 13:57 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson requested review of D3380: Set correct Grafana URL.
Jul 27 2024, 13:57
dereckson closed D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:52
dereckson committed rOPS91ddc5cc0a67: Move Grafana plugins directory to default location (authored by dereckson).
Move Grafana plugins directory to default location
Jul 27 2024, 13:52
dereckson accepted D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:52
dereckson requested review of D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:51
dereckson added a revision to T651: Deploy Grafana: D3379: Move Grafana plugins directory to default location.
Jul 27 2024, 13:51 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson committed rOPSe7a3480a4443: Expose RabbitMQ metrics on port 15692 (authored by dereckson).
Expose RabbitMQ metrics on port 15692
Jul 27 2024, 12:15
dereckson closed D3374: Expose RabbitMQ metrics on port 15692.
Jul 27 2024, 12:15
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Dashboard: https://grafana.nasqueron.org/d/Kn5xm-gZk/rabbitmq-overview?orgId=1&refresh=15s

Jul 27 2024, 12:14 · Operations sprints (Consolidate them all), Servers
dereckson committed rOPSd17f23473772: Scrape RabbitMQ metrics into Prometheus (authored by dereckson).
Scrape RabbitMQ metrics into Prometheus
Jul 27 2024, 12:11
dereckson closed D3376: Scrape RabbitMQ metrics into Prometheus.
Jul 27 2024, 12:11
dereckson closed D3370: Deploy Prometheus on WindRiver.
Jul 27 2024, 12:10
dereckson committed rOPSf2455785f16d: Deploy Prometheus on WindRiver (authored by dereckson).
Deploy Prometheus on WindRiver
Jul 27 2024, 12:10
dereckson accepted D3370: Deploy Prometheus on WindRiver.
Jul 27 2024, 12:10
dereckson published D3370: Deploy Prometheus on WindRiver for review.
Jul 27 2024, 12:09
dereckson closed D3378: Declare libexec to dirs map.
Jul 27 2024, 12:01
dereckson committed rOPSbc4be357c9ec: Declare libexec to dirs map (authored by dereckson).
Declare libexec to dirs map
Jul 27 2024, 12:01
dereckson accepted D3378: Declare libexec to dirs map.
Jul 27 2024, 12:01
dereckson requested review of D3378: Declare libexec to dirs map.
Jul 27 2024, 12:00

Jul 26 2024

dereckson removed a project from T651: Deploy Grafana: Nasqueron Docker deployment squad.

Not deployed to Docker but bare-metal.

Jul 26 2024, 23:09 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson moved T651: Deploy Grafana from Backlog - Monitoring / misc to Working on on the Operations sprints (Ignite Alkane Propulsion) board.
Jul 26 2024, 23:09 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson moved T651: Deploy Grafana from Backlog to Working on on the Servers board.
Jul 26 2024, 23:09 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson closed D3377: Deploy Grafana.
Jul 26 2024, 23:08
dereckson committed rOPS1a46d56b872f: Deploy Grafana (authored by dereckson).
Deploy Grafana
Jul 26 2024, 23:08
dereckson accepted D3377: Deploy Grafana.
Jul 26 2024, 23:08
dereckson updated the diff for D3377: Deploy Grafana.

Fix whitespace issue

Jul 26 2024, 23:06
dereckson accepted D3376: Scrape RabbitMQ metrics into Prometheus.
Jul 26 2024, 23:05
dereckson accepted D3374: Expose RabbitMQ metrics on port 15692.

Still to deploy.

Jul 26 2024, 23:04
dereckson added a comment to T650: Deploy PCP on Docker engines.

T651 has a Grafana ready if we wish to retest this on Dwellers, green light.

Jul 26 2024, 19:39 · Monitoring and reporting, Servers
dereckson added a comment to T651: Deploy Grafana.

Deployed at https://grafana.nasqueron.org/

Jul 26 2024, 19:38 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson updated the summary of D3377: Deploy Grafana.
Jul 26 2024, 19:38
dereckson added a revision to T651: Deploy Grafana: D3377: Deploy Grafana.
Jul 26 2024, 19:38 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson requested review of D3377: Deploy Grafana.
Jul 26 2024, 19:37
dereckson added a revision to T1633: Collect metrics from RabbitMQ: D3376: Scrape RabbitMQ metrics into Prometheus.
Jul 26 2024, 19:34 · Operations sprints (Consolidate them all), Servers
dereckson requested review of D3376: Scrape RabbitMQ metrics into Prometheus.
Jul 26 2024, 19:34
dereckson added a comment to T1496: Deploy StatsD and Graphite.

With a transformation, we can multiply the field by 10 to solve that issue: https://grafana.nasqueron.org/d/fdsy3oogbchs0f/graphite-quux-sandbox?orgId=1&tab=transform&from=1722018733917&to=1722022333917

Jul 26 2024, 19:32 · Operations sprints (Ignite Alkane Propulsion), Nasqueron Docker deployment squad, Monitoring and reporting
dereckson added a comment to T1496: Deploy StatsD and Graphite.

The graphite Docker image provides both pieces of software.

Jul 26 2024, 19:24 · Operations sprints (Ignite Alkane Propulsion), Nasqueron Docker deployment squad, Monitoring and reporting
dereckson renamed T1496: Deploy StatsD and Graphite from Deploy graphite to Deploy StatsD and Graphite.
Jul 26 2024, 19:13 · Operations sprints (Ignite Alkane Propulsion), Nasqueron Docker deployment squad, Monitoring and reporting
dereckson merged task T1495: Deploy StatsD into T1496: Deploy StatsD and Graphite.
Jul 26 2024, 19:13 · Operations sprints (Ignite Alkane Propulsion), Nasqueron Docker deployment squad, Monitoring and reporting
dereckson merged T1495: Deploy StatsD into T1496: Deploy StatsD and Graphite.
Jul 26 2024, 19:13 · Operations sprints (Ignite Alkane Propulsion), Nasqueron Docker deployment squad, Monitoring and reporting

Jul 25 2024

dereckson added a comment to T1505: Automate Let's Encrypt TLS certificates management for every server.

rOPS1e9a54c10365 has worked like a charm on WindRiver to generate grafana.nasqueron.org through DNS.

Jul 25 2024, 20:43 · Servers
dereckson triaged T1505: Automate Let's Encrypt TLS certificates management for every server as Normal priority.
Jul 25 2024, 20:42 · Servers
dereckson committed rOPS1e9a54c10365: Deploy Certbot everywhere (authored by dereckson).
Deploy Certbot everywhere
Jul 25 2024, 20:41
dereckson closed D3248: Deploy Certbot everywhere.
Jul 25 2024, 20:41
dereckson updated the diff for D3248: Deploy Certbot everywhere.

Rebased. Use /usr/local/etc/periodic. Clean certbot_dir.

Jul 25 2024, 20:41
DorianWinty updated the diff for D3242: Install postfix.

add hostname

Jul 25 2024, 18:56
dereckson added a comment to T651: Deploy Grafana.

DNS: grafana. CNAME www-dev.nasqueron.org

Jul 25 2024, 18:49 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson added a comment to T651: Deploy Grafana.

Deployment can be using sqlite3 as long as it's still performant
as we want our monitoring tools to be resiliant.

Jul 25 2024, 18:49 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
DorianWinty updated the diff for D3364: Provisioning Dovecot Config.

follow comments

Jul 25 2024, 18:46
dereckson added a comment to T650: Deploy PCP on Docker engines.

Probably a good part of roles/core/monitoring when grains["os_family"] == "RedHat". Eglide has "Debian" for that grain, but not sure if we've enough RAM there.

Jul 25 2024, 18:17 · Monitoring and reporting, Servers
DorianWinty updated the diff for D3364: Provisioning Dovecot Config.

chmod of files and folder + encryption

Jul 25 2024, 18:14
dereckson added a comment to T652: Install PCP on Dwellers.

Just for reference, this was a test deployment. This is not currently installed on Dwellers, and needs to be in Salt as part of T650.

Jul 25 2024, 18:13 · Servers
dereckson renamed T650: Deploy PCP on Docker engines from Give access to Dwellers key statistics to Deploy PCP on Docker engines.
Jul 25 2024, 18:12 · Monitoring and reporting, Servers
dereckson raised the priority of T651: Deploy Grafana from Low to Normal.
Jul 25 2024, 18:12 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson claimed T651: Deploy Grafana.

This task has been created in 2016 to publish metrics from PCP (Performance Co-Pilot) on RHEL-like servers, especially our Docker engines.

Jul 25 2024, 18:12 · Monitoring and reporting, Operations sprints (Ignite Alkane Propulsion), Servers
dereckson added a comment to T1623: Deploy Prometheus to gain observability.

RabbitMQ exporters have been added to NetBox under the tag observability -> https://netbox.nasqueron.org/ipam/services/?tag=observability 🔒

Jul 25 2024, 18:04 · Monitoring and reporting, Operations sprints (Consolidate them all), Servers
dereckson added parent tasks for T1987: Dovecot Metrics: T1931: Dovecot Provisioning, T1623: Deploy Prometheus to gain observability.
Jul 25 2024, 18:03 · Restricted Project, Mail
dereckson added a subtask for T1623: Deploy Prometheus to gain observability: T1987: Dovecot Metrics.
Jul 25 2024, 18:03 · Monitoring and reporting, Operations sprints (Consolidate them all), Servers
dereckson added a subtask for T1931: Dovecot Provisioning: T1987: Dovecot Metrics.
Jul 25 2024, 18:03 · Mail, Restricted Project, Servers
dereckson added inline comments to D3364: Provisioning Dovecot Config.
Jul 25 2024, 17:47
dereckson requested changes to D3364: Provisioning Dovecot Config.
Jul 25 2024, 17:45
dereckson added a comment to T1932: ViMbAdmin Provisioning.

Next: memcached

Jul 25 2024, 17:39 · Mail, Restricted Project, Servers
dereckson closed D3373: Enable rabbitmq_prometheus plugin.
Jul 25 2024, 17:37
dereckson committed rDRABBITMQ0b92cff35baa: Enable rabbitmq_prometheus plugin (authored by dereckson).
Enable rabbitmq_prometheus plugin
Jul 25 2024, 17:37
dereckson accepted D3373: Enable rabbitmq_prometheus plugin.
Jul 25 2024, 17:36
dereckson added a comment to T1633: Collect metrics from RabbitMQ.

Pending container redeployment with D3374, we can reach metrics set in D3373 with socat:

Jul 25 2024, 17:36 · Operations sprints (Consolidate them all), Servers
DorianWinty published D3364: Provisioning Dovecot Config for review.
Jul 25 2024, 17:09