Page MenuHomeDevCentral
Feed Advanced Search

Mar 25 2023

dereckson triaged T1803: Move and migrate Ysul production services elsewhere as Normal priority.
Mar 25 2023, 11:02 · Operations sprints (Ignite Alkane Propulsion), Alkane, Servers
dereckson closed T1791: Refresh Sentry installation as Resolved.
Mar 25 2023, 09:53 · Monitoring and reporting
dereckson added a comment to T1750: Import FANTOIR database.

To configure Airflow, we can need a PostgreSQL DSN.

Mar 25 2023, 09:46 · Nasqueron Databases
dereckson added a comment to T1791: Refresh Sentry installation.

Current status

Mar 25 2023, 09:45 · Monitoring and reporting
dereckson closed T1802: Upgrade Sentry to 23.3.1 as Resolved.
docker-002
$ docker pull nasqueron/sentry
[…]
$ sentry nasqueron upgrade
[…]
Running migrations for default
Operations to perform:
  Apply all migrations: admin, auth, contenttypes, nodestore, replays, sentry, sessions, sites, social_auth
Running migrations:
  Applying sentry.0380_backfill_monitor_env_initial... OK
  Applying sentry.0381_fix_org_slug_casing... OK
  Applying sentry.0382_add_installation_id_to_service_hook... OK
  Applying sentry.0383_mv_user_avatar... OK
  Applying sentry.0384_backfill_installation_ids... OK
  Applying sentry.0385_service_hook_hc_fk... OK
  Applying sentry.0386_backfill_monitor_env_checkins... OK
  Applying sentry.0387_add_until_escalating_column_to_groupsnooze... OK
  Applying sentry.0388_remove_unique_constraint_artifact_bundle... OK
  Applying sentry.0389_nullify_debug_id_artifact_bundle_field... OK
  Applying sentry.0390_remove_field_in_bundle_model... OK
  Applying sentry.0391_remove_field_in_bundle_model_from_db... OK
  Applying sentry.0392_add_date_uploaded_field_to_bundle... OK
  Applying sentry.0393_create_groupforecast_table... OK
  Applying sentry.0394_set_none_date_uploaded_to_date_added... OK
Creating missing DSNs
Correcting Group.num_comments counter
$ deploy-container sentry
[…]
Mar 25 2023, 09:29 · Monitoring and reporting
dereckson closed D2908: Pull nasqueron/sentry image.
Mar 25 2023, 08:49
dereckson committed rOPS2517ada8c0e0: Pull nasqueron/sentry image (authored by dereckson).
Pull nasqueron/sentry image
Mar 25 2023, 08:49
dereckson updated the diff for D2908: Pull nasqueron/sentry image.

Alphabetic order

Mar 25 2023, 08:49
dereckson accepted D2908: Pull nasqueron/sentry image.
Mar 25 2023, 08:49
dereckson requested review of D2908: Pull nasqueron/sentry image.
Mar 25 2023, 08:48
dereckson added a revision to T1791: Refresh Sentry installation: D2908: Pull nasqueron/sentry image.
Mar 25 2023, 08:48 · Monitoring and reporting

Mar 24 2023

dereckson added a comment to T1802: Upgrade Sentry to 23.3.1.
docker-002
$ docker logs sentry_snuba_api
2023-03-24 20:58:44,295 Initializing Snuba...
2023-03-24 20:58:47,701 Snuba initialization took 3.4077668339014053s
2023-03-24 20:58:48,246 Initializing Snuba...
2023-03-24 20:58:51,448 Snuba initialization took 3.2032665936276317s
*** Starting uWSGI 2.0.20 (64bit) on [Fri Mar 24 20:58:51 2023] ***
compiled with version: 8.3.1 20190311 (Red Hat 8.3.1-3) on 11 November 2021 18:13:24
os: Linux-5.14.0-162.12.1.el9_1.0.2.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 30 22:14:42 UTC 2023
nodename: b225edf80078
machine: x86_64
clock source: unix
pcre jit disabled
detected number of CPU cores: 8
current working directory: /usr/src/snuba
detected binary path: /usr/local/bin/python
your memory page size is 4096 bytes
detected max file descriptor number: 1073741816
lock engine: pthread robust mutexes
thunder lock: enabled
uwsgi socket 0 bound to TCP address 0.0.0.0:1218 fd 3
Python version: 3.8.13 (default, Aug 23 2022, 09:42:19)  [GCC 10.2.1 20210110]
--- Python VM already initialized ---
Python main interpreter initialized at 0x564efb872870
python threads support enabled
your server socket listen backlog is limited to 100 connections
your mercy for graceful operations on workers is 60 seconds
mapped 145808 bytes (142 KB) for 1 cores
*** Operational MODE: single process ***
initialized 38 metrics
spawned uWSGI master process (pid: 1)
spawned uWSGI worker 1 (pid: 28, cores: 1)
metrics collector thread started
2023-03-24 20:58:51,868 Initializing Snuba...
WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x564efb872870 pid: 28 (default app)
Mar 24 2023, 21:01 · Monitoring and reporting
dereckson added a comment to T1802: Upgrade Sentry to 23.3.1.

ModuleNotFoundError: No module named 'snuba.settings.settings_self_hosted'

Mar 24 2023, 20:59 · Monitoring and reporting
dereckson added a comment to T1802: Upgrade Sentry to 23.3.1.
docker-002
$ docker logs sentry_zookeeper
[…]
===> User
uid=0(root) gid=0(root) groups=0(root)
===> Configuring ...
===> Running preflight checks ...
===> Check if /var/lib/zookeeper/data is writable ...
===> Check if /var/lib/zookeeper/log is writable ...
===> Launching ...
===> Launching zookeeper ...
[2023-03-24 20:43:14,853] WARN Either no config or no quorum defined in config, running  in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)
[2023-03-24 20:43:15,007] WARN o.e.j.s.ServletContextHandler@33f88ab{/,null,STOPPED} contextPath ends with /* (org.eclipse.jetty.server.handler.ContextHandler)
[2023-03-24 20:43:15,007] WARN Empty contextPath (org.eclipse.jetty.server.handler.ContextHandler)
[2023-03-24 20:43:15,078] WARN ServletContext@o.e.j.s.ServletContextHandler@33f88ab{/,null,STARTING} has uncovered http methods for path: /* (org.eclipse.jetty.security.SecurityHandler)
Mar 24 2023, 20:48 · Monitoring and reporting
dereckson closed D2907: Upgrade Sentry to 23.3.1.
Mar 24 2023, 20:40
dereckson committed rOPSbe16147e6590: Upgrade Sentry to 23.3.1 (authored by dereckson).
Upgrade Sentry to 23.3.1
Mar 24 2023, 20:40
dereckson accepted D2907: Upgrade Sentry to 23.3.1.
Mar 24 2023, 20:40
dereckson added a revision to T1802: Upgrade Sentry to 23.3.1: D2907: Upgrade Sentry to 23.3.1.
Mar 24 2023, 20:39 · Monitoring and reporting
dereckson requested review of D2907: Upgrade Sentry to 23.3.1.
Mar 24 2023, 20:39
dereckson updated the task description for T1802: Upgrade Sentry to 23.3.1.
Mar 24 2023, 20:37 · Monitoring and reporting
dereckson claimed T1802: Upgrade Sentry to 23.3.1.
Mar 24 2023, 20:35 · Monitoring and reporting
dereckson renamed T1243: Deploy Varnish on webserver-legacy from Deploy Varnish on Ysul to Deploy Varnish on webserver-legacy.
Mar 24 2023, 01:17 · Servers
dereckson closed T720: Ysul: cannot stat /etc/login.conf: Not permitted in capability mode as Resolved.

Not present in recent FreeBSD machines, so I guess it was solved during an OS upgrade.

Mar 24 2023, 01:14 · security, Servers
dereckson lowered the priority of T448: More modern jails management on Ysul from High to Low.

We currently use jails only on devserver role for Poudriere, not anymore for hosting purpose.

Mar 24 2023, 01:11 · IPv6, Operations sprint 0, Servers
dereckson added a parent task for T761: Automate to create subdomains DNS records: T1217: Host our DNS servers.
Mar 24 2023, 01:09 · DNS, Servers
dereckson added a subtask for T1217: Host our DNS servers: T761: Automate to create subdomains DNS records.
Mar 24 2023, 01:09 · Servers
dereckson added a comment to T761: Automate to create subdomains DNS records.

I guess it would make sense to manage DNS records as a Git repository.

Mar 24 2023, 01:09 · DNS, Servers
dereckson renamed T761: Automate to create subdomains DNS records from Install a DNS server on ysul to Automate to create subdomains DNS records.
Mar 24 2023, 01:08 · DNS, Servers
dereckson added a comment to T1731: Ensure Notifications Center CI jobs run smoothly in PHP 8.1 .

phpmd and pdpend are still missing per T1002.

Mar 24 2023, 01:07 · Continous integration and delivery, Notifications center
dereckson merged T1002: Install pdepend, phpcpd, phpcs, phploc on Ysul into T1731: Ensure Notifications Center CI jobs run smoothly in PHP 8.1 .
Mar 24 2023, 01:06 · Continous integration and delivery, Notifications center
dereckson merged task T1002: Install pdepend, phpcpd, phpcs, phploc on Ysul into T1731: Ensure Notifications Center CI jobs run smoothly in PHP 8.1 .
Mar 24 2023, 01:06 · Servers
dereckson closed T1230: Low disk space on Ysul as Resolved.

Currently 79G free.

Mar 24 2023, 01:05 · Servers
dereckson closed T1031: Server outage: ysul.nasqueron.org doesn't reply to ping as Resolved.
Mar 24 2023, 01:05 · Servers
dereckson closed T1312: ZFS snapshots on devserver as Resolved by committing rOPS537a319f6313: Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:58 · Servers, Operations sprints (The Dreadnought will produce new officers)
dereckson closed T1312: ZFS snapshots on devserver, a subtask of T1268: Reprovision Ysul, as Resolved.
Mar 24 2023, 00:58 · Operations sprints (The Dreadnought will produce new officers), Salt, Servers
dereckson closed D2906: Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:58
dereckson committed rOPS537a319f6313: Setup ZFS snapshots for home volumes (authored by dereckson).
Setup ZFS snapshots for home volumes
Mar 24 2023, 00:58
dereckson added a comment to D2906: Setup ZFS snapshots for home volumes.

ZFS property no-op on WindRiver, so the state is idempotent:

Mar 24 2023, 00:57
dereckson accepted D2906: Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:54
dereckson updated the diff for D2906: Setup ZFS snapshots for home volumes.

Correct package name

Mar 24 2023, 00:54
dereckson planned changes to D2906: Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:51
dereckson retitled D2906: Setup ZFS snapshots for home volumes from Setup ZFS snapshots for home volumes This allows to go back in time to recover or compare files. Especially useful on devservers, it can be useful too on other servers, and allow an unified setup for FreeBSD machines. to Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:47
dereckson requested review of D2906: Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:46
dereckson added a revision to T1312: ZFS snapshots on devserver: D2906: Setup ZFS snapshots for home volumes.
Mar 24 2023, 00:46 · Servers, Operations sprints (The Dreadnought will produce new officers)
dereckson triaged T1312: ZFS snapshots on devserver as High priority.

⚠ It's been experimentally manually configured on WindRiver through zfs-auto-snapshot.

Mar 24 2023, 00:29 · Servers, Operations sprints (The Dreadnought will produce new officers)
dereckson renamed T1312: ZFS snapshots on devserver from ZFS snapshots on Ysul to ZFS snapshots on devserver.
Mar 24 2023, 00:17 · Servers, Operations sprints (The Dreadnought will produce new officers)
dereckson renamed T305: Installed dictionaries on devserver from Installed dictionaries on Ysul to Installed dictionaries on devserver.
Mar 24 2023, 00:16 · Salt, Servers
dereckson added a comment to T519: Set kern.ipc.somaxconn to 1024 on Ysul.

Change applied to every FreeBSD server, including Ysul.

Mar 24 2023, 00:15 · Servers
dereckson closed T519: Set kern.ipc.somaxconn to 1024 on Ysul as Resolved.
Mar 24 2023, 00:15 · Servers
dereckson closed T1801: sysctl conflict for router role, a subtask of T519: Set kern.ipc.somaxconn to 1024 on Ysul, as Invalid.
Mar 24 2023, 00:15 · Servers
dereckson closed T1801: sysctl conflict for router role as Invalid.

So roles/core/network/routes.sls provisions a rc file with gateway_enable="YES", and that enables net.inet.ip.forwarding.

Mar 24 2023, 00:15 · Servers
dereckson closed D2905: Use node.has_role method.
Mar 24 2023, 00:11
dereckson committed rOPS71ca2f91f5d1: Use node.has_role method (authored by dereckson).
Use node.has_role method
Mar 24 2023, 00:11
dereckson accepted D2905: Use node.has_role method.
Mar 24 2023, 00:11
dereckson requested review of D2905: Use node.has_role method.
Mar 24 2023, 00:11
dereckson added a revision to T1801: sysctl conflict for router role: D2905: Use node.has_role method.
Mar 24 2023, 00:11 · Servers
dereckson added a comment to T1801: sysctl conflict for router role.

Actually, we don't have any unit for the router role.

Mar 24 2023, 00:07 · Servers

Mar 23 2023

dereckson triaged T1801: sysctl conflict for router role as High priority.
Mar 23 2023, 23:58 · Servers
dereckson closed D2904: Increase maximum number of connection requests in queue for a socket.
Mar 23 2023, 23:55
dereckson committed rOPSbef5764143dc: Increase maximum number of connection requests in queue for a socket (authored by dereckson).
Increase maximum number of connection requests in queue for a socket
Mar 23 2023, 23:55
dereckson accepted D2904: Increase maximum number of connection requests in queue for a socket.
Mar 23 2023, 23:55
dereckson updated the diff for D2904: Increase maximum number of connection requests in queue for a socket.

Add task to the file comment

Mar 23 2023, 23:55
dereckson requested review of D2904: Increase maximum number of connection requests in queue for a socket.
Mar 23 2023, 23:53
dereckson added a revision to T519: Set kern.ipc.somaxconn to 1024 on Ysul: D2904: Increase maximum number of connection requests in queue for a socket.
Mar 23 2023, 23:53 · Servers
dereckson added a comment to T519: Set kern.ipc.somaxconn to 1024 on Ysul.
kern.ipc.somaxconn: 128 -> 1024
Mar 23 2023, 23:46 · Servers
dereckson added a comment to T519: Set kern.ipc.somaxconn to 1024 on Ysul.

Only a new occurence since last year:

Mar 23 2023, 23:46 · Servers
dereckson closed T1679: Upgrade PHP 7.4 base Docker image to recent Debian version, a subtask of T1547: Consolidate DevCentral Docker image, as Resolved.
Mar 23 2023, 23:39 · User-Dereckson, DevCentral, Servers, Technical debt, Nasqueron Docker deployment squad, Docker images
dereckson closed T1679: Upgrade PHP 7.4 base Docker image to recent Debian version, a subtask of T1677: Update PHP Docker images to PHP 8.1, as Resolved.
Mar 23 2023, 23:39 · Zed, Docker images, PHP 8.x support
dereckson closed T1679: Upgrade PHP 7.4 base Docker image to recent Debian version as Resolved.
Mar 23 2023, 23:39 · PHP 8.x support, Docker images, User-Dereckson

Mar 20 2023

dereckson accepted D2763: 1st commit.

Prototype OK.

Mar 20 2023, 21:20

Mar 17 2023

dereckson edited Description on rabbitmq-tcl.
Mar 17 2023, 13:41

Mar 16 2023

dereckson closed D2902: Handle .geoipupdate lock file.
Mar 16 2023, 19:15
dereckson committed rOPS8a59aa7594c2: Handle .geoipupdate lock file (authored by dereckson).
Handle .geoipupdate lock file
Mar 16 2023, 19:15
dereckson accepted D2902: Handle .geoipupdate lock file.
Mar 16 2023, 19:15
dereckson requested review of D2902: Handle .geoipupdate lock file.
Mar 16 2023, 19:14
dereckson closed D2901: Build a Sentry + hvac Docker image.
Mar 16 2023, 19:07
dereckson committed rDSENTRYae68f9289508: Build a Sentry + hvac Docker image (authored by dereckson).
Build a Sentry + hvac Docker image
Mar 16 2023, 19:07
dereckson accepted D2901: Build a Sentry + hvac Docker image.
Mar 16 2023, 19:06
dereckson added a revision to T1791: Refresh Sentry installation: D2901: Build a Sentry + hvac Docker image.
Mar 16 2023, 19:06 · Monitoring and reporting
dereckson retitled D2901: Build a Sentry + hvac Docker image from Build a Sentry + Vault Docker image to Build a Sentry + hvac Docker image.
Mar 16 2023, 19:06
dereckson requested review of D2901: Build a Sentry + hvac Docker image.
Mar 16 2023, 19:05
dereckson closed D2900: Deploy Relay for SDK development on Dwellers.
Mar 16 2023, 18:36
dereckson committed rOPS642bf17d707f: Deploy Relay for SDK development on Dwellers (authored by dereckson).
Deploy Relay for SDK development on Dwellers
Mar 16 2023, 18:36
dereckson accepted D2900: Deploy Relay for SDK development on Dwellers.
Mar 16 2023, 18:35
dereckson updated the summary of D2900: Deploy Relay for SDK development on Dwellers.
Mar 16 2023, 18:34
dereckson added a revision to T1790: Trace eggdrop errors: D2900: Deploy Relay for SDK development on Dwellers.
Mar 16 2023, 18:33 · IRC, Monitoring and reporting, Dæghrefn
dereckson requested review of D2900: Deploy Relay for SDK development on Dwellers.
Mar 16 2023, 18:33
dereckson closed D2899: Allow eggdrop to run Git commands on repositories.
Mar 16 2023, 18:23
dereckson committed rOPSbb6e7f795437: Allow eggdrop to run Git commands on repositories (authored by dereckson).
Allow eggdrop to run Git commands on repositories
Mar 16 2023, 18:23
dereckson added a comment to D2899: Allow eggdrop to run Git commands on repositories.

Example command

Mar 16 2023, 18:23
dereckson accepted D2899: Allow eggdrop to run Git commands on repositories.
Mar 16 2023, 18:19
dereckson retitled D2899: Allow eggdrop to run Git commands on repositories from Allow eggdrop to run git commands on repositories to Allow eggdrop to run Git commands on repositories.
Mar 16 2023, 18:18
dereckson added a revision to T1790: Trace eggdrop errors: D2899: Allow eggdrop to run Git commands on repositories.
Mar 16 2023, 18:18 · IRC, Monitoring and reporting, Dæghrefn
dereckson requested review of D2899: Allow eggdrop to run Git commands on repositories.
Mar 16 2023, 18:18
dereckson closed D2898: Release version 1.1.0.
Mar 16 2023, 17:47
dereckson committed rTOMMY7f43c31156c2: Release version 1.1.0 (authored by dereckson).
Release version 1.1.0
Mar 16 2023, 17:47
dereckson accepted D2898: Release version 1.1.0.
Mar 16 2023, 17:46
dereckson requested review of D2898: Release version 1.1.0.
Mar 16 2023, 17:45
dereckson closed D2897: Upgrade to Ruby 3.2, Sinatra 3.0, Rack 2.2.
Mar 16 2023, 17:39
dereckson committed rTOMMY3807eeebbf7d: Upgrade to Ruby 3.2, Sinatra 3.0, Rack 2.2 (authored by dereckson).
Upgrade to Ruby 3.2, Sinatra 3.0, Rack 2.2
Mar 16 2023, 17:39