Page MenuHomeDevCentral
Feed Advanced Search

May 23 2017

dereckson renamed T1206: Can't upload pictures on Mastodon: permission error to create a directory from Can't upload pictures on Mastodon: to Can't upload pictures on Mastodon: permission error to mkdir.
May 23 2017, 18:38 · Nasqueron Docker deployment squad, Servers, Mastodon
dereckson added a comment to T1206: Can't upload pictures on Mastodon: permission error to create a directory.

I switched the SELinux configuration to Permissive, so we'll get logs, and we'll be apply to apply sand_virt_t SELinux policy to the directories to manage by the container.

May 23 2017, 18:38 · Nasqueron Docker deployment squad, Servers, Mastodon
dereckson added a comment to T1206: Can't upload pictures on Mastodon: permission error to create a directory.

Could be a SELinux issue, as the same time in the main logs:

May 23 2017, 18:36 · Nasqueron Docker deployment squad, Servers, Mastodon
dereckson created T1206: Can't upload pictures on Mastodon: permission error to create a directory.
May 23 2017, 18:36 · Nasqueron Docker deployment squad, Servers, Mastodon
dereckson lowered the priority of T1205: Upgrade Docker Engine to 1.13+ on Dwellers from Unbreak Now! to Normal.

[ Decreasing priority as it's done. ]

May 23 2017, 17:12 · Servers
dereckson renamed T1205: Upgrade Docker Engine to 1.13+ on Dwellers from Upgrade Docker Engine to 1.13+ to Upgrade Docker Engine to 1.13+ on Dwellers.
May 23 2017, 17:11 · Servers

May 9 2017

dereckson added a comment to T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).

A side issue: ntpd wasn't running, and a drift existed. That has been resolved at 12:28:49.

May 9 2017, 12:49 · User-Dereckson, Servers
dereckson closed T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue) as Resolved.

Server consolidation done.

May 9 2017, 12:40 · User-Dereckson, Servers
dereckson added a comment to T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).

To give a little idea about how this process is slow:

May 9 2017, 00:14 · User-Dereckson, Servers
dereckson moved T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue) from Backlog to Needs Review / Blocked / Waiting on the User-Dereckson board.
May 9 2017, 00:00 · User-Dereckson, Servers
dereckson added a project to T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue): User-Dereckson.
May 9 2017, 00:00 · User-Dereckson, Servers
dereckson moved T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue) from Backlog to Working on on the Servers board.
May 9 2017, 00:00 · User-Dereckson, Servers
dereckson added a comment to T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).

Snapshot consolidation started, that will take a long time. During this operation, I/O perfs will be degraded.

May 9 2017, 00:00 · User-Dereckson, Servers

May 8 2017

dereckson lowered the priority of T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue) from Unbreak Now! to High.

Hypervisor happy, server running again.

May 8 2017, 23:45 · User-Dereckson, Servers
dereckson closed T1202: Drop Docker-flat.vmdk from Dwellers as Resolved.
May 8 2017, 23:43 · Servers
dereckson closed T1202: Drop Docker-flat.vmdk from Dwellers, a subtask of T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue), as Resolved.
May 8 2017, 23:43 · User-Dereckson, Servers
dereckson added a comment to T1202: Drop Docker-flat.vmdk from Dwellers.
Stormshear
$ rm /vmfs/volumes/datastore1/Docker-flat.vmdk
$ df -h
VMFS-5     924.0G 724.0G    200.0G  78% /vmfs/volumes/datastore1
May 8 2017, 23:42 · Servers
dereckson added a comment to T1202: Drop Docker-flat.vmdk from Dwellers.

Tests successfully done on Docker we can delete the files from the hypervisor.

May 8 2017, 23:40 · Servers
dereckson added a comment to T1202: Drop Docker-flat.vmdk from Dwellers.

Remove the volume

May 8 2017, 23:37 · Servers
dereckson added a comment to T1202: Drop Docker-flat.vmdk from Dwellers.

Remove the volume group

May 8 2017, 23:34 · Servers
dereckson added a comment to T1202: Drop Docker-flat.vmdk from Dwellers.

Disable the volume group

May 8 2017, 23:32 · Servers
dereckson added a comment to T1202: Drop Docker-flat.vmdk from Dwellers.

Currently, the disk isn't even mounted on Dwellers, /etc/fstab line is commented out.

May 8 2017, 23:24 · Servers
dereckson created T1202: Drop Docker-flat.vmdk from Dwellers.
May 8 2017, 23:20 · Servers
dereckson added a comment to T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).

Ysul is in snapshot mode, that explains the growing.

May 8 2017, 23:17 · User-Dereckson, Servers
dereckson claimed T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).
May 8 2017, 23:12 · User-Dereckson, Servers
dereckson renamed T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue) from Server outage: ysul.nasqueron.org to Server outage: ysul.nasqueron.org (zfs disk free space issue).
May 8 2017, 23:12 · User-Dereckson, Servers
dereckson added a comment to T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).

I'll attach a VSphere client to the server to see what happens. ETA 22:30.

May 8 2017, 21:58 · User-Dereckson, Servers
dereckson updated the task description for T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).
May 8 2017, 21:57 · User-Dereckson, Servers
dereckson created T1201: Server outage: ysul.nasqueron.org (zfs disk free space issue).
May 8 2017, 21:56 · User-Dereckson, Servers

May 6 2017

dereckson claimed T1200: Can't currently build images with Docker compose on Dwellers.
May 6 2017, 18:37 · Servers

May 5 2017

dereckson closed T1199: Reinstall gcc on Ysul as Resolved.
Ysul
$ pkg install valgrind py27-numpy
New packages to be INSTALLED:
        valgrind: 3.10.1.20160113_4,1
        py27-numpy: 1.11.2_3,1                                                                                                                         
        suitesparse: 4.0.2_6                                                                                                                           
        openblas: 0.2.19_1,1                                                                                                                           
        gcc5: 5.4.0_2                                                                                                                                  
        lapack: 3.5.0_2                                                                                                                                
        blas: 3.5.0_3                                                                                                                                  
        cblas: 1.0_6  
May 5 2017, 18:58 · Servers
dereckson added a comment to T1199: Reinstall gcc on Ysul.

valgrind and py27-numpy are the only ones identified as currently in use.

May 5 2017, 18:55 · Servers
dereckson moved T1199: Reinstall gcc on Ysul from Backlog to Working on on the Servers board.
May 5 2017, 18:54 · Servers
dereckson created T1199: Reinstall gcc on Ysul.
May 5 2017, 18:53 · Servers

May 1 2017

dereckson closed T1183: Logs aren't currently received on Dwellers as Resolved.

Issue was the size kept was older logs.

May 1 2017, 12:08 · Mastodon, Servers
dereckson updated the task description for T1183: Logs aren't currently received on Dwellers.
May 1 2017, 12:08 · Mastodon, Servers
dereckson updated the task description for T1183: Logs aren't currently received on Dwellers.
May 1 2017, 12:07 · Mastodon, Servers
dereckson updated the task description for T1183: Logs aren't currently received on Dwellers.
May 1 2017, 12:07 · Mastodon, Servers

Apr 29 2017

dereckson closed T1194: Disable pam_nologin on Eglide as Resolved by committing rOPS7277030d10a6: Disable pam_nologin for SSH connections.
Apr 29 2017, 13:47 · Servers

Apr 28 2017

dereckson added a revision to T1196: Automate the mailserver lxc container through Salt: D978: Add Dwellers as lxc provider.
Apr 28 2017, 18:40 · Mail, Servers, Salt
dereckson added projects to T1196: Automate the mailserver lxc container through Salt: Salt, Servers, Mail.
Apr 28 2017, 18:38 · Mail, Servers, Salt
dereckson added a subtask for T1195: Install Salt on Dwellers: T1196: Automate the mailserver lxc container through Salt.
Apr 28 2017, 16:22 · Servers
dereckson claimed T1195: Install Salt on Dwellers.
Apr 28 2017, 16:21 · Servers
dereckson updated the task description for T1194: Disable pam_nologin on Eglide.
Apr 28 2017, 15:02 · Servers
dereckson moved T1194: Disable pam_nologin on Eglide from Backlog to Pending review on the Servers board.
Apr 28 2017, 14:47 · Servers
dereckson added a revision to T1194: Disable pam_nologin on Eglide: D975: Disable pam_nologin for SSH connections.
Apr 28 2017, 09:42 · Servers
dereckson claimed T1194: Disable pam_nologin on Eglide.
Apr 28 2017, 07:30 · Servers

Apr 27 2017

dereckson closed T940: Add server (when all the remaining is done) to shells.red-pill.eu, a subtask of T938: [Roadmap] Allow public subscriptions for Eglide, as Resolved.
Apr 27 2017, 17:48 · Eglide, IRC, Servers
dereckson added revisions to T819: Web hosting on Eglide: D965: Provide a Let's encrypt unit, D966: Generate Let's encrypt certificates, D967: Enable TLS on Eglide sites.
Apr 27 2017, 17:43 · Eglide, Salt, IRC, Servers
dereckson closed T1191: Ensure MariaDB install correctly on Debian as Resolved.

I removed the package on Eglide, then run twice salt eglide state.apply roles/shellserver/database/mysql.

Apr 27 2017, 12:56 · Eglide, Salt, Servers
dereckson renamed T1191: Ensure MariaDB install correctly on Debian from Switch MariaDB packaged to mariadb-server for Debian to Ensure MariaDB install correctly on Debian.
Apr 27 2017, 12:52 · Eglide, Salt, Servers
dereckson triaged T1190: Fix eglide machine id and restart systemd journal as Normal priority.
Apr 27 2017, 12:18 · Servers
dereckson closed T1190: Fix eglide machine id and restart systemd journal as Resolved.
Apr 27 2017, 12:18 · Servers
dereckson claimed T1190: Fix eglide machine id and restart systemd journal.
Apr 27 2017, 12:18 · Servers

Apr 20 2017

dereckson closed T1185: Restart nginx when configuration sls are amended on Eglide as Resolved by committing rOPS674d4e016732: Reload nginx after any configuration file is updated.
Apr 20 2017, 10:02 · Servers
dereckson added a revision to T1185: Restart nginx when configuration sls are amended on Eglide: D955: Reload nginx after any configuration file is updated.
Apr 20 2017, 08:15 · Servers
dereckson claimed T1185: Restart nginx when configuration sls are amended on Eglide.
Apr 20 2017, 07:56 · Servers

Apr 19 2017

dereckson added projects to T1184: Create a staging repository to make clear what is available for Salt deployment: Salt, Servers.
Apr 19 2017, 22:02 · Servers, Salt

Apr 18 2017

dereckson claimed T1183: Logs aren't currently received on Dwellers.
Apr 18 2017, 11:53 · Mastodon, Servers

Apr 16 2017

dereckson closed T1181: Arcanist complains Curl extension is missing on Eglide as Resolved by committing rOPS34c4094be604: Install curl PHP extension on Eglide.
Apr 16 2017, 21:28 · Servers

Apr 15 2017

dereckson added a revision to T1181: Arcanist complains Curl extension is missing on Eglide: D951: Install curl PHP extension on Eglide.
Apr 15 2017, 17:28 · Servers
dereckson claimed T1181: Arcanist complains Curl extension is missing on Eglide.
Apr 15 2017, 17:27 · Servers

Apr 13 2017

dereckson lowered the priority of T1180: Low space disk on Dwellers from Unbreak Now! to High.
Dwellers
$ journalctl --vacuum-size=500M
Vacuuming done, freed 3.5G of archived journals on disk.
Apr 13 2017, 21:48 · Operations sprints (The Dreadnought will produce new officers), Servers
dereckson updated the task description for T1180: Low space disk on Dwellers.
Apr 13 2017, 21:45 · Operations sprints (The Dreadnought will produce new officers), Servers
dereckson created T1180: Low space disk on Dwellers.
Apr 13 2017, 21:45 · Operations sprints (The Dreadnought will produce new officers), Servers

Apr 9 2017

dereckson closed T1171: Enable HTTP/2 on Dwellers as Resolved.

Done using https://brouken.com/brouken-centos-7-repo/

Apr 9 2017, 15:02 · Servers
dereckson closed T1174: Deploy a Mastodon instance for Nasqueron as Resolved.
Apr 9 2017, 12:53 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson closed T1173: Reconfigure TLS on Dwellers as Resolved.

Done using Firefox recommended cyphers for modern browsers

Apr 9 2017, 12:39 · Servers
dereckson closed T1173: Reconfigure TLS on Dwellers, a subtask of T1174: Deploy a Mastodon instance for Nasqueron, as Resolved.
Apr 9 2017, 12:39 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson closed T1178: On Ysul, Notifications CLI client complain about pika deps missing as Resolved.
Apr 9 2017, 12:37 · Servers
dereckson added a comment to T1178: On Ysul, Notifications CLI client complain about pika deps missing.

Apr 9 02:01:25 ysul pkg-static: py35-pika-0.10.0 installed

Apr 9 2017, 02:03 · Servers
dereckson closed T1176: 502 page for social.nasqueron.org as Resolved by committing rDII6bfd2caba88d: Add 502 page for social.nasqueron.org.
Apr 9 2017, 01:48 · good-first-issue, Servers
dereckson closed T1176: 502 page for social.nasqueron.org, a subtask of T1174: Deploy a Mastodon instance for Nasqueron, as Resolved.
Apr 9 2017, 01:48 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson closed T1176: 502 page for social.nasqueron.org, a subtask of T114: 502 pages for services on the Docker PaaS, as Resolved.
Apr 9 2017, 01:48 · Operations sprints (Operations sprint 1), design, good-first-issue, Servers, Forum, DevCentral
dereckson added a revision to T1176: 502 page for social.nasqueron.org: D946: Add 502 page for social.nasqueron.org.
Apr 9 2017, 01:45 · good-first-issue, Servers

Apr 7 2017

dereckson claimed T1178: On Ysul, Notifications CLI client complain about pika deps missing.
Apr 7 2017, 14:27 · Servers

Apr 3 2017

dereckson added a subtask for T1174: Deploy a Mastodon instance for Nasqueron: T1173: Reconfigure TLS on Dwellers.
Apr 3 2017, 21:23 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson added a parent task for T1173: Reconfigure TLS on Dwellers: T1174: Deploy a Mastodon instance for Nasqueron.
Apr 3 2017, 21:23 · Servers
dereckson added a subtask for T114: 502 pages for services on the Docker PaaS: T1176: 502 page for social.nasqueron.org.
Apr 3 2017, 21:23 · Operations sprints (Operations sprint 1), design, good-first-issue, Servers, Forum, DevCentral
dereckson added a parent task for T1176: 502 page for social.nasqueron.org: T114: 502 pages for services on the Docker PaaS.
Apr 3 2017, 21:23 · good-first-issue, Servers
dereckson moved T1176: 502 page for social.nasqueron.org from Backlog to Design on the good-first-issue board.
Apr 3 2017, 21:22 · good-first-issue, Servers
dereckson created T1176: 502 page for social.nasqueron.org.
Apr 3 2017, 21:22 · good-first-issue, Servers
dereckson closed T1175: Mailgun configuration for Mastodon as Resolved.
social.nasqueron.org.	86400	IN	A	212.129.32.223
social.nasqueron.org.	86400	IN	AAAA	2001:470:1f13:ce7:ca5:cade:fab:1e
Apr 3 2017, 20:55 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson closed T1175: Mailgun configuration for Mastodon, a subtask of T1174: Deploy a Mastodon instance for Nasqueron, as Resolved.
Apr 3 2017, 20:55 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson created T1175: Mailgun configuration for Mastodon.
Apr 3 2017, 20:48 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson created T1174: Deploy a Mastodon instance for Nasqueron.
Apr 3 2017, 20:47 · Nasqueron Docker deployment squad, Mastodon, Servers
dereckson created T1173: Reconfigure TLS on Dwellers.
Apr 3 2017, 20:27 · Servers

Apr 2 2017

dereckson triaged T1171: Enable HTTP/2 on Dwellers as Low priority.

On RHEL 7, OpenSSL is at 1.0.1. This is an issue as it lacks ALPN, shipped with 1.0.2, and as such, HTTP/2 won't work on Chrome, who removed support for NPN.

Apr 2 2017, 16:39 · Servers
dereckson closed T1170: Enable HTTP/2 on Ysul as Resolved.
diff --git a/nginx/ssl_params b/nginx/ssl_params
index adfa855..55e7d9d 100644
--- a/nginx/ssl_params
+++ b/nginx/ssl_params
@@ -1,6 +1,6 @@
         #Enable https
-        listen              443 ssl;
-        listen              [2001:470:1f13:9e1:0:c0ff:ee:1]:443 ssl;
+        listen              443 ssl http2;
+        listen              [2001:470:1f13:9e1:0:c0ff:ee:1]:443 ssl http2;
         keepalive_timeout   70;
Apr 2 2017, 16:36 · Servers
dereckson claimed T1170: Enable HTTP/2 on Ysul.
Apr 2 2017, 16:34 · Servers
dereckson claimed T1171: Enable HTTP/2 on Dwellers.
Apr 2 2017, 16:34 · Servers

Apr 1 2017

dereckson added a comment to T1169: Postfix on ysul.nasqueron.org doesn't listen on IPv6.

Configuration change

Apr 1 2017, 09:07 · Operations sprints (Ignite Alkane Propulsion), Servers, IPv6
dereckson renamed T1169: Postfix on ysul.nasqueron.org doesn't listen on IPv6 from Inet server (and so postfix) on ysul.nasqueron.org doesn't listen on IPv6 to Postfix on ysul.nasqueron.org doesn't listen on IPv6.
Apr 1 2017, 08:59 · Operations sprints (Ignite Alkane Propulsion), Servers, IPv6
dereckson renamed T1169: Postfix on ysul.nasqueron.org doesn't listen on IPv6 from Mail server on ysul.nasqueron.org doesn't listen on IPv6 to Inet server (and so postfix) on ysul.nasqueron.org doesn't listen on IPv6.
Apr 1 2017, 08:58 · Operations sprints (Ignite Alkane Propulsion), Servers, IPv6
dereckson added a comment to T1169: Postfix on ysul.nasqueron.org doesn't listen on IPv6.
Apr 1 2017, 08:58 · Operations sprints (Ignite Alkane Propulsion), Servers, IPv6
dereckson created T1169: Postfix on ysul.nasqueron.org doesn't listen on IPv6.
Apr 1 2017, 08:52 · Operations sprints (Ignite Alkane Propulsion), Servers, IPv6

Mar 31 2017

Sandlayth added a project to T1162: 2017-03-01 eglide.org server outage: User-Sandlayth.
Mar 31 2017, 19:07 · User-Sandlayth, Eglide, Servers

Mar 14 2017

dereckson created T1168: Migrate HotGlue from Apache to nginx.
Mar 14 2017, 15:12 · Zed, Servers

Mar 12 2017

dereckson created T1167: Restart nginx on Ysul when renew certificates.
Mar 12 2017, 19:05 · TLS certificates, Wolfplex migration, Servers, User-Dereckson

Mar 6 2017

dereckson added a revision to T1163: Odderon doesn't start at server boot: D934: Enable odderon service.
Mar 6 2017, 12:56 · Eglide, Servers