Maniphest T1624

Install an Elastic stack for nasqueron-infra forest
Open, HighPublic
Actions

Assigned To

Authored By

	dereckson
	Sep 22 2020, 02:05

Tags

Referenced Files

None

Subscribers

Description

This Elastic stack will be used for to store the following content relevant to our infrastructure:

servers logs
containers logs
application logs
application metrics (but probably more in scope of Prometheus, see T1623)
notifications (so we can keep a copy of what happens in CI/CD)

This Elastic stack will be NOT used for the following tasks:

application search indexes (MediaWiki SaaS, Phabricator instances)
application content

Separate application-specific Elastic stacks can be installed in addition of the infrastructure one, but that's not in the scope of this task.

Best candidate is to use Open Distro for Elasticsearch.

Can be installed on Kubernetes once CloudHugger is ready (see T1622).

Revisions and Commits

rOPS Nasqueron Operations
	Needs Review		D2455 Collect logs from Docker
		D2459	rOPSef7e38a04cc8 Set OpenSearch heap size
		D2457	rOPS56cdf1d8db9b Fix user and permissions for certificates folder
		D2456	rOPS7d37a670d1f5 Protect OpenSearch users' passwords
		D2452	rOPS8e556670aebd Set compatibility mode to use beats
		D2450	rOPS4a61120c7c4d Install Dashboards
		D2451	rOPS9ddaacb64635 Tweak OpenSearch installation
		D2449	rOPS04e70ee4e1b3 Install OpenSearch

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T1621 Prepare a more flexible containers platform
		Open		dereckson	T1624 Install an Elastic stack for nasqueron-infra forest

Event Timeline

dereckson triaged this task as High priority.Sep 22 2020, 02:05

dereckson created this task.

dereckson added a parent task: T1621: Prepare a more flexible containers platform.

dereckson mentioned this in T1625: Deploy a service mesh.Sep 22 2020, 02:10

dereckson added projects: Servers, Operations sprints (Consolidate them all).Sep 22 2020, 02:21

dereckson added a project: Elastic for infra.

Detaching from containers dependency: we can clearly install Elastic on baremetal.

Reinstalling cloudhugger as Debian Bullseye (Debian 11).

dereckson claimed this task.Jan 2 2022, 20:47

dereckson moved this task from Backlog to Working on on the Operations sprints (Consolidate them all) board.

dereckson added a revision: D2449: Install OpenSearch.Jan 8 2022, 18:08

dereckson added a commit: rOPS04e70ee4e1b3: Install OpenSearch.Jan 8 2022, 18:19

dereckson added a revision: D2450: Install Dashboards.Jan 9 2022, 09:59

dereckson added a revision: D2451: Tweak OpenSearch installation.Jan 9 2022, 10:06

dereckson added a commit: rOPS9ddaacb64635: Tweak OpenSearch installation.Jan 9 2022, 10:13

dereckson added a commit: rOPS4a61120c7c4d: Install Dashboards.Jan 9 2022, 10:16

dereckson added a revision: D2452: Set compatibility mode to use beats.Jan 9 2022, 10:21

dereckson added a commit: rOPS8e556670aebd: Set compatibility mode to use beats.Jan 9 2022, 10:22

dereckson added a parent task: T1621: Prepare a more flexible containers platform.Jan 9 2022, 10:28

dereckson mentioned this in T1621: Prepare a more flexible containers platform.

dereckson added a revision: D2455: Collect logs from Docker.Jan 9 2022, 11:30

dereckson added a revision: D2456: Protect OpenSearch users' passwords.Jan 9 2022, 21:24

dereckson added a commit: rOPS7d37a670d1f5: Protect OpenSearch users' passwords.Jan 9 2022, 21:25

dereckson added a revision: D2457: Fix user and permissions for certificates folder.Jan 9 2022, 22:10

dereckson added a commit: rOPS56cdf1d8db9b: Fix user and permissions for certificates folder.Jan 9 2022, 22:13

dereckson added a revision: D2459: Set OpenSearch heap size.Jan 10 2022, 19:25

dereckson added a commit: rOPSef7e38a04cc8: Set OpenSearch heap size.Jan 10 2022, 19:26

dereckson moved this task from Working on to Not for this sprint on the Operations sprints (Consolidate them all) board.May 18 2023, 11:48