Page MenuHomeDevCentral

Stormshear EXSi hypervisor agents aren't responsive
Closed, ResolvedPublic

Description

On StormShear:

$ esxcli vm process list
Connect to localhost failed: Connection failure

We need to restart the EXSi hypervisor agents.

Event Timeline

Restart the management agents on the hypervisor isn't helpful:

~ # /etc/init.d/hostd restart
watchdog-hostd: Terminating watchdog process with PID 94900058
hostd stopped.
Ramdisk 'hostd' with estimated size of 129MB already exists
hostd started.
~ # /etc/init.d/vpxa restart
watchdog-vpxa: Terminating watchdog process with PID 94900730
vpxa stopped.

Hypervisor works again

$ services.sh restart
Running xorg stop
Running sfcbd stop
This operation is not supported.
Please use /etc/init.d/sfcbd-watchdog stop
Running snmpd stop
root: snmpd is not running.
Running wsman stop
Stopping openwsmand
Running sfcbd-watchdog stop
Connect to localhost failed: Connection failure
Connect to localhost failed: Connection failure
Running vpxa stop
watchdog-vpxa: Terminating watchdog process with PID 140231202
vpxa stopped.
Connect to localhost failed: Connection failure
Running vobd stop
watchdog-vobd: Terminating watchdog process with PID 94900663
vobd stopped
Running lacp stop
watchdog-net-lacp: Terminating watchdog process with PID 94900599
Running memscrubd stop
memscrubd is not running
Running dcbd stop
watchdog-dcbd: Terminating watchdog process with PID 94900439
Running cdp stop
watchdog-cdp: Terminating watchdog process with PID 94900401
Running smartd stop
watchdog-smartd: Terminating watchdog process with PID 94802056
smartd stopped
Running nscd stop
watchdog-nscd: Terminating watchdog process with PID 94900309
Running slpd stop
Stopping slpd
Running storageRM stop
watchdog-storageRM: Terminating watchdog process with PID 94900260
storageRM stopped
Running lbtd stop
watchdog-net-lbt: Terminating watchdog process with PID 94900161
net-lbt stopped
Running rhttpproxy stop
rhttpproxy is not running.
Running hostd stop
watchdog-hostd: Terminating watchdog process with PID 140231045
hostd stopped.
Running sensord stop
sensord is not running
Running sdrsInjector stop
watchdog-sdrsInjector: Terminating watchdog process with PID 94899953
sdrsInjector stopped
Running vmfstraced stop
watchdog-vmfstracegd: PID file /var/run/vmware/watchdog-vmfstracegd.PID does not exist
watchdog-vmfstracegd: Unable to terminate watchdog: No running watchdog process for vmfstracegd
vmfstracegd is not running
Failed to clear vmfstracegd memory reservation
Running usbarbitrator stop
watchdog-usbarbitrator: Terminating watchdog process with PID 94899904
usbarbitrator stopped
Running SSH stop
SSH login disabled
VobUserLib_Init failed with -1
Connect to localhost failed: Connection failure
Errors: 
Invalid operation requested: This ruleset is required and connot be disabled
Running DCUI stop
Disabling DCUI logins
VobUserLib_Init failed with -1
Running iomemory-vsl stop
Running vsantraced stop
watchdog-vsantraced: Terminating watchdog process with PID 94899750
vsantraced stopped
watchdog-vsantracedUrgen: Terminating watchdog process with PID 94867011
vsantracedUrgen stopped
Running vsantraced restart
Storing traces to /scratch/vsantraces
vsantraced started
vsantracedUrgen started
Running iomemory-vsl restart
Running DCUI restart
Enabling DCUI login: runlevel = 
VobUserLib_Init failed with -1
Running SSH restart
Connect to localhost failed: Connection failure
SSH login enabled
VobUserLib_Init failed with -1
Running usbarbitrator restart
usbarbitrator started
Running vmfstraced restart
VMFS Global Tracing is not enabled.
Running sdrsInjector restart
sdrsInjector started
Running sensord restart
sensord started
Running hostd restart
Ramdisk 'hostd' with estimated size of 129MB already exists
hostd started.
Running rhttpproxy restart
rhttpproxy started.
Running lbtd restart
net-lbt started
Running storageRM restart
storageRM started
Running slpd restart
Starting slpd
Running nscd restart
nscd started
Running smartd restart
smartd started
Running cdp restart
cdp started
Running dcbd restart
dcbd started
Running memscrubd restart
The checkPages boot option is FALSE, hence memscrubd could not be started.
Running lacp restart
LACP daemon started
Running vobd restart
vobd started
Running vpxa restart
Running sfcbd-watchdog restart
Running wsman restart
Starting openwsmand
Running snmpd restart
root: snmpd has not been enabled.
Running sfcbd restart
This operation is not supported.
Please use /etc/init.d/sfcbd-watchdog start
Running xorg restart
$ esxcli vm process list
[...]
Ysul
[...]