Page MenuHomePhabricator

Instance console does not gives output / keystroke access
Closed, DuplicatePublic

Description

On the beta cluster, we have to play with lvm and mount some volume at /srv/vdb . We end up with instances being stalled after reboot with:

The disk drive for /srv/vdb is not ready yet or not present.
Continue to wait, or Press S to skip mounting or M for manual recovery

The affected instances are:

https://wikitech.wikimedia.org/wiki/Nova_Resource:I-00000080.eqiad.wmflabs
https://wikitech.wikimedia.org/wiki/Nova_Resource:I-00000103.eqiad.wmflabs

Looking at the OpenStack documentation at https://wikitech.wikimedia.org/wiki/OpenStack#Get_an_interactive_console_to_an_instance_from_a_host :

virsh console --devname serial1 <instance id>

Daniel Zahn attempted to get a console access to the instances from their compute nodes but when entering a key ends up with:

error: internal error: character device (null) is not using a PTY

The instance can not be rebooted from the wikitech manager either.


Version: unspecified
Severity: normal

Details

Reference
bz62847

Related Objects

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:03 AM
bzimport added a project: Cloud-VPS.
bzimport set Reference to bz62847.
bzimport added a subscriber: Unknown Object (MLST).

The locked instances got unlocked by shut downing them then mounting the root partition following the instructions at https://wikitech.wikimedia.org/wiki/OpenStack#Mounting_an_instance.27s_disk . Then the faulty entry in /etc/fstab got wiped out letting the instance boot properly.

We still have a console issue though :(

chasemp subscribed.
scfc claimed this task.
scfc subscribed.

Both instances have been deleted in the mean time, so resolving this task.

scfc removed scfc as the assignee of this task.Feb 1 2016, 4:17 AM
scfc set Security to None.

Reopening, AFAIK we still can not access instances console.

Do you mean by "we" you as in project administrators or "we" as in Labs ops? AFAIK Labs ops has console access to instances via OpenStack. Do you want project administrators/project members to have console access as well?

hashar lowered the priority of this task from Medium to Low.Feb 12 2016, 1:03 PM

"we" Labs ops. If an instance is locked on boot, the console access does not let you connect or does not accept key strokes.

This task is two years old, maybe the newer OpenStack version we are running on labs is no more affected. Can't verify though.