Non-IPMI nodes are not responding as expected

From GigaTux Wiki
Jump to navigation Jump to search

Something's gone seriously wrong and you cannot access any UK nodes via SSH or even the IPMI. If this is a Rapidswitch / Maidenhead server, follow the instructions below. Otherwise, use the support contact for the relevant Servers.

  1. Wait for a while (15 minutes), if other VPSs are working fine. Things might return to normal soon. If other VPSs are not working fine, progress to the next stage.
  2. Open up the Rapidswitch Control Panel and select the affected server:
  3. Select KVMoIP Request on the right of the panel:
  4. If you get an error saying Your account administrator has not granted you the right to request chargeable technical work, and your free sessions have been used for this month. Please contact someone at your company who has permission to request chargeable work., select Recovery Session on the right of the panel instead.
  5. Click Request KVM Session at the bottom of the panel:
  6. Within 30 minutes, you should receive an email with details of the KVM session web address, username and password. If they take longer than 10 minutes, feel free to ring them up, quoting the IS- number of the server. Tell them not to bother if the screen output is blank, and get them to just power cycle the server.
  7. Go to the KVM web page, use the in built VNC viewer (requires Java) and log in using the credentials provided.
  8. The console will probably have a lot of messages like:
    Apr 28 14:16:19 node00002 kernel: [2046094.610443] IN=eth5 OUT= PHYSIN=peth5 MAC=00:1e:8c:93:b8:13:00:1d:46:70:3a:80:08:00 SRC=94.76.216.218 DST=78.129.201.181 LEN=48 TOS=0x00 PREC=0x00 TTL=121 ID=7192 DF PROTO=TCP SPT=2603 DPT=8443 WINDOW=65535 RES=0x00 SYN URGP=0
    These can safely be ignored.
  9. Try and log in using your standard username and password. If you get no console prompt after a while trying, you will probably need to reset the machine. See Resetting a non-IPMI physical server for more information.
  10. Run su to get a root prompt, with appropriate password, and examine things such as the system load, processes and virtual servers (xm list).