Coventry: Difference between revisions
| (64 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
Data centre location is CV4 9HN - just off Torrington Avenue. | Data centre location is CV4 9HN - just off Torrington Avenue. | ||
We currently have a 1/4 rack, but will have another 1/4 rack soon. | |||
=Quarter Rack C8= | |||
==Specifications== | ==Specifications== | ||
| Line 11: | Line 15: | ||
* 24 Port Gigabit Switch | * 24 Port Gigabit Switch | ||
* 24/7 Access | * 24/7 Access | ||
==Rack layout== | ==Rack layout== | ||
[[File:C8.jpg|200px|thumb|right|Cabinet C8]] | |||
{| class="wikitable" | {| class="wikitable" | ||
| node00004 | | node00004 | ||
|- | |- | ||
| Line 31: | Line 26: | ||
| node00001 | | node00001 | ||
|- | |- | ||
| | | bittyback | ||
|- | |||
| 8 Port APC Remote Reboot PDU | |||
|- | |- | ||
| 24 Port Gigabit Switch - Cisco 2960 | | 24 Port Gigabit Switch - Cisco 2960 | ||
|- | |- | ||
| 2 x Mini ITX case - firewall and dedi44001 (IPMI .60 and .70) | |||
| 2 x Mini ITX case - firewall and dedi44001 | |||
|- | |- | ||
| 2 x Mini ITX case - dedi44002 and dedi44003 | | 2 x Mini ITX case - dedi44002 and dedi44003 (IPMI .80 and .90) | ||
|- | |- | ||
| 2 x Mini ITX case - dedi44004 and dedi44005 | | 2 x Mini ITX case - dedi44004 and dedi44005 (IPMI .100 and .110) | ||
|- | |- | ||
| | | 2 x Mini ITX case - dedi44006 and dedi44007 (IPMI .120 and .130) | ||
|} | |} | ||
==Switch== | ==Switch Layout== | ||
Colour is the network cable colour, each on their own vlan: | |||
If we really need a layer 3 switch, they can provide one for £20 per month or we can provide our own. They recommend a Cisco 3750G or Juniper EX4200. | If we really need a layer 3 switch, they can provide one for £20 per month or we can provide our own. They recommend a Cisco 3750G or Juniper EX4200. | ||
* 1083 - UKSERVERS - Routed to Internet (white) | |||
* 101 - FIREWALLED - BMCs and Bittyback (green and red and blue (small switch)) | |||
{| class="wikitable" | {| class="wikitable" | ||
|style="color: | |style="background-color: black; color: white"|Gi0/0 | ||
| | |style="background-color: black; color: white"|Gi0/2 | ||
| | |style="background-color: black; color: white"|Gi0/4 | ||
| | |style="background-color: black; color: white"|Gi0/6 | ||
|style="color: | |style="background-color: black; color: white"|Gi0/8 | ||
|style="color: | |style="background-color: black; color: white"|Gi0/10 | ||
|style="background-color: black; color: white"| | |||
|style="background-color: black; color: white"|Gi0/12 | |||
|style="background-color: black; color: white"|Gi0/14 | |||
|style="background-color: black; color: white"|Gi0/16 | |||
|style="background-color: black; color: white"|Gi0/18 | |||
|style="background-color: black; color: white"|Gi0/20 | |||
|style="background-color: black; color: white"|Gi0/22 | |||
|- | |||
|style="color: blue;"|firewall | |||
|node00001 | |||
|node00002 | |||
|node00004 | |||
|dedi44001 (source filtered) | |||
|dedi44002 (source filtered) | |||
|style="background-color: black"| | |style="background-color: black"| | ||
|style="color: red;"|bittyback | |style="color: red;"|bittyback | ||
|style="color: green;"|node00001 BMC | |style="color: green;"|node00001 BMC | ||
|style="color: green;"|node00002 BMC | |style="color: green;"|node00002 BMC | ||
|style="color: green;"|node00004 BMC | |style="color: green;"|node00004 BMC | ||
|style="color: green;"|bittyback BMC | |style="color: green;"|bittyback BMC | ||
|style="color: | |style="color: white; background-color: purple"|Uplink | ||
|- | |- | ||
|style="color: blue;"| | |style="color: blue;"|Switch in new rack | ||
| | |dedi44003 (source filtered) | ||
| | |dedi44004 (source filtered) | ||
| | |dedi44005 (source filtered) | ||
| | |dedi44006 (source filtered) | ||
| | |dedi44007 (source filtered) | ||
|style="background-color: black"| | |style="background-color: black"| | ||
|style="color: red;"|Firewall | |style="color: red;"|Firewall | ||
|style="color: green;"|dedi44001 BMC ( | |style="color: green;"|firewall BMC | ||
|style="color: green;"|dedi44002 BMC | |style="color: green;"|dedi44001 BMC | ||
|style="color: green;"|dedi44003 BMC | |style="color: blue;"|Small switch | ||
|style="color: green;"|dedi44004 BMC | |style="color: blue;"|Switch in new rack | ||
|style="color: green;"|dedi44005 BMC | |style="color: white; background-color: purple"|Uplink | ||
|- | |||
|style="background-color: black; color: white"|Gi0/1 | |||
|style="background-color: black; color: white"|Gi0/3 | |||
|style="background-color: black; color: white"|Gi0/5 | |||
|style="background-color: black; color: white"|Gi0/7 | |||
|style="background-color: black; color: white"|Gi0/9 | |||
|style="background-color: black; color: white"|Gi0/11 | |||
|style="background-color: black; color: white"| | |||
|style="background-color: black; color: white"|Gi0/13 | |||
|style="background-color: black; color: white"|Gi0/15 | |||
|style="background-color: black; color: white"|Gi0/17 | |||
|style="background-color: black; color: white"|Gi0/19 | |||
|style="background-color: black; color: white"|Gi0/21 | |||
|style="background-color: black; color: white"|Gi0/23 | |||
|} | |||
Small switch | |||
{| class="wikitable" | |||
|style="color: blue;"|Connection to switch | |||
|style="color: grey;"|(unc) | |||
|style="color: green;"|dedi44002 BMC | |||
|style="color: green;"|dedi44003 BMC | |||
|- | |||
|style="color: green;"|dedi44004 BMC | |||
|style="color: green;"|dedi44005 BMC | |||
|style="color: green;"|dedi44006 BMC | |||
|style="color: green;"|dedi44007 BMC | |||
|} | |} | ||
===Power=== | |||
The PDU has eight ports. These will be used as follows: | |||
* Switch | |||
* node00001, node00002 | |||
* node00004, bittyback | |||
* firewall and dedi1 | |||
* dedi2 and dedi3 | |||
* dedi4 and dedi5 | |||
* dedi6 and dedi7 | |||
* dedi8 and dedi9 | |||
===KVM=== | |||
* C8-kvm1: Not sure. Some Centos 6 server. | |||
* C8-kvm2: Not sure. No signal (may have been dedi5) | |||
* C8-kvm3: node00002 (PS2) | |||
* C8-kvm4: node00004 (USB) | |||
* C8-kvm5: Unconnected | |||
* C8-kvm6: firewall (USB) | |||
* C8-kvm7: node00001 (PS2) | |||
* C8-kvm8: Not present | |||
The web client for the KVM might not always work. If not there is a client based version. | |||
# Download and run the software From: http://ukservers.com/downloads/win7kvm.zip - thankfully this does appear to work at least under Wine 5. | |||
# Click Add a New Remote Console Switch | |||
# Select the KVM Type provided | |||
# Select the device has an IP address and enter the KVM IP provided (Dell 2161DS-2 in this case) | |||
# The IP address auto-connectivity can time out. Adding this manually afterwards often lets things work. | |||
# Once completed click the servers tab where you should see a list of available interfaces. Select KVM ID provided that relates to your server/rack and enter the KVM User and KVM Password provided. The list above should match up the servers with the right port numbers for the KVM. Switching between servers requires UKServers to change over the connection. | |||
# Click okay and you should then be able to view your server. | |||
===Startup output=== | ===Startup output=== | ||
| Line 171: | Line 241: | ||
The firewall doesn't have a BMC because we don't want it to be Internet facing, and we probably only need the BMC if the firewall is down (and hence can't be used). We will rely on the KVMoIP for this and a permanently attached USB stick. | The firewall doesn't have a BMC because we don't want it to be Internet facing, and we probably only need the BMC if the firewall is down (and hence can't be used). We will rely on the KVMoIP for this and a permanently attached USB stick. | ||
= | =Quarter Rack - C20= | ||
==Specifications== | |||
* Up to 11U Lockable Rackspace | |||
* 3A of Power | |||
* 1U 8 Port APC Remote Reboot PDU | |||
* Up to 4 x KVM over IP Connections | |||
* 2 x 1000Mbit Network Ports | |||
* Extra 5TB Monthly Bandwidth (pooled) | |||
* 48 Port Gigabit Switch (Juniper, provided by us) | |||
* 24/7 Access | |||
==Rack layout== | |||
= | [[File:C20.jpg|200px|thumb|right|Cabinet C20]] | ||
{| class="wikitable" | |||
| Empty | |||
|- | |||
| Empty | |||
|- | |||
| Empty | |||
|- | |||
| Empty | |||
|- | |||
| Empty | |||
|- | |||
| Empty | |||
|- | |||
| 2 x Mini ITX case - dedi44014 and dedi44015 (IPMI .184 and .185) | |||
|- | |||
| 2 x Mini ITX case - dedi44012 and dedi44013 (IPMI .182 and .183) | |||
|- | |||
| 2 x Mini ITX case - dedi44010 and dedi44011 (IPMI .180 and .181) | |||
|- | |||
| 2 x Mini ITX case - dedi44008 and dedi44009 (IPMI .160 and .170) | |||
|- | |||
| 48 Port Gigabit Switch - Juniper EX4200 and 8 Port APC Remote Reboot PDU | |||
|} | |||
==Switch Layout== | |||
* Unknown VLAN - UKSERVERS - Routed to Internet (white) | |||
* internal VLAN - FIREWALLED - BMCs (green) | |||
{| class="wikitable" | |||
|style="background-color: black; color: white"|0 | |||
|style="background-color: black; color: white"|2 | |||
|style="background-color: black; color: white"|4 | |||
|style="background-color: black; color: white"|6 | |||
|style="background-color: black; color: white"|8 | |||
|style="background-color: black; color: white"|10 | |||
|style="background-color: black; color: white"| | |||
|style="background-color: black; color: white"|12 | |||
|style="background-color: black; color: white"|14 | |||
== | |style="background-color: black; color: white"|16 | ||
|style="background-color: black; color: white"|18 | |||
|style="background-color: black; color: white"|20 | |||
|style="background-color: black; color: white"|22 | |||
|- | |||
|style="color: grey;"|(unc) | |||
|dedi44008 | |||
|dedi44010 | |||
|dedi44012 | |||
|dedi44014 | |||
|style="color: grey;"|(unc) | |||
|style="background-color: black"| | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|- | |||
|style="color: blue;"|Other rack<br />(public) | |||
|dedi44009 | |||
|dedi44011 | |||
|dedi44013 | |||
|dedi44015 | |||
|style="color: grey;"|(unc) | |||
|style="background-color: black"| | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|style="color: grey;"|(unc) | |||
|- | |||
|style="background-color: black; color: white"|1 | |||
|style="background-color: black; color: white"|3 | |||
|style="background-color: black; color: white"|5 | |||
|style="background-color: black; color: white"|7 | |||
|style="background-color: black; color: white"|9 | |||
|style="background-color: black; color: white"|11 | |||
|style="background-color: black; color: white"| | |||
|style="background-color: black; color: white"|13 | |||
|style="background-color: black; color: white"|15 | |||
|style="background-color: black; color: white"|17 | |||
|style="background-color: black; color: white"|19 | |||
|style="background-color: black; color: white"|21 | |||
|style="background-color: black; color: white"|23 | |||
|} | |||
{| class="wikitable" | {| class="wikitable" | ||
| | |style="background-color: black; color: white"|24 | ||
|style="background-color: black; color: white"|26 | |||
|style="background-color: black; color: white"|28 | |||
|style="background-color: black; color: white"|30 | |||
|style="background-color: black; color: white"|32 | |||
|style="background-color: black; color: white"|34 | |||
|style="background-color: black; color: white"| | |||
|style="background-color: black; color: white"|36 | |||
|style="background-color: black; color: white"|38 | |||
|style="background-color: black; color: white"|40 | |||
|style="background-color: black; color: white"|42 | |||
|style="background-color: black; color: white"|44 | |||
|style="background-color: black; color: white"|46 | |||
|- | |||
|style="color: blue;"|Other rack<br />(firewalled) | |||
|style="color: green;"|dedi44008<br />BMC | |||
|style="color: green;"|dedi44010<br />BMC | |||
|style="color: green;"|dedi44012<br />BMC | |||
|style="color: green;"|dedi44014<br />BMC | |||
|style="color: grey;"|(unc int) | |||
|style="background-color: black"| | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|- | |||
|style="color: grey;"|(unc int) | |||
|style="color: green;"|dedi44009<br />BMC | |||
|style="color: green;"|dedi44011<br />BMC | |||
|style="color: green;"|dedi44013<br />BMC | |||
|style="color: green;"|dedi44015<br />BMC | |||
|style="color: grey;"|(unc int) | |||
|style="background-color: black"| | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|style="color: grey;"|(unc int) | |||
|- | |||
|style="background-color: black; color: white"|25 | |||
|style="background-color: black; color: white"|27 | |||
|style="background-color: black; color: white"|29 | |||
|style="background-color: black; color: white"|31 | |||
|style="background-color: black; color: white"|33 | |||
|style="background-color: black; color: white"|35 | |||
|style="background-color: black; color: white"| | |||
|style="background-color: black; color: white"|37 | |||
|style="background-color: black; color: white"|39 | |||
|style="background-color: black; color: white"|41 | |||
|style="background-color: black; color: white"|43 | |||
|style="background-color: black; color: white"|45 | |||
|style="background-color: black; color: white"|47 | |||
| | |||
|} | |} | ||
== | ===Power=== | ||
The PDU has eight ports. These will be used as follows: | |||
* | * dedi44008, dedi44009 | ||
* | * dedi44010, dedi44011 | ||
* | * dedi44012, dedi44013 | ||
* | * dedi44014, dedi44015 | ||
* | * | ||
* | * | ||
* | * | ||
* | * Switch | ||
Latest revision as of 10:40, 12 December 2020
Data centre location is CV4 9HN - just off Torrington Avenue.
We currently have a 1/4 rack, but will have another 1/4 rack soon.
Quarter Rack C8
Specifications
- Up to 11U Lockable Rackspace
- 3A of Power
- 1U 8 Port APC Remote Reboot PDU
- Up to 4 x KVM over IP Connections
- 2 x 1000Mbit Network Ports
- 20TB Monthly Bandwidth
- 24 Port Gigabit Switch
- 24/7 Access
Rack layout
| node00004 |
| node00002 |
| node00001 |
| bittyback |
| 8 Port APC Remote Reboot PDU |
| 24 Port Gigabit Switch - Cisco 2960 |
| 2 x Mini ITX case - firewall and dedi44001 (IPMI .60 and .70) |
| 2 x Mini ITX case - dedi44002 and dedi44003 (IPMI .80 and .90) |
| 2 x Mini ITX case - dedi44004 and dedi44005 (IPMI .100 and .110) |
| 2 x Mini ITX case - dedi44006 and dedi44007 (IPMI .120 and .130) |
Switch Layout
Colour is the network cable colour, each on their own vlan:
If we really need a layer 3 switch, they can provide one for £20 per month or we can provide our own. They recommend a Cisco 3750G or Juniper EX4200.
- 1083 - UKSERVERS - Routed to Internet (white)
- 101 - FIREWALLED - BMCs and Bittyback (green and red and blue (small switch))
| Gi0/0 | Gi0/2 | Gi0/4 | Gi0/6 | Gi0/8 | Gi0/10 | Gi0/12 | Gi0/14 | Gi0/16 | Gi0/18 | Gi0/20 | Gi0/22 | |
| firewall | node00001 | node00002 | node00004 | dedi44001 (source filtered) | dedi44002 (source filtered) | bittyback | node00001 BMC | node00002 BMC | node00004 BMC | bittyback BMC | Uplink | |
| Switch in new rack | dedi44003 (source filtered) | dedi44004 (source filtered) | dedi44005 (source filtered) | dedi44006 (source filtered) | dedi44007 (source filtered) | Firewall | firewall BMC | dedi44001 BMC | Small switch | Switch in new rack | Uplink | |
| Gi0/1 | Gi0/3 | Gi0/5 | Gi0/7 | Gi0/9 | Gi0/11 | Gi0/13 | Gi0/15 | Gi0/17 | Gi0/19 | Gi0/21 | Gi0/23 |
Small switch
| Connection to switch | (unc) | dedi44002 BMC | dedi44003 BMC |
| dedi44004 BMC | dedi44005 BMC | dedi44006 BMC | dedi44007 BMC |
Power
The PDU has eight ports. These will be used as follows:
- Switch
- node00001, node00002
- node00004, bittyback
- firewall and dedi1
- dedi2 and dedi3
- dedi4 and dedi5
- dedi6 and dedi7
- dedi8 and dedi9
KVM
- C8-kvm1: Not sure. Some Centos 6 server.
- C8-kvm2: Not sure. No signal (may have been dedi5)
- C8-kvm3: node00002 (PS2)
- C8-kvm4: node00004 (USB)
- C8-kvm5: Unconnected
- C8-kvm6: firewall (USB)
- C8-kvm7: node00001 (PS2)
- C8-kvm8: Not present
The web client for the KVM might not always work. If not there is a client based version.
- Download and run the software From: http://ukservers.com/downloads/win7kvm.zip - thankfully this does appear to work at least under Wine 5.
- Click Add a New Remote Console Switch
- Select the KVM Type provided
- Select the device has an IP address and enter the KVM IP provided (Dell 2161DS-2 in this case)
- The IP address auto-connectivity can time out. Adding this manually afterwards often lets things work.
- Once completed click the servers tab where you should see a list of available interfaces. Select KVM ID provided that relates to your server/rack and enter the KVM User and KVM Password provided. The list above should match up the servers with the right port numbers for the KVM. Switching between servers requires UKServers to change over the connection.
- Click okay and you should then be able to view your server.
Startup output
Cisco IOS Software, C2960 Software (C2960-LANBASE-M), Version 12.2(35)SE5, RELEASE SOFTWARE (fc1) Copyright (c) 1986-2007 by Cisco Systems, Inc. Compiled Thu 19-Jul-07 20:06 by nachen Image text-base: 0x00003000, data-base: 0x00D40000 ROM: Bootstrap program is C2960 boot loader BOOTLDR: C2960 Boot Loader (C2960-HBOOT-M) Version 12.2(25r)SEE6, RELEASE SOFTWARE (fc1) sw0.rack40 uptime is 22 weeks, 22 hours, 32 minutes System returned to ROM by power-on System image file is "flash:c2960-lanbase-mz.122-35.SE5/c2960-lanbase-mz.122-35.SE5.bin" cisco WS-C2960G-24TC-L (PowerPC405) processor (revision E0) with 61440K/4088K bytes of memory. Processor board ID FOC1252U1RS Last reset from power-on 2 Virtual Ethernet interfaces 48 Gigabit Ethernet interfaces The password-recovery mechanism is enabled.
VLAN configuration
Cisco document is at [1]
Create VLANs
- configure terminal
- vlan 100
- end
- show vlan
- vlan 101
- end
- show vlan
- copy running-config startup config
Assign VLANs
- configure terminal
- interface interface-id
- switchport mode access 100 or 101
- end
- show running-config interface interface-id
- show interfaces interface-id switchport
- copy running-config startup config
- show interfaces vlan 100 or 101
- show vlan 100 or 101
Disallow VLAN 101 direct access to the trunk
- configure terminal
- interface interface-id
- switchport trunk allowed vlan remove 101
- end
- show interfaces interface-id switchport
Source IP Guard
A simple overview is at [2] and a video at [3]
- interface interface-id
- ip verify source
- show ip dhcp snoop bind
DHCP snooping must be enabled globally, and again for each VLAN on which IP source guard will be run.
- ip dhcp snooping
- ip dhcp snooping vlan 100
Get MAC addresses
- show mac address-table int interface-id
Configure the IP address on the port
- conf t
- ip device tracking maximum 10 <-- try without this first
- ip source binding MAC vlan 100 IP address interface interface-id
- show ip verify source
Firewall
The firewall doesn't have a BMC because we don't want it to be Internet facing, and we probably only need the BMC if the firewall is down (and hence can't be used). We will rely on the KVMoIP for this and a permanently attached USB stick.
Quarter Rack - C20
Specifications
- Up to 11U Lockable Rackspace
- 3A of Power
- 1U 8 Port APC Remote Reboot PDU
- Up to 4 x KVM over IP Connections
- 2 x 1000Mbit Network Ports
- Extra 5TB Monthly Bandwidth (pooled)
- 48 Port Gigabit Switch (Juniper, provided by us)
- 24/7 Access
Rack layout

| Empty |
| Empty |
| Empty |
| Empty |
| Empty |
| Empty |
| 2 x Mini ITX case - dedi44014 and dedi44015 (IPMI .184 and .185) |
| 2 x Mini ITX case - dedi44012 and dedi44013 (IPMI .182 and .183) |
| 2 x Mini ITX case - dedi44010 and dedi44011 (IPMI .180 and .181) |
| 2 x Mini ITX case - dedi44008 and dedi44009 (IPMI .160 and .170) |
| 48 Port Gigabit Switch - Juniper EX4200 and 8 Port APC Remote Reboot PDU |
Switch Layout
- Unknown VLAN - UKSERVERS - Routed to Internet (white)
- internal VLAN - FIREWALLED - BMCs (green)
| 0 | 2 | 4 | 6 | 8 | 10 | 12 | 14 | 16 | 18 | 20 | 22 | |
| (unc) | dedi44008 | dedi44010 | dedi44012 | dedi44014 | (unc) | (unc) | (unc) | (unc) | (unc) | (unc) | (unc) | |
| Other rack (public) |
dedi44009 | dedi44011 | dedi44013 | dedi44015 | (unc) | (unc) | (unc) | (unc) | (unc) | (unc) | (unc) | |
| 1 | 3 | 5 | 7 | 9 | 11 | 13 | 15 | 17 | 19 | 21 | 23 |
| 24 | 26 | 28 | 30 | 32 | 34 | 36 | 38 | 40 | 42 | 44 | 46 | |
| Other rack (firewalled) |
dedi44008 BMC |
dedi44010 BMC |
dedi44012 BMC |
dedi44014 BMC |
(unc int) | (unc int) | (unc int) | (unc int) | (unc int) | (unc int) | (unc int) | |
| (unc int) | dedi44009 BMC |
dedi44011 BMC |
dedi44013 BMC |
dedi44015 BMC |
(unc int) | (unc int) | (unc int) | (unc int) | (unc int) | (unc int) | (unc int) | |
| 25 | 27 | 29 | 31 | 33 | 35 | 37 | 39 | 41 | 43 | 45 | 47 |
Power
The PDU has eight ports. These will be used as follows:
- dedi44008, dedi44009
- dedi44010, dedi44011
- dedi44012, dedi44013
- dedi44014, dedi44015
- Switch