Coventry: Difference between revisions

From GigaTux Wiki
Jump to navigation Jump to search
← Older edit

Cocodude (talk | contribs)

2 user groups
978 edits
VisualWikitext
 
(92 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Data centre location is CV4 9HN - just off Torrington Avenue.
We currently have a 1/4 rack, but will have another 1/4 rack soon.
=Quarter Rack C8=
==Specifications==
==Specifications==


Line 12: Line 18:
==Rack layout==
==Rack layout==


* (empty)
[[File:C8.jpg|200px|thumb|right|Cabinet C8]]
* node00004
{| class="wikitable"
* node00002
| node00004
* node00001
|-
* KVMoIP ?
| node00002
* 24 Port Gigabit Switch - Cisco 2960
|-
* 2 x Mini ITX case - firewall and ?
| node00001
* 2 x Mini ITX case - ? and ?
|-
* 2 x Mini ITX case - ? and ?
| bittyback
* bittyback
|-
* 8 Port APC Remove Reboot PDU
| 8 Port APC Remote Reboot PDU
|-
| 24 Port Gigabit Switch - Cisco 2960
|-
| 2 x Mini ITX case - firewall and dedi44001 (IPMI .60 and .70)
|-
| 2 x Mini ITX case - dedi44002 and dedi44003 (IPMI .80 and .90)
|-
| 2 x Mini ITX case - dedi44004 and dedi44005 (IPMI .100 and .110)
|-
| 2 x Mini ITX case - dedi44006 and dedi44007 (IPMI .120 and .130)
|}
 
==Switch Layout==
 
Colour is the network cable colour, each on their own vlan:
 
If we really need a layer 3 switch, they can provide one for £20 per month or we can provide our own. They recommend a Cisco 3750G or Juniper EX4200.
 
* 1083 - UKSERVERS - Routed to Internet (white)
* 101 - FIREWALLED - BMCs and Bittyback (green and red and blue (small switch))
 
{| class="wikitable"
|style="background-color: black; color: white"|Gi0/0
|style="background-color: black; color: white"|Gi0/2
|style="background-color: black; color: white"|Gi0/4
|style="background-color: black; color: white"|Gi0/6
|style="background-color: black; color: white"|Gi0/8
|style="background-color: black; color: white"|Gi0/10
|style="background-color: black; color: white"|
|style="background-color: black; color: white"|Gi0/12
|style="background-color: black; color: white"|Gi0/14
|style="background-color: black; color: white"|Gi0/16
|style="background-color: black; color: white"|Gi0/18
|style="background-color: black; color: white"|Gi0/20
|style="background-color: black; color: white"|Gi0/22
|-
|style="color: blue;"|firewall
|node00001
|node00002
|node00004
|dedi44001 (source filtered)
|dedi44002 (source filtered)
|style="background-color: black"|
|style="color: red;"|bittyback
|style="color: green;"|node00001 BMC
|style="color: green;"|node00002 BMC
|style="color: green;"|node00004 BMC
|style="color: green;"|bittyback BMC
|style="color: white; background-color: purple"|Uplink
|-
|style="color: blue;"|Switch in new rack
|dedi44003 (source filtered)
|dedi44004 (source filtered)
|dedi44005 (source filtered)
|dedi44006 (source filtered)
|dedi44007 (source filtered)
|style="background-color: black"|
|style="color: red;"|Firewall
|style="color: green;"|firewall BMC
|style="color: green;"|dedi44001 BMC
|style="color: blue;"|Small switch
|style="color: blue;"|Switch in new rack
|style="color: white; background-color: purple"|Uplink
|-
|style="background-color: black; color: white"|Gi0/1
|style="background-color: black; color: white"|Gi0/3
|style="background-color: black; color: white"|Gi0/5
|style="background-color: black; color: white"|Gi0/7
|style="background-color: black; color: white"|Gi0/9
|style="background-color: black; color: white"|Gi0/11
|style="background-color: black; color: white"|
|style="background-color: black; color: white"|Gi0/13
|style="background-color: black; color: white"|Gi0/15
|style="background-color: black; color: white"|Gi0/17
|style="background-color: black; color: white"|Gi0/19
|style="background-color: black; color: white"|Gi0/21
|style="background-color: black; color: white"|Gi0/23
|}


==Switch layout==
Small switch


{| class="wikitable"
{| class="wikitable"
|Orange
|style="color: blue;"|Connection to switch
|Apple
|style="color: grey;"|(unc)
|style="color: green;"|dedi44002 BMC
|style="color: green;"|dedi44003 BMC
|-
|-
|Bread
|style="color: green;"|dedi44004 BMC
|Pie
|style="color: green;"|dedi44005 BMC
|style="color: green;"|dedi44006 BMC
|style="color: green;"|dedi44007 BMC
|}
|}
===Power===
The PDU has eight ports. These will be used as follows:
* Switch
* node00001, node00002
* node00004, bittyback
* firewall and dedi1
* dedi2 and dedi3
* dedi4 and dedi5
* dedi6 and dedi7
* dedi8 and dedi9
===KVM===
* C8-kvm1: Not sure. Some Centos 6 server.
* C8-kvm2: Not sure. No signal (may have been dedi5)
* C8-kvm3: node00002 (PS2)
* C8-kvm4: node00004 (USB)
* C8-kvm5: Unconnected
* C8-kvm6: firewall (USB)
* C8-kvm7: node00001 (PS2)
* C8-kvm8: Not present
The web client for the KVM might not always work.  If not there is a client based version.
# Download and run the software From: http://ukservers.com/downloads/win7kvm.zip - thankfully this does appear to work at least under Wine 5.
# Click Add a New Remote Console Switch
# Select the KVM Type provided
# Select the device has an IP address and enter the KVM IP provided (Dell 2161DS-2 in this case)
# The IP address auto-connectivity can time out. Adding this manually afterwards often lets things work.
# Once completed click the servers tab where you should see a list of available interfaces. Select KVM ID provided that relates to your server/rack and enter the KVM User and KVM Password provided.  The list above should match up the servers with the right port numbers for the KVM. Switching between servers requires UKServers to change over the connection.
# Click okay and you should then be able to view your server.
===Startup output===
Cisco IOS Software, C2960 Software (C2960-LANBASE-M), Version 12.2(35)SE5, RELEASE SOFTWARE (fc1)
Copyright (c) 1986-2007 by Cisco Systems, Inc.
Compiled Thu 19-Jul-07 20:06 by nachen
Image text-base: 0x00003000, data-base: 0x00D40000
ROM: Bootstrap program is C2960 boot loader
BOOTLDR: C2960 Boot Loader (C2960-HBOOT-M) Version 12.2(25r)SEE6, RELEASE SOFTWARE (fc1)
sw0.rack40 uptime is 22 weeks, 22 hours, 32 minutes
System returned to ROM by power-on
System image file is "flash:c2960-lanbase-mz.122-35.SE5/c2960-lanbase-mz.122-35.SE5.bin"
cisco WS-C2960G-24TC-L (PowerPC405) processor (revision E0) with 61440K/4088K bytes of memory.
Processor board ID FOC1252U1RS
Last reset from power-on
2 Virtual Ethernet interfaces
48 Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.
===VLAN configuration===
Cisco document is at [http://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst2960/software/release/12-2_55_se/configuration/guide/scg_2960/swvlan.pdf]
====Create VLANs====
* configure terminal
* vlan 100
* end
* show vlan
* vlan 101
* end
* show vlan
* copy running-config startup config
====Assign VLANs====
* configure terminal
* interface ''interface-id''
* switchport mode access ''100 or 101''
* end
* show running-config interface ''interface-id''
* show interfaces ''interface-id'' switchport
* copy running-config startup config
* show interfaces vlan ''100 or 101''
* show vlan ''100 or 101''
====Disallow VLAN 101 direct access to the trunk====
* configure terminal
* interface ''interface-id''
* switchport trunk allowed vlan remove 101
* end
* show interfaces ''interface-id'' switchport
===Source IP Guard===
A simple overview is at [http://packetlife.net/blog/2009/may/25/ip-source-guard-without-dhcp/] and a video at [https://www.youtube.com/watch?v=sEdM0S7BDb8]
* interface ''interface-id''
* ip verify source
* show ip dhcp snoop bind
DHCP snooping must be enabled globally, and again for each VLAN on which IP source guard will be run.
* ip dhcp snooping
* ip dhcp snooping vlan 100
Get MAC addresses
* show mac address-table int ''interface-id''
Configure the IP address on the port
* conf t
* ip device tracking maximum 10 <-- try without this first
* ip source binding ''MAC'' vlan 100 ''IP address'' interface ''interface-id''
* show ip verify source
==Firewall==
The firewall doesn't have a BMC because we don't want it to be Internet facing, and we probably only need the BMC if the firewall is down (and hence can't be used). We will rely on the KVMoIP for this and a permanently attached USB stick.
=Quarter Rack - C20=
==Specifications==
* Up to 11U Lockable Rackspace
* 3A of Power
* 1U 8 Port APC Remote Reboot PDU
* Up to 4 x KVM over IP Connections
* 2 x 1000Mbit Network Ports
* Extra 5TB Monthly Bandwidth (pooled)
* 48 Port Gigabit Switch (Juniper, provided by us)
* 24/7 Access
==Rack layout==
[[File:C20.jpg|200px|thumb|right|Cabinet C20]]
{| class="wikitable"
| Empty
|-
| Empty
|-
| Empty
|-
| Empty
|-
| Empty
|-
| Empty
|-
| 2 x Mini ITX case - dedi44014 and dedi44015 (IPMI .184 and .185)
|-
| 2 x Mini ITX case - dedi44012 and dedi44013 (IPMI .182 and .183)
|-
| 2 x Mini ITX case - dedi44010 and dedi44011 (IPMI .180 and .181)
|-
| 2 x Mini ITX case - dedi44008 and dedi44009 (IPMI .160 and .170)
|-
| 48 Port Gigabit Switch - Juniper EX4200 and 8 Port APC Remote Reboot PDU
|}
==Switch Layout==
* Unknown VLAN - UKSERVERS - Routed to Internet (white)
* internal VLAN - FIREWALLED - BMCs (green)
{| class="wikitable"
|style="background-color: black; color: white"|0
|style="background-color: black; color: white"|2
|style="background-color: black; color: white"|4
|style="background-color: black; color: white"|6
|style="background-color: black; color: white"|8
|style="background-color: black; color: white"|10
|style="background-color: black; color: white"|
|style="background-color: black; color: white"|12
|style="background-color: black; color: white"|14
|style="background-color: black; color: white"|16
|style="background-color: black; color: white"|18
|style="background-color: black; color: white"|20
|style="background-color: black; color: white"|22
|-
|style="color: grey;"|(unc)
|dedi44008
|dedi44010
|dedi44012
|dedi44014
|style="color: grey;"|(unc)
|style="background-color: black"|
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|-
|style="color: blue;"|Other rack<br />(public)
|dedi44009
|dedi44011
|dedi44013
|dedi44015
|style="color: grey;"|(unc)
|style="background-color: black"|
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|style="color: grey;"|(unc)
|-
|style="background-color: black; color: white"|1
|style="background-color: black; color: white"|3
|style="background-color: black; color: white"|5
|style="background-color: black; color: white"|7
|style="background-color: black; color: white"|9
|style="background-color: black; color: white"|11
|style="background-color: black; color: white"|
|style="background-color: black; color: white"|13
|style="background-color: black; color: white"|15
|style="background-color: black; color: white"|17
|style="background-color: black; color: white"|19
|style="background-color: black; color: white"|21
|style="background-color: black; color: white"|23
|}
{| class="wikitable"
|style="background-color: black; color: white"|24
|style="background-color: black; color: white"|26
|style="background-color: black; color: white"|28
|style="background-color: black; color: white"|30
|style="background-color: black; color: white"|32
|style="background-color: black; color: white"|34
|style="background-color: black; color: white"|
|style="background-color: black; color: white"|36
|style="background-color: black; color: white"|38
|style="background-color: black; color: white"|40
|style="background-color: black; color: white"|42
|style="background-color: black; color: white"|44
|style="background-color: black; color: white"|46
|-
|style="color: blue;"|Other rack<br />(firewalled)
|style="color: green;"|dedi44008<br />BMC
|style="color: green;"|dedi44010<br />BMC
|style="color: green;"|dedi44012<br />BMC
|style="color: green;"|dedi44014<br />BMC
|style="color: grey;"|(unc int)
|style="background-color: black"|
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|-
|style="color: grey;"|(unc int)
|style="color: green;"|dedi44009<br />BMC
|style="color: green;"|dedi44011<br />BMC
|style="color: green;"|dedi44013<br />BMC
|style="color: green;"|dedi44015<br />BMC
|style="color: grey;"|(unc int)
|style="background-color: black"|
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|style="color: grey;"|(unc int)
|-
|style="background-color: black; color: white"|25
|style="background-color: black; color: white"|27
|style="background-color: black; color: white"|29
|style="background-color: black; color: white"|31
|style="background-color: black; color: white"|33
|style="background-color: black; color: white"|35
|style="background-color: black; color: white"|
|style="background-color: black; color: white"|37
|style="background-color: black; color: white"|39
|style="background-color: black; color: white"|41
|style="background-color: black; color: white"|43
|style="background-color: black; color: white"|45
|style="background-color: black; color: white"|47
|}
===Power===
The PDU has eight ports. These will be used as follows:
* dedi44008, dedi44009
* dedi44010, dedi44011
* dedi44012, dedi44013
* dedi44014, dedi44015
*
*
*
* Switch

Latest revision as of 10:40, 12 December 2020

Data centre location is CV4 9HN - just off Torrington Avenue.

We currently have a 1/4 rack, but will have another 1/4 rack soon.

Quarter Rack C8

Specifications

  • Up to 11U Lockable Rackspace
  • 3A of Power
  • 1U 8 Port APC Remote Reboot PDU
  • Up to 4 x KVM over IP Connections
  • 2 x 1000Mbit Network Ports
  • 20TB Monthly Bandwidth
  • 24 Port Gigabit Switch
  • 24/7 Access

Rack layout

Error creating thumbnail: File missing
Cabinet C8
node00004
node00002
node00001
bittyback
8 Port APC Remote Reboot PDU
24 Port Gigabit Switch - Cisco 2960
2 x Mini ITX case - firewall and dedi44001 (IPMI .60 and .70)
2 x Mini ITX case - dedi44002 and dedi44003 (IPMI .80 and .90)
2 x Mini ITX case - dedi44004 and dedi44005 (IPMI .100 and .110)
2 x Mini ITX case - dedi44006 and dedi44007 (IPMI .120 and .130)

Switch Layout

Colour is the network cable colour, each on their own vlan:

If we really need a layer 3 switch, they can provide one for £20 per month or we can provide our own. They recommend a Cisco 3750G or Juniper EX4200.

  • 1083 - UKSERVERS - Routed to Internet (white)
  • 101 - FIREWALLED - BMCs and Bittyback (green and red and blue (small switch))
Gi0/0 Gi0/2 Gi0/4 Gi0/6 Gi0/8 Gi0/10 Gi0/12 Gi0/14 Gi0/16 Gi0/18 Gi0/20 Gi0/22
firewall node00001 node00002 node00004 dedi44001 (source filtered) dedi44002 (source filtered) bittyback node00001 BMC node00002 BMC node00004 BMC bittyback BMC Uplink
Switch in new rack dedi44003 (source filtered) dedi44004 (source filtered) dedi44005 (source filtered) dedi44006 (source filtered) dedi44007 (source filtered) Firewall firewall BMC dedi44001 BMC Small switch Switch in new rack Uplink
Gi0/1 Gi0/3 Gi0/5 Gi0/7 Gi0/9 Gi0/11 Gi0/13 Gi0/15 Gi0/17 Gi0/19 Gi0/21 Gi0/23

Small switch

Connection to switch (unc) dedi44002 BMC dedi44003 BMC
dedi44004 BMC dedi44005 BMC dedi44006 BMC dedi44007 BMC

Power

The PDU has eight ports. These will be used as follows:

  • Switch
  • node00001, node00002
  • node00004, bittyback
  • firewall and dedi1
  • dedi2 and dedi3
  • dedi4 and dedi5
  • dedi6 and dedi7
  • dedi8 and dedi9

KVM

  • C8-kvm1: Not sure. Some Centos 6 server.
  • C8-kvm2: Not sure. No signal (may have been dedi5)
  • C8-kvm3: node00002 (PS2)
  • C8-kvm4: node00004 (USB)
  • C8-kvm5: Unconnected
  • C8-kvm6: firewall (USB)
  • C8-kvm7: node00001 (PS2)
  • C8-kvm8: Not present

The web client for the KVM might not always work. If not there is a client based version.

  1. Download and run the software From: http://ukservers.com/downloads/win7kvm.zip - thankfully this does appear to work at least under Wine 5.
  2. Click Add a New Remote Console Switch
  3. Select the KVM Type provided
  4. Select the device has an IP address and enter the KVM IP provided (Dell 2161DS-2 in this case)
  5. The IP address auto-connectivity can time out. Adding this manually afterwards often lets things work.
  6. Once completed click the servers tab where you should see a list of available interfaces. Select KVM ID provided that relates to your server/rack and enter the KVM User and KVM Password provided. The list above should match up the servers with the right port numbers for the KVM. Switching between servers requires UKServers to change over the connection.
  7. Click okay and you should then be able to view your server.

Startup output

Cisco IOS Software, C2960 Software (C2960-LANBASE-M), Version 12.2(35)SE5, RELEASE SOFTWARE (fc1)
Copyright (c) 1986-2007 by Cisco Systems, Inc.
Compiled Thu 19-Jul-07 20:06 by nachen
Image text-base: 0x00003000, data-base: 0x00D40000

ROM: Bootstrap program is C2960 boot loader
BOOTLDR: C2960 Boot Loader (C2960-HBOOT-M) Version 12.2(25r)SEE6, RELEASE SOFTWARE (fc1)

sw0.rack40 uptime is 22 weeks, 22 hours, 32 minutes
System returned to ROM by power-on
System image file is "flash:c2960-lanbase-mz.122-35.SE5/c2960-lanbase-mz.122-35.SE5.bin"

cisco WS-C2960G-24TC-L (PowerPC405) processor (revision E0) with 61440K/4088K bytes of memory.
Processor board ID FOC1252U1RS
Last reset from power-on
2 Virtual Ethernet interfaces
48 Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

VLAN configuration

Cisco document is at [1]

Create VLANs

  • configure terminal
  • vlan 100
  • end
  • show vlan
  • vlan 101
  • end
  • show vlan
  • copy running-config startup config

Assign VLANs

  • configure terminal
  • interface interface-id
  • switchport mode access 100 or 101
  • end
  • show running-config interface interface-id
  • show interfaces interface-id switchport
  • copy running-config startup config
  • show interfaces vlan 100 or 101
  • show vlan 100 or 101

Disallow VLAN 101 direct access to the trunk

  • configure terminal
  • interface interface-id
  • switchport trunk allowed vlan remove 101
  • end
  • show interfaces interface-id switchport

Source IP Guard

A simple overview is at [2] and a video at [3]

  • interface interface-id
  • ip verify source
  • show ip dhcp snoop bind

DHCP snooping must be enabled globally, and again for each VLAN on which IP source guard will be run.

  • ip dhcp snooping
  • ip dhcp snooping vlan 100

Get MAC addresses

  • show mac address-table int interface-id

Configure the IP address on the port

  • conf t
  • ip device tracking maximum 10 <-- try without this first
  • ip source binding MAC vlan 100 IP address interface interface-id
  • show ip verify source

Firewall

The firewall doesn't have a BMC because we don't want it to be Internet facing, and we probably only need the BMC if the firewall is down (and hence can't be used). We will rely on the KVMoIP for this and a permanently attached USB stick.

Quarter Rack - C20

Specifications

  • Up to 11U Lockable Rackspace
  • 3A of Power
  • 1U 8 Port APC Remote Reboot PDU
  • Up to 4 x KVM over IP Connections
  • 2 x 1000Mbit Network Ports
  • Extra 5TB Monthly Bandwidth (pooled)
  • 48 Port Gigabit Switch (Juniper, provided by us)
  • 24/7 Access

Rack layout

Cabinet C20
Empty
Empty
Empty
Empty
Empty
Empty
2 x Mini ITX case - dedi44014 and dedi44015 (IPMI .184 and .185)
2 x Mini ITX case - dedi44012 and dedi44013 (IPMI .182 and .183)
2 x Mini ITX case - dedi44010 and dedi44011 (IPMI .180 and .181)
2 x Mini ITX case - dedi44008 and dedi44009 (IPMI .160 and .170)
48 Port Gigabit Switch - Juniper EX4200 and 8 Port APC Remote Reboot PDU

Switch Layout

  • Unknown VLAN - UKSERVERS - Routed to Internet (white)
  • internal VLAN - FIREWALLED - BMCs (green)
0 2 4 6 8 10 12 14 16 18 20 22
(unc) dedi44008 dedi44010 dedi44012 dedi44014 (unc) (unc) (unc) (unc) (unc) (unc) (unc)
Other rack
(public) 		dedi44009 dedi44011 dedi44013 dedi44015 (unc) (unc) (unc) (unc) (unc) (unc) (unc)
1 3 5 7 9 11 13 15 17 19 21 23
24 26 28 30 32 34 36 38 40 42 44 46
Other rack
(firewalled) 		dedi44008
BMC 		dedi44010
BMC 		dedi44012
BMC 		dedi44014
BMC 		(unc int) (unc int) (unc int) (unc int) (unc int) (unc int) (unc int)
(unc int) dedi44009
BMC 		dedi44011
BMC 		dedi44013
BMC 		dedi44015
BMC 		(unc int) (unc int) (unc int) (unc int) (unc int) (unc int) (unc int)
25 27 29 31 33 35 37 39 41 43 45 47

Power

The PDU has eight ports. These will be used as follows:

  • dedi44008, dedi44009
  • dedi44010, dedi44011
  • dedi44012, dedi44013
  • dedi44014, dedi44015
  • Switch
Retrieved from "https://gigatux.com/wiki/index.php?title=Coventry&oldid=1035"