Monday, June 4, 2012

Cisco Nexus 5000/2000 Install (Part 4): HA/Redundancy Topology and Configuration Examples/Samples

Cisco Nexus 5000/2000 Install (Part 4): Topology and Configuration Examples/Samples

I thought I would put up a final topology and configuration examples of this install I did.  I have taken out the sensitive data and changed sensitive data that would be important to the config.  See below the final topology and configs for N5K-1 and N5K-2.  You will notice in N5K-1 it has the port extension module in it.  That will be Ethernet 2/1-16.
For more info and notes that I took on this install, see the following links:
For the notes and some explanations "through" the install, click here.
For the notes on "vPC", click here.
For the notes on the "FEXs", click here.

Here are the configs, first for N5k-1, then for N5K-2:
sh run

!Command: show running-config
!Time: Wed Apr  1 21:12:58 2009

version 5.1(3)N1(1a)
hostname N5K-1

feature telnet
no feature http-server
cfs eth distribute
feature lacp
feature vpc
feature lldp
feature fex



ip domain-lookup
class-map type qos class-fcoe
class-map type queuing class-fcoe
  match qos-group 1
class-map type queuing class-all-flood
  match qos-group 2
class-map type queuing class-ip-multicast
  match qos-group 2
class-map type network-qos class-fcoe
  match qos-group 1
class-map type network-qos class-all-flood
  match qos-group 2
class-map type network-qos class-ip-multicast
  match qos-group 2
fex 100
  pinning max-links 1
  description "FEX0100"
fex 101
  pinning max-links 1
  description "FEX0101"


vrf context management
vlan 1-2,10,273
vpc domain 1
  peer-keepalive destination 192.168.1.51

interface port-channel6
  switchport mode fex-fabric
  fex associate 100
  vpc 6

interface port-channel7
  switchport mode fex-fabric
  fex associate 101
  vpc 7

interface port-channel11
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  vpc 11

interface port-channel15
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  vpc 15

interface port-channel100
  switchport mode fex-fabric

interface port-channel101
  speed 10000

interface port-channel1516
  switchport mode trunk
  spanning-tree port type network
  speed 1000
  vpc peer-link

interface Ethernet1/1
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/2
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/3
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/4
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/5
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/6
  description *** To FEX 100 ****** To FEX 100 ***
  switchport mode fex-fabric
  fex associate 100
  channel-group 6

interface Ethernet1/7
  description *** To FEX 101 ****** To FEX 101 ***
  switchport mode fex-fabric
  fex associate 101
  channel-group 7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15
  switchport mode trunk
  speed 1000
  channel-group 1516 mode active

interface Ethernet1/16
  switchport mode trunk
  speed 1000
  channel-group 1516 mode active

interface Ethernet1/17
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/18
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/19
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/20
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/21
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/22

interface Ethernet1/23

interface Ethernet1/24

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30
  switchport access vlan 273
  speed 1000

interface Ethernet1/31

interface Ethernet1/32

interface Ethernet2/1

interface Ethernet2/2

interface Ethernet2/3

interface Ethernet2/4

interface Ethernet2/5

interface Ethernet2/6

interface Ethernet2/7

interface Ethernet2/8

interface Ethernet2/9

interface Ethernet2/10

interface Ethernet2/11

interface Ethernet2/12

interface Ethernet2/13

interface Ethernet2/14

interface Ethernet2/15

interface Ethernet2/16

interface mgmt0
  ip address 192.168.1.52/24

interface Ethernet100/1/1
  switchport access vlan 273

interface Ethernet100/1/2
  switchport access vlan 273

interface Ethernet100/1/3
  switchport access vlan 273

interface Ethernet100/1/4
  switchport access vlan 273

interface Ethernet100/1/5
  switchport access vlan 273

interface Ethernet100/1/6
  switchport access vlan 273

interface Ethernet100/1/7
  switchport access vlan 273

interface Ethernet100/1/8
  switchport access vlan 273

interface Ethernet100/1/9
  switchport access vlan 273

interface Ethernet100/1/10
  switchport access vlan 273

interface Ethernet100/1/11
  switchport access vlan 273

interface Ethernet100/1/12
  switchport access vlan 273

interface Ethernet100/1/13
  switchport access vlan 273

interface Ethernet100/1/14
  switchport access vlan 273

interface Ethernet100/1/15
  switchport access vlan 273

interface Ethernet100/1/16
  switchport access vlan 273

interface Ethernet100/1/17
  switchport access vlan 2

interface Ethernet100/1/18
  switchport access vlan 2

interface Ethernet100/1/19
  switchport access vlan 2

interface Ethernet100/1/20
  switchport access vlan 2

interface Ethernet100/1/21
  switchport access vlan 2

interface Ethernet100/1/22
  switchport access vlan 2

interface Ethernet100/1/23
  switchport access vlan 2

interface Ethernet100/1/24
  switchport access vlan 2

interface Ethernet100/1/25
  switchport access vlan 2

interface Ethernet100/1/26
  switchport access vlan 2

interface Ethernet100/1/27
  switchport access vlan 2

interface Ethernet100/1/28
  switchport access vlan 2

interface Ethernet100/1/29
  switchport access vlan 2

interface Ethernet100/1/30
  switchport access vlan 2

interface Ethernet100/1/31
  switchport access vlan 2

interface Ethernet100/1/32
  switchport access vlan 2

interface Ethernet101/1/1
  switchport access vlan 273

interface Ethernet101/1/2
  switchport access vlan 273

interface Ethernet101/1/3
  switchport access vlan 273

interface Ethernet101/1/4
  switchport access vlan 273

interface Ethernet101/1/5
  switchport access vlan 273

interface Ethernet101/1/6
  switchport access vlan 273

interface Ethernet101/1/7
  switchport access vlan 273

interface Ethernet101/1/8
  switchport access vlan 273

interface Ethernet101/1/9
  switchport access vlan 273

interface Ethernet101/1/10
  switchport access vlan 273

interface Ethernet101/1/11
  switchport access vlan 273

interface Ethernet101/1/12
  switchport access vlan 273

interface Ethernet101/1/13
  switchport access vlan 273

interface Ethernet101/1/14
  switchport access vlan 273

interface Ethernet101/1/15
  switchport access vlan 273

interface Ethernet101/1/16
  switchport access vlan 273

interface Ethernet101/1/17
  switchport access vlan 2

interface Ethernet101/1/18
  switchport access vlan 2

interface Ethernet101/1/19
  switchport access vlan 2

interface Ethernet101/1/20
  switchport access vlan 2

interface Ethernet101/1/21
  switchport access vlan 2

interface Ethernet101/1/22
  switchport access vlan 2

interface Ethernet101/1/23
  switchport access vlan 2

interface Ethernet101/1/24
  switchport access vlan 2

interface Ethernet101/1/25
  switchport access vlan 2

interface Ethernet101/1/26
  switchport access vlan 2

interface Ethernet101/1/27
  switchport access vlan 2

interface Ethernet101/1/28
  switchport access vlan 2

interface Ethernet101/1/29
  switchport access vlan 2

interface Ethernet101/1/30
  switchport access vlan 2

interface Ethernet101/1/31
  switchport access vlan 2

interface Ethernet101/1/32
  switchport access vlan 2
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N1.1a.bin
boot system bootflash:/n5000-uk9.5.1.3.N1.1a.bin
ip route 0.0.0.0/0 192.168.1.1

N5K-1#
N5K-1#
==================================================================
term len 0
N5K-2# sh run

!Command: show running-config
!Time: Wed Apr  1 21:11:26 2009

version 5.1(3)N1(1a)
hostname N5K-2

feature telnet
no feature http-server
cfs eth distribute
feature lacp
feature vpc
feature lldp
feature fex


ip domain-lookup
class-map type qos class-fcoe
class-map type queuing class-fcoe
  match qos-group 1
class-map type queuing class-all-flood
  match qos-group 2
class-map type queuing class-ip-multicast
  match qos-group 2
class-map type network-qos class-fcoe
  match qos-group 1
class-map type network-qos class-all-flood
  match qos-group 2
class-map type network-qos class-ip-multicast
  match qos-group 2
fex 100
  pinning max-links 1
  description "FEX0100"
fex 101
  pinning max-links 1
  description "FEX0101"


vrf context management
  ip route 0.0.0.0/0 192.168.1.1
vlan 1-2,273
vpc domain 1
  peer-keepalive destination 192.168.1.52

interface port-channel6
  switchport mode fex-fabric
  fex associate 100
  vpc 6

interface port-channel7
  switchport mode fex-fabric
  fex associate 101
  vpc 7

interface port-channel11
  switchport mode trunk
  speed 1000
  vpc 11

interface port-channel15
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  vpc 15

interface port-channel1516
  switchport mode trunk
  spanning-tree port type network
  speed 1000
  vpc peer-link

interface Ethernet1/1
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/2
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/3
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/4
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/5
  description To_Core_Switch2
  switchport mode trunk
  speed 1000
  channel-group 15 mode active

interface Ethernet1/6
  description *** To FEX 100 ****** To FEX 100 ***
  switchport mode fex-fabric
  fex associate 100
  channel-group 6

interface Ethernet1/7
  description *** To FEX 101 ****** To FEX 101 ***
  switchport mode fex-fabric
  fex associate 101
  channel-group 7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15
  switchport mode trunk
  speed 1000
  channel-group 1516 mode active

interface Ethernet1/16
  switchport mode trunk
  speed 1000
  channel-group 1516 mode active

interface Ethernet1/17
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/18
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/19
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/20
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/21
  description To_Core_Switch1
  switchport mode trunk
  speed 1000
  channel-group 11 mode active

interface Ethernet1/22

interface Ethernet1/23

interface Ethernet1/24

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30

interface Ethernet1/31

interface Ethernet1/32

interface mgmt0
  ip address 192.168.1.51/24

interface Ethernet100/1/1
  switchport access vlan 273

interface Ethernet100/1/2
  switchport access vlan 273

interface Ethernet100/1/3
  switchport access vlan 273

interface Ethernet100/1/4
  switchport access vlan 273

interface Ethernet100/1/5
  switchport access vlan 273

interface Ethernet100/1/6
  switchport access vlan 273

interface Ethernet100/1/7
  switchport access vlan 273

interface Ethernet100/1/8
  switchport access vlan 273

interface Ethernet100/1/9
  switchport access vlan 273

interface Ethernet100/1/10
  switchport access vlan 273

interface Ethernet100/1/11
  switchport access vlan 273

interface Ethernet100/1/12
  switchport access vlan 273

interface Ethernet100/1/13
  switchport access vlan 273

interface Ethernet100/1/14
  switchport access vlan 273

interface Ethernet100/1/15
  switchport access vlan 273

interface Ethernet100/1/16
  switchport access vlan 273

interface Ethernet100/1/17
  switchport access vlan 2

interface Ethernet100/1/18
  switchport access vlan 2

interface Ethernet100/1/19
  switchport access vlan 2

interface Ethernet100/1/20
  switchport access vlan 2

interface Ethernet100/1/21
  switchport access vlan 2

interface Ethernet100/1/22
  switchport access vlan 2

interface Ethernet100/1/23
  switchport access vlan 2

interface Ethernet100/1/24
  switchport access vlan 2

interface Ethernet100/1/25
  switchport access vlan 2

interface Ethernet100/1/26
  switchport access vlan 2

interface Ethernet100/1/27
  switchport access vlan 2

interface Ethernet100/1/28
  switchport access vlan 2

interface Ethernet100/1/29
  switchport access vlan 2

interface Ethernet100/1/30
  switchport access vlan 2

interface Ethernet100/1/31
  switchport access vlan 2

interface Ethernet100/1/32
  switchport access vlan 2

interface Ethernet101/1/1
  switchport access vlan 273

interface Ethernet101/1/2
  switchport access vlan 273

interface Ethernet101/1/3
  switchport access vlan 273

interface Ethernet101/1/4
  switchport access vlan 273

interface Ethernet101/1/5
  switchport access vlan 273

interface Ethernet101/1/6
  switchport access vlan 273

interface Ethernet101/1/7
  switchport access vlan 273

interface Ethernet101/1/8
  switchport access vlan 273

interface Ethernet101/1/9
  switchport access vlan 273

interface Ethernet101/1/10
  switchport access vlan 273

interface Ethernet101/1/11
  switchport access vlan 273

interface Ethernet101/1/12
  switchport access vlan 273

interface Ethernet101/1/13
  switchport access vlan 273

interface Ethernet101/1/14
  switchport access vlan 273

interface Ethernet101/1/15
  switchport access vlan 273

interface Ethernet101/1/16
  switchport access vlan 273

interface Ethernet101/1/17
  switchport access vlan 2

interface Ethernet101/1/18
  switchport access vlan 2

interface Ethernet101/1/19
  switchport access vlan 2

interface Ethernet101/1/20
  switchport access vlan 2

interface Ethernet101/1/21
  switchport access vlan 2

interface Ethernet101/1/22
  switchport access vlan 2

interface Ethernet101/1/23
  switchport access vlan 2

interface Ethernet101/1/24
  switchport access vlan 2

interface Ethernet101/1/25
  switchport access vlan 2

interface Ethernet101/1/26
  switchport access vlan 2

interface Ethernet101/1/27
  switchport access vlan 2

interface Ethernet101/1/28
  switchport access vlan 2

interface Ethernet101/1/29
  switchport access vlan 2

interface Ethernet101/1/30
  switchport access vlan 2

interface Ethernet101/1/31
  switchport access vlan 2

interface Ethernet101/1/32
  switchport access vlan 2
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N1.1a.bin
boot system bootflash:/n5000-uk9.5.1.3.N1.1a.bin
ip route 0.0.0.0/0 192.168.1.1

N5K-2#
N5K-2#