Edgerouter Pro8 and Netonix Switches and Lag's

[whubbartt]

HI all;

I am trying to setup a 2 lags between my Netonix and Edgerouter. It looks pretty easy on the Netonix side but I can't find much information as how to do it on the Edgerouter side. Has anyone done this? If so, would you mind sharing a walk through on the Edgerouter side to accomplish the lag setup?

Much appreciated!

Thanks,

WH

[mike99]

Edgerouter is not a switch, it's a router and LAG is a layer 2 protocol. Edgerouter won't be able to support it. Maybe a edgerouter X could support it but I don't think it's a supported feature.

Between layer 3 devices, you can use OSPF equal cost load balancing but not sure if edgerouter support it.

[sirhc]

Cisco routers support Static LAGs but not LACP
We use a Static LAG between our Cisco routers and our Netonix Switches
Maybe Edge routers will support STATIC LAGs??

Here is our Typical tower Cisco config with a STATIC LAG

HC01#sh run
Building configuration...
Current configuration : 15133 bytes
!
version 15.3
service nagle
no service pad
service timestamps debug datetime msec
service timestamps log datetime msec
service password-encryption
!
hostname HC01
!
boot-start-marker
boot system flash0:/c2951-universalk9-mz.SPA.153-1.T1.bin
boot config flash0:/startup-config
warm-reboot count 50
boot-end-marker
!
logging buffered 10000
no logging console
no logging monitor
enable secret 4 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
!
no aaa new-model
clock timezone EST -5 0
clock summer-time EDT recurring
!
ip cef
!
ip domain name xxxxxxxxxxxx.xxx
ip name-server 0.0.0.0
ip name-server 0.0.0.0
!
multilink bundle-name authenticated
!
!
license udi pid CISCO2951/K9 sn XXXXXXXXXXXXXXX
!
!
archive
path tftp://0.0.0.0/HC1-config
write-memory
!
spanning-tree portfast bpduguard
no spanning-tree vlan 1
no spanning-tree vlan 16
no spanning-tree vlan 20
no spanning-tree vlan 21
no spanning-tree vlan 22
no spanning-tree vlan 51
no spanning-tree vlan 52
no spanning-tree vlan 53
no spanning-tree vlan 54
no spanning-tree vlan 55
no spanning-tree vlan 56
no spanning-tree vlan 60
no spanning-tree vlan 70
no spanning-tree vlan 71
no spanning-tree vlan 72
no spanning-tree vlan 97
no spanning-tree vlan 100
!
redundancy
!
ip tcp ecn
ip tcp path-mtu-discovery
!
interface Port-channel10
description Tank Vlan
no ip address
no ip redirects
load-interval 30
carrier-delay msec 0
no mop enabled
hold-queue 150 in
!
interface Port-channel10.1
encapsulation dot1Q 1 native
ip address 0.0.0.0 255.255.255.0
no ip redirects
!
interface Port-channel10.20
description HC20 AP
encapsulation dot1Q 20
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.21
description HC21 AP
encapsulation dot1Q 21
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.22
description HC22 AP
encapsulation dot1Q 22
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.51
description HC51 AP
encapsulation dot1Q 51
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.52
description HC52 AP
encapsulation dot1Q 52
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.53
description HC53 AP
encapsulation dot1Q 53
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.54
description HC54 AP
encapsulation dot1Q 54
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.55
description HC55 AP
encapsulation dot1Q 55
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.56
description HC56 AP
encapsulation dot1Q 56
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.60
description HC2CDC
encapsulation dot1Q 60
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
!
interface Port-channel10.70
description HC to RTC.MA 5Ghz
encapsulation dot1Q 70
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
ip ospf dead-interval minimal hello-multiplier 5
!
interface Port-channel10.71
description HC to RTC.IC 5Ghz
encapsulation dot1Q 71
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
!
interface Port-channel10.72
description HC to RTC.MS 5Ghz P2P
encapsulation dot1Q 72
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Port-channel10.96
description TMC Access Points
encapsulation dot1Q 96
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.0 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
no ip redirects
!
interface Embedded-Service-Engine0/0
no ip address
shutdown
!
interface GigabitEthernet0/0
description Lagg to WS1 P22
no ip address
no ip redirects
load-interval 30
carrier-delay msec 0
duplex auto
speed auto
channel-group 10
no cdp enable
no mop enabled
!
interface GigabitEthernet0/1
description Lagg to WS1 P23
no ip address
no ip redirects
load-interval 30
carrier-delay msec 0
duplex auto
speed auto
media-type rj45
no keepalive
channel-group 10
no cdp enable
no mop enabled
!
interface GigabitEthernet0/2
description HC to QR AF24Ghz
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
ip ospf dead-interval minimal hello-multiplier 5
load-interval 30
carrier-delay msec 0
duplex auto
speed auto
no cdp enable
no mop enabled
!
interface GigabitEthernet0/1/0
description HC to NL Fiber 1
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
ip ospf dead-interval minimal hello-multiplier 5
load-interval 30
carrier-delay msec 0
media-type sfp
no cdp enable
no mop enabled
!
interface GigabitEthernet0/2/0
description HC to NL Fiber 2
ip address 0.0.0.0 255.255.255.248
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
ip ospf dead-interval minimal hello-multiplier 5
ip ospf cost 65000
load-interval 30
shutdown
media-type sfp
no cdp enable
no mop enabled
!
interface GigabitEthernet0/3/0
description HC to BV AF24Ghz
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
duplex auto
speed auto
media-type rj45
!
interface GigabitEthernet0/0/0
no ip address
!
interface GigabitEthernet0/0/1
no ip address
!
interface GigabitEthernet0/0/2
description HC to GT RocketM5 (Vlan 97)
switchport access vlan 97
no ip address
!
interface GigabitEthernet0/0/3
description HC to SR Mimosa B5Ghz (Vlan 100)
switchport access vlan 100
no ip address
!
interface Vlan1
no ip address
!
interface Vlan97
description HC to GT RocketM5 on G0/0/2
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.248
no ip redirects
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
ip ospf hello-interval 20
!
interface Vlan100
description HC to SR Mimosa B5Ghz on G0/0/3
ip address 0.0.0.0 255.255.255.252 secondary
ip address 0.0.0.0 255.255.255.252
ip ospf message-digest-key 1 md5 7 XXXXXXXXXXXXXXXXXXXXXXXXXXXX
ip ospf dead-interval minimal hello-multiplier 5
ip ospf cost 60000
load-interval 30
carrier-delay msec 0
no mop enabled
!
router ospf 1
router-id 0.0.0.0
auto-cost reference-bandwidth 1000
area 0 authentication message-digest
area 50 authentication message-digest
area 51 authentication message-digest
area 60 authentication message-digest
timers throttle spf 1 10000 20000
timers throttle lsa 100 10000 45000
redistribute connected subnets
redistribute static subnets
network 0.0.0.0 0.0.0.7 area 0
network 0.0.0.0 0.0.0.7 area 0
network 0.0.0.0 0.0.0.7 area 0
network 0.0.0.0 0 0.0.0.7 area 0
network 0.0.0.0 0.0.0.7 area 0
network 0.0.0.0 0.0.0.7 area 50
network 0.0.0 0 0.0.7 area 51
network 0.0.0.0 0.0.0.7 area 60
network 0.0.0.0 0.0.0.3 area 0
!
no ip forward-protocol nd
!
no ip http server
no ip http secure-server
!
ip route 0.0.0.0 255.255.255.252 0.0.0.0
ip route 0.0.0.0 255.255.255.252 0.0.0.0
ip route 0.0.0.0 255.255.255.252 0.0.0.0
ip ospf name-lookup
!
no cdp run
!
snmp-server community XXXXXXXXXX XX XX
snmp-server enable traps ospf state-change
snmp-server enable traps ospf errors
snmp-server enable traps envmon
snmp-server enable traps entity-sensor threshold
access-list 20 permit 0.0.0.0 0.0.0.255
access-list 20 permit 0.0.0.0 0.0.7.255
access-list 20 permit 0.0.0.0 0.0.255.255
access-list 20 deny any
access-list 30 permit 0.0.0.0 0.0.0.127
!
control-plane
!
banner motd ^C
****************************************************************************
* *
* *
* NO UNAUTHORIZED ACCESS *
* *
* *
****************************************************************************
^C
!
line con 0
line aux 0
line 2
no activation-character
no exec
transport preferred none
transport input all
transport output none
stopbits 1
line vty 0 4
password 7 00000000
login
transport input telnet ssh
line vty 5 15
password 7 00000000
login
transport input telnet ssh
!
scheduler process-watchdog terminate
scheduler isr-watchdog
no scheduler allocate
scheduler interval 100
ntp server ip XXXXXX.XXXXXX.XXX prefer
!
end
HC01#

[mike99]

Maybe Edge routers will support STATIC LAGs??

Layer 3 switch support LAG, not router. The edgerouter would need a switch chip between the NIC ports and the Canvium ASIC to be able to support LAG, static or LACP.
From Cisco doc:
Link aggregation, also called trunking, is an optional feature available on the Ethernet gateway and is used with Layer 2 Bridging. Link aggregation allows multiple ports to merge logically in a single link.

Source: http://www.cisco.com/c/en/us/td/docs/se ... 3link.html

[sirhc]

We do not have a switch card in our Cisco 2951 Mike99 and we set up STATIC LAGs with our Netonix switches?

Now the Cisco will not support LACP LAGs without a switch card.

interface Port-channel10
description Tank Vlan
no ip address
no ip redirects
load-interval 30
carrier-delay msec 0
no mop enabled
hold-queue 150 in
!
interface Port-channel10.1
encapsulation dot1Q 1 native
ip address 0.0.0.0 255.255.255.0
no ip redirects


interface GigabitEthernet0/0
description Lagg to WS1 P22
no ip address
no ip redirects
load-interval 30
carrier-delay msec 0
duplex auto
speed auto
channel-group 10
no cdp enable
no mop enabled
!
interface GigabitEthernet0/1
description Lagg to WS1 P23
no ip address
no ip redirects
load-interval 30
carrier-delay msec 0
duplex auto
speed auto
media-type rj45
no keepalive
channel-group 10
no cdp enable
no mop enabled

[sirhc]

Here are our Tabs in our switch

[sirhc]

Notice the LAG carries only local radios to the tower such as APs and Private PTP to high end customers.

The back hauls go through the switch as 2 ports configured as midspan injectors.

This keeps pause framed from local radios from affecting traffic coming in and leaving the tower to the next tower.

This also allows us to reboot backhaul radios and see the traffic going through them.

Take a good look at our VLAN Tab and the Cisco Router config and it all lines up.

The midspan injector VLANs are in BLUE box all other local radios are feed through STATIC LAG from router. Works well for us anyway.

[mike99]

Probably that the Cisco ASIC of those device support some kind of bridging fonction to support the 2 ethernet as a port channel while Ubnt don't. Ubnt ASIC is very limited and don't support layer 2 fonctionnality, not even bridge 2 ports.

It would be probably possible to do it without the Cavium ASIC since linux probably support it but without ASIC, edgerouter performance are really limited.

[whubbartt]

Ubiquiti claims that the EdgeRouter Pro supports static and Lacp but there is no example how to set this up. It has something to do with bonding.
They say that static support is default but you can change to dynamic.

I am basically wanting it to support fail over from pause frames. We seem to get alot of those and it's slowing things down a bit.

Thank You guys for your response.

WH

Bonding info although we've not been able to make it work

https://community.ubnt.com/t5/EdgeMAX/L ... d-p/564733

[sirhc]

This is why we try to make our interfaces as simple and straightforward as possible.

You should see the UI we have planned for our routers if we ever get big enough to produce it, everything laid out simple and straightforward.

Maybe not as flashy as UBNT UI but simple and efficient.