Hi,
I was getting a memory error every 30 seconds on this N2048 and I did some searching around and it said to try updating the firmware. I updated the firmware on one of the switches and rebooted it. It came back up but VPC between this switch and the primary VPC switch (which is on 6.1.2.4 is not working at all.
It indicates in the manual that you can upgrade the firmware on two systems in VPC with each other but after you reboot the first one you end up in a lot of trouble.
Basically all the new switch does when it boots up is say this:
<187> Dec 15 14:01:00 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 521 %% Failed to send interface(Gi1/0/46) add information to peer
<187> Dec 15 14:01:00 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 520 %% Failed to deliver Application's Dot3ad control message with TxID 38 and size 52 bytes to peer
<187> Dec 15 14:00:56 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 519 %% Failed to send interface(Gi1/0/45) add information to peer
<187> Dec 15 14:00:56 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 518 %% Failed to deliver Application's Dot3ad control message with TxID 37 and size 52 bytes to peer
<187> Dec 15 14:00:52 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 517 %% Failed to send interface(Gi1/0/44) add information to peer
<187> Dec 15 14:00:52 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 516 %% Failed to deliver Application's Dot3ad control message with TxID 36 and size 52 bytes to peer
<187> Dec 15 14:00:48 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 515 %% Failed to send interface(Gi1/0/43) add information to peer
<187> Dec 15 14:00:48 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 514 %% Failed to deliver Application's Dot3ad control message with TxID 35 and size 52 bytes to peer
<187> Dec 15 14:00:44 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 513 %% Failed to send interface(Gi1/0/42) add information to peer
<187> Dec 15 14:00:44 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 512 %% Failed to deliver Application's Dot3ad control message with TxID 34 and size 52 bytes to peer
<187> Dec 15 14:00:40 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 511 %% Failed to send interface(Gi1/0/41) add information to peer
<187> Dec 15 14:00:40 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 510 %% Failed to deliver Application's Dot3ad control message with TxID 33 and size 52 bytes to peer
<187> Dec 15 14:00:36 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 509 %% Failed to send interface(Gi1/0/33) add information to peer
<187> Dec 15 14:00:36 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 508 %% Failed to deliver Application's Dot3ad control message with TxID 32 and size 52 bytes to peer
<187> Dec 15 14:00:32 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 507 %% Failed to send interface(Gi1/0/32) add information to peer
<187> Dec 15 14:00:32 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 506 %% Failed to deliver Application's Dot3ad control message with TxID 31 and size 52 bytes to peer
<187> Dec 15 14:00:28 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 505 %% Failed to send interface(Gi1/0/31) add information to peer
<187> Dec 15 14:00:28 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 504 %% Failed to deliver Application's Dot3ad control message with TxID 30 and size 52 bytes to peer
<187> Dec 15 14:00:24 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 503 %% Failed to send interface(Gi1/0/25) add information to peer
<187> Dec 15 14:00:24 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 502 %% Failed to deliver Application's Dot3ad control message with TxID 29 and size 52 bytes to peer
<187> Dec 15 14:00:20 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 501 %% Failed to send interface(Gi1/0/24) add information to peer
<187> Dec 15 14:00:20 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 500 %% Failed to deliver Application's Dot3ad control message with TxID 28 and size 52 bytes to peer
<187> Dec 15 14:00:16 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 499 %% Failed to send interface(Gi1/0/23) add information to peer
<187> Dec 15 14:00:16 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 498 %% Failed to deliver Application's Dot3ad control message with TxID 27 and size 52 bytes to peer
<187> Dec 15 14:00:12 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 497 %% Failed to send interface(Gi1/0/22) add information to peer
<187> Dec 15 14:00:12 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 496 %% Failed to deliver Application's Dot3ad control message with TxID 26 and size 52 bytes to peer
<187> Dec 15 14:00:08 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 495 %% Failed to send interface(Gi1/0/21) add information to peer
<187> Dec 15 14:00:08 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 494 %% Failed to deliver Application's Dot3ad control message with TxID 25 and size 52 bytes to peer
<187> Dec 15 14:00:04 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 493 %% Failed to send interface(Gi1/0/14) add information to peer
<187> Dec 15 14:00:04 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 492 %% Failed to deliver Application's Dot3ad control message with TxID 24 and size 52 bytes to peer
<187> Dec 15 14:00:00 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 491 %% Failed to send interface(Gi1/0/13) add information to peer
<187> Dec 15 14:00:00 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 490 %% Failed to deliver Application's Dot3ad control message with TxID 23 and size 52 bytes to peer
<187> Dec 15 13:59:56 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 489 %% Failed to send interface(Gi1/0/12) add information to peer
<187> Dec 15 13:59:56 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 488 %% Failed to deliver Application's Dot3ad control message with TxID 22 and size 52 bytes to peer
<187> Dec 15 13:59:52 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 487 %% Failed to send interface(Gi1/0/11) add information to peer
<187> Dec 15 13:59:52 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 486 %% Failed to deliver Application's Dot3ad control message with TxID 21 and size 52 bytes to peer
<187> Dec 15 13:59:48 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 485 %% Failed to send interface(Gi1/0/46) add information to peer
<187> Dec 15 13:59:48 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 484 %% Failed to deliver Application's Dot3ad control message with TxID 20 and size 52 bytes to peer
<187> Dec 15 13:59:44 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 483 %% Failed to send interface(Gi1/0/45) add information to peer
<187> Dec 15 13:59:44 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 482 %% Failed to deliver Application's Dot3ad control message with TxID 19 and size 52 bytes to peer
<187> Dec 15 13:59:40 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 481 %% Failed to send interface(Gi1/0/44) add information to peer
<187> Dec 15 13:59:40 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 480 %% Failed to deliver Application's Dot3ad control message with TxID 18 and size 52 bytes to peer
<187> Dec 15 13:59:36 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 479 %% Failed to send interface(Gi1/0/43) add information to peer
<187> Dec 15 13:59:36 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 478 %% Failed to deliver Application's Dot3ad control message with TxID 17 and size 52 bytes to peer
<187> Dec 15 13:59:32 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 477 %% Failed to send interface(Gi1/0/42) add information to peer
<187> Dec 15 13:59:32 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 476 %% Failed to deliver Application's Dot3ad control message with TxID 16 and size 52 bytes to peer
<187> Dec 15 13:59:28 N2048-1-1 DOT3AD[dot3ad_core_lac]: dot3ad_mlag_peer.c(3612) 475 %% Failed to send interface(Gi1/0/41) add information to peer
<187> Dec 15 13:59:28 N2048-1-1 MLAG[mlagTxTask]: mlag_comm.c(790) 474 %% Failed to deliver Application's Dot3ad control message with TxID 15 and size 52 bytes to peer
All of the physical interfaces on the switch with the new firmware are being forced down and the VPCs are in operationally disabled/wait mode. this worked perfectly before upgrading.
N2048-1#show vpc 22
VPC id# 22
-----------------
Config mode.................................... Enabled
Operational mode............................... Disabled
Port channel................................... Po22
Local Members Status
----------------- ------
Gi1/0/22 DOWN
Peer Members Status
---------------- ------
N2048-1#show interfaces gi1/0/22
Interface Name................................. Gi1/0/22
SOC Hardware Info.............................. BCM56340_A0
Link Status.................................... shut /None
Keepalive Enabled.............................. FALSE
Err-disable Cause.............................. None
MTU Size....................................... 1518
Port Mode [Duplex]............................. N/A
Port Speed..................................... Unknown
Link Debounce Flaps............................ 0
Auto-Negotation Status......................... Auto
Burned MAC Address............................. F8B1.565C.054A
L3 MAC Address................................. F8B1.565C.054B
Sample Load Interval........................... 300
Received Input Rate Bits/Sec................... 0
Received Input Rate Packets/Sec................ 0
Transmitted Input Rate Bits/Sec................ 0
Transmitted Input Rate Packets/Sec : .......... 0
Total Packets Received Without Errors.......... 0
Unicast Packets Received....................... 0
Multicast Packets Received..................... 0
Broadcast Packets Received..................... 0
Total Packets Received with MAC Errors......... 0
N2048-1#show interfaces po22
Channel Ports Ch-Type Hash Type Min-links Local Prf
------- ----------------------------- -------- --------- --------- ---------
Po22 Inactive: Gi1/0/22 Dynamic 7 1 Disabled
If there is anyone out there that knows what is going on please let me know.