We have a N4032 switch used for a vSAN environment. Right now we only have 4 ESXi host connected to it ( 8 ports ). all the switch ports are configured as auto:
show interfaces status
Port Description Vlan Duplex Speed Neg Link Flow Ctrl
State Status
--------- ------------------------- ----- ------ ------- ---- ------ ---------
Te1/0/1 95 Full 10000 Auto Up Active
Te1/0/2 95 Full 10000 Auto Up Active
Te1/0/3 95 Full 10000 Auto Up Active
Te1/0/4 95 Full 10000 Auto Up Active
Te1/0/5 95 Full 10000 Auto Up Active
Te1/0/6 95 Full 10000 Auto Up Active
Te1/0/7 95 Full 10000 Auto Up Active
Te1/0/8 95 Full 10000 Auto Up Active
Te1/0/9 95 N/A Unknown Auto Down Inactive
Te1/0/10 95 N/A Unknown Auto Down Inactive
On the ESXi side, each host has two NIC configured as auto mode.
the NIC teaming is configured as :
Both adapter active;
load balancing : route based on the originating virtual port ID
failover detection: Link status only
Notify switches: Yes
Failback: Yes
The physical NIC are QLogic :
vmnic6 0000:43:00.0 bnx2x Up 10000Mbps Full 00:0e:1e:9e:c2:80 9000 QLogic Corporation NetXtreme II BCM57810 10 Gigabit Ethernet
vmnic7 0000:43:00.1 bnx2x Up 10000Mbps Full 00:0e:1e:9e:c2:82 9000 QLogic Corporation NetXtreme II BCM57810 10 Gigabit Ethernet
I found occasionally some of the NICs will go "link down", and come back in 5/6 seconds:
<189> Dec 13 19:17:59 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 6043 %% Link Up: Te1/0/5
<189> Dec 13 19:17:54 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 6041 %% Link on Te1/0/5 is failed
<189> Dec 13 19:17:54 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 6040 %% Link Down: Te1/0/5
<189> Dec 12 07:51:34 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5869 %% Link Up: Te1/0/5
<189> Dec 12 07:51:29 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5867 %% Link on Te1/0/5 is failed
<189> Dec 12 07:51:29 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5866 %% Link Down: Te1/0/5
189> Dec 9 22:12:08 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5732 %% Link Up: Te1/0/7
<189> Dec 9 22:12:02 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5730 %% Link on Te1/0/7 is failed
<189> Dec 9 22:12:02 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5729 %% Link Down: Te1/0/7
<189> Dec 9 11:39:41 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5726 %% Link Up: Te1/0/3
<189> Dec 9 11:39:36 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5724 %% Link on Te1/0/3 is failed
<189> Dec 9 11:39:36 10.4.101.83-1 TRAPMGR[1221624372]: traputil.c(697) 5723 %% Link Down: Te1/0/3
Te1/0/3,Te1/0/5,Te1/0/7 belong to 3 different hosts, doesn't look like it's a cable/switch port/nic hardware problem. since it's happening on 3 ports.