We have a situation where it appears that all traffic communicating over our 8024F and 5524 switches is transferring at 100Mbps.
I'm not a networking guy and we outsource our networking to consultants who have not been available to help much, so I'm hoping I can find some guidance here.
Our configuration is as follows:
Two 8024F switches connected to two Equalogic 6010 SANs.
Two 5524F switches connected to the 8024Fs, as well as a Cisco 5520 ASA.
Four Dell R610 servers running VMWare 5.5 these are connected to both the 8024F and the 5524F
The 5524F switches connect to three 100Mb interfaces; one for an EPL to our office from the datacenter, one for internet, and one to backup datacenter.
iSCSI for Dell hosts is directly connected to the 8024F, and the ethernet ports on the Dell servers are connected to the 5524F - ethernet was set up primarly as a backup network.
There are several VLANs; one for iSCSI, one for VMotion, several for segmented data networks, and one for the backup network. All of the ports on the 5524 are trunked; VLANs are defined on the ASA.
What we're seeing is that throughput to the Equalogics is maxed out to 100Mbps. I ran a SQL backup this morning and it was only doing 12MB/s which equates to about 96Mbps, and I saw high disk queue length on the server itself and in VMWare.
Monitoring through Solarwinds of the 5524F shows several 1Gbps interfaces all hitting *exactly* 10% utilization. All of this transmit data; virtually nothing being received.
Oddly, the vSwitch on VMWare for the backup interface (connected to ethernet) shows tons of receive traffic even though the particular host I was monitoring has no guests configured for that network.
Finally, I ran a packet capture on the VMWare host and saw a ton of iSCSI traffic...obviously nothing on that interface accepted the traffic as there is another vSwitch dedicated to iSCSI at 10Gbps.
Our network consultant did suggest that we define all of the 5524 ports for specific VLANs which sounds right. He looked at the spanning tree configuration and said everything looks good there.
But what I can't understand is why everything seems to be pegged at 100Mbps; none of the 100Mbps show any significant traffic; all of the traffic seems to be over the 1Gbps interfaces.
Thanks for any help you folks can provide!
Eric
