Types of vSAN multicast setups that I have tested. These tests we done on my HP v1910-24G switches. I have also done some testing on a pair of VDX 6740 switches, but need to clean up any client info before being added to this list.
Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping enabled on both switches and IGMP Querier enabled on only switch 1.
Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping enabled on both switches and IGMP Querier disabled on both switches.
Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping disabled on both switches and IGMP Querier disabled on both switches.
Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping enabled on only switch 1 and IGMP Querier enabled on only switch 1.
Split multicast, two subnets, isolated switches, two vmks. VSAN-001 Multicast performance 27.73 One multicast, one subnet, one switch, one vmk. VSAN-004 Multicast performance 27.77 VSAN-017 Storage performance stress IOPS Throughput MB/s Average Latency (ms) Maximum Latency (ms) 40.75 0.322 71.91566667 699.0573333 One multicast, one subnet, two switches, two vmks. VSAN-007 Multicast performance 7.63 Two multicast, two subnets, isolated switches, two vmks. VSAN-010 Multicast performance 27.80 VSAN-013 Storage performance stress IOPS Throughput MB/s Average Latency (ms) Maximum Latency (ms) 51.31666667 0.405 59.23133333 761.466 Two multicast, two subnets, isolated switches, two vmks. VSAN 6.2 VSAN-021 Multicast performance 27.93 VSAN-022 Storage performance stress IOPS Throughput MB/s Average Latency (ms) Maximum Latency (ms) 33.11666667 0.2625 90.08566667 475.3316667 esxcli vsan network ipv4 set -i vmk2 -d 224.2.3.6 -u 224.1.2.5
Switch usage graphs images:vmware
http://www.vmware.com/files/pdf/products/vsan/VMware-Virtual-SAN-Network-Design-Guide.pdf
On host 1 run the following to monitor for VSAN multicast traffic;
[root@matx01vmvh01:~] tcpdump-uw -i vmk1 -n -s0 -t -c 20 udp port 12345 or udp port 23451
On host 2 run the following to generate example VSAN multicast traffic;
[root@matx01vmvh02:~] nc -uz -s 10.2.6.82 224.2.3.4 23451
If vSAN is up and running, you should see multicast traffic from all hosts in the vSAN cluster on the same layer 2 segment. Some switches will require static multicast groups for 224.1.2.3 and 224.2.3.4. or to have multicast forced to version 3