===== VMware vSAN Multicast ===== {{tag>VMware vSAN}} Types of vSAN multicast setups that I have tested. These tests we done on my HP v1910-24G switches. I have also done some testing on a pair of VDX 6740 switches, but need to clean up any client info before being added to this list. ==== New Tests 2016-06-05 ==== Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping enabled on both switches and IGMP Querier enabled on only switch 1. * Multicast performance test 27.71 MB/s * Multicast performance test 27.85 MB/s * Multicast performance test 27.96 MB/s * Multicast performance test 28.05 MB/s * Multicast performance test 12.06 MB/s * Multicast performance test 28.02 MB/s * Multicast performance test 28.00 MB/s Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping enabled on both switches and IGMP Querier disabled on both switches. * Multicast performance test 12.03 MB/s * Multicast performance test 28.09 MB/s * Multicast performance test 12.06 MB/s * Multicast performance test 12.04 MB/s Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping disabled on both switches and IGMP Querier disabled on both switches. * Multicast performance test 12.03 MB/s * Multicast performance test 28.06 MB/s * Multicast performance test 27.90 MB/s * Multicast performance test 12.01 MB/s Nerdy Drunk three node vSAN v6.2 on two HP v1910-24G switches with vSAN traffic connected to switch 1. vSAN VLAN is tagged across both switches with IGMP Snooping enabled on only switch 1 and IGMP Querier enabled on only switch 1. * Multicast performance test 28.07 MB/s * Multicast performance test 27.97 MB/s * Multicast performance test 12.05 MB/s * Multicast performance test 28.09 MB/s \\ ==== Old Tests ==== Split multicast, two subnets, isolated switches, two vmks. VSAN-001 Multicast performance 27.73 One multicast, one subnet, one switch, one vmk. VSAN-004 Multicast performance 27.77 VSAN-017 Storage performance stress IOPS Throughput MB/s Average Latency (ms) Maximum Latency (ms) 40.75 0.322 71.91566667 699.0573333 One multicast, one subnet, two switches, two vmks. VSAN-007 Multicast performance 7.63 Two multicast, two subnets, isolated switches, two vmks. VSAN-010 Multicast performance 27.80 VSAN-013 Storage performance stress IOPS Throughput MB/s Average Latency (ms) Maximum Latency (ms) 51.31666667 0.405 59.23133333 761.466 Two multicast, two subnets, isolated switches, two vmks. VSAN 6.2 VSAN-021 Multicast performance 27.93 VSAN-022 Storage performance stress IOPS Throughput MB/s Average Latency (ms) Maximum Latency (ms) 33.11666667 0.2625 90.08566667 475.3316667 esxcli vsan network ipv4 set -i vmk2 -d 224.2.3.6 -u 224.1.2.5 Switch usage graphs {{gallery>images:vmware?switch-*.png&lightbox}} ---- http://www.vmware.com/files/pdf/products/vsan/VMware-Virtual-SAN-Network-Design-Guide.pdf ==== Testing Multicast Connectivity ==== On host 1 run the following to monitor for VSAN multicast traffic; [root@matx01vmvh01:~] tcpdump-uw -i vmk1 -n -s0 -t -c 20 udp port 12345 or udp port 23451 On host 2 run the following to generate example VSAN multicast traffic; [root@matx01vmvh02:~] nc -uz -s 10.2.6.82 224.2.3.4 23451 If vSAN is up and running, you should see multicast traffic from all hosts in the vSAN cluster on the same layer 2 segment. **Some [[brocade:icx-multicast|switches]] will require static multicast groups for 224.1.2.3 and 224.2.3.4. or to have multicast forced to version 3**