Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=439 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 439.322/439.322/439.322/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 50458 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 50474 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 50480 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 50482 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 50490 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 50506 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 50516 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 50520 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 50524 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 50534 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  18.6 MBytes   156 Mbits/sec    0    300 KBytes
[  7]   0.00-1.00   sec  18.7 MBytes   157 Mbits/sec    0    301 KBytes
[  9]   0.00-1.00   sec  18.9 MBytes   159 Mbits/sec    0    341 KBytes
[ 11]   0.00-1.00   sec  17.7 MBytes   149 Mbits/sec    0    300 KBytes
[ 13]   0.00-1.00   sec  18.7 MBytes   157 Mbits/sec    0    331 KBytes
[ 15]   0.00-1.00   sec  18.9 MBytes   159 Mbits/sec    0    317 KBytes
[ 17]   0.00-1.00   sec  19.7 MBytes   165 Mbits/sec    0    392 KBytes
[ 19]   0.00-1.00   sec  18.9 MBytes   158 Mbits/sec    0    328 KBytes
[ 21]   0.00-1.00   sec  18.8 MBytes   157 Mbits/sec    0    329 KBytes
[ 23]   0.00-1.00   sec  19.0 MBytes   160 Mbits/sec    0    300 KBytes
[SUM]   0.00-1.00   sec   188 MBytes  1.58 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  19.3 MBytes   162 Mbits/sec   90    264 KBytes
[  7]   1.00-2.00   sec  19.8 MBytes   166 Mbits/sec   50    274 KBytes
[  9]   1.00-2.00   sec  19.9 MBytes   167 Mbits/sec   66    298 KBytes
[ 11]   1.00-2.00   sec  19.4 MBytes   163 Mbits/sec   76    264 KBytes
[ 13]   1.00-2.00   sec  19.6 MBytes   164 Mbits/sec   91    222 KBytes
[ 15]   1.00-2.00   sec  18.8 MBytes   157 Mbits/sec   74    221 KBytes
[ 17]   1.00-2.00   sec  19.3 MBytes   162 Mbits/sec   32    239 KBytes
[ 19]   1.00-2.00   sec  19.5 MBytes   163 Mbits/sec   17    280 KBytes
[ 21]   1.00-2.00   sec  18.8 MBytes   158 Mbits/sec   93    225 KBytes
[ 23]   1.00-2.00   sec  18.5 MBytes   155 Mbits/sec  100    215 KBytes
[SUM]   1.00-2.00   sec   193 MBytes  1.62 Gbits/sec  689
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  26.2 MBytes   220 Mbits/sec   16    235 KBytes
[  7]   2.00-3.00   sec  27.9 MBytes   234 Mbits/sec    0    308 KBytes
[  9]   2.00-3.00   sec  28.2 MBytes   237 Mbits/sec    0    334 KBytes
[ 11]   2.00-3.00   sec  27.3 MBytes   229 Mbits/sec    0    294 KBytes
[ 13]   2.00-3.00   sec  26.7 MBytes   224 Mbits/sec    0    274 KBytes
[ 15]   2.00-3.00   sec  27.4 MBytes   230 Mbits/sec    0    270 KBytes
[ 17]   2.00-3.00   sec  26.8 MBytes   225 Mbits/sec    0    281 KBytes
[ 19]   2.00-3.00   sec  26.2 MBytes   219 Mbits/sec   36    243 KBytes
[ 21]   2.00-3.00   sec  27.1 MBytes   227 Mbits/sec    0    272 KBytes
[ 23]   2.00-3.00   sec  26.5 MBytes   222 Mbits/sec    0    269 KBytes
[SUM]   2.00-3.00   sec   270 MBytes  2.27 Gbits/sec   52
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  39.3 MBytes   330 Mbits/sec   71    167 KBytes
[  7]   3.00-4.00   sec  39.9 MBytes   335 Mbits/sec   57    212 KBytes
[  9]   3.00-4.00   sec  41.7 MBytes   350 Mbits/sec   97    215 KBytes
[ 11]   3.00-4.00   sec  38.1 MBytes   320 Mbits/sec   86    170 KBytes
[ 13]   3.00-4.00   sec  41.0 MBytes   344 Mbits/sec   96    250 KBytes
[ 15]   3.00-4.00   sec  38.1 MBytes   320 Mbits/sec   76    202 KBytes
[ 17]   3.00-4.00   sec  39.9 MBytes   335 Mbits/sec   62    249 KBytes
[ 19]   3.00-4.00   sec  36.2 MBytes   304 Mbits/sec   57    201 KBytes
[ 21]   3.00-4.00   sec  37.3 MBytes   313 Mbits/sec   59    198 KBytes
[ 23]   3.00-4.00   sec  39.8 MBytes   334 Mbits/sec  105    219 KBytes
[SUM]   3.00-4.00   sec   391 MBytes  3.28 Gbits/sec  766
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  33.0 MBytes   277 Mbits/sec   45    206 KBytes
[  7]   4.00-5.00   sec  33.9 MBytes   284 Mbits/sec   87    178 KBytes
[  9]   4.00-5.00   sec  33.9 MBytes   284 Mbits/sec   81    178 KBytes
[ 11]   4.00-5.00   sec  35.6 MBytes   299 Mbits/sec    8    211 KBytes
[ 13]   4.00-5.00   sec  32.8 MBytes   275 Mbits/sec   86    177 KBytes
[ 15]   4.00-5.00   sec  33.9 MBytes   285 Mbits/sec   37    215 KBytes
[ 17]   4.00-5.00   sec  35.0 MBytes   293 Mbits/sec   86    225 KBytes
[ 19]   4.00-5.00   sec  33.2 MBytes   279 Mbits/sec   82    212 KBytes
[ 21]   4.00-5.00   sec  36.5 MBytes   306 Mbits/sec    0    276 KBytes
[ 23]   4.00-5.00   sec  32.3 MBytes   271 Mbits/sec   90    178 KBytes
[SUM]   4.00-5.00   sec   340 MBytes  2.85 Gbits/sec  602
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   136 MBytes   229 Mbits/sec  222             sender
[  5]   0.00-5.01   sec   135 MBytes   226 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   140 MBytes   235 Mbits/sec  194             sender
[  7]   0.00-5.01   sec   139 MBytes   232 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   143 MBytes   239 Mbits/sec  244             sender
[  9]   0.00-5.01   sec   141 MBytes   235 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   138 MBytes   232 Mbits/sec  170             sender
[ 11]   0.00-5.01   sec   136 MBytes   229 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   139 MBytes   233 Mbits/sec  273             sender
[ 13]   0.00-5.01   sec   137 MBytes   230 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   137 MBytes   230 Mbits/sec  187             sender
[ 15]   0.00-5.01   sec   135 MBytes   227 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   141 MBytes   236 Mbits/sec  180             sender
[ 17]   0.00-5.01   sec   138 MBytes   232 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   134 MBytes   225 Mbits/sec  192             sender
[ 19]   0.00-5.01   sec   132 MBytes   222 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   138 MBytes   232 Mbits/sec  152             sender
[ 21]   0.00-5.01   sec   137 MBytes   229 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   136 MBytes   228 Mbits/sec  295             sender
[ 23]   0.00-5.01   sec   135 MBytes   226 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.35 GBytes  2.32 Gbits/sec  2109             sender
[SUM]   0.00-5.01   sec  1.33 GBytes  2.29 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        113066   7484843          0      992642  1502790843          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.465 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.465/0.465/0.465/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 50546 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 50558 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 50570 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 50580 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 50584 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 50588 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 50604 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 50606 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 50620 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 50626 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  52.7 MBytes   442 Mbits/sec  193    181 KBytes
[  7]   0.00-1.00   sec  44.2 MBytes   370 Mbits/sec  261    146 KBytes
[  9]   0.00-1.00   sec  42.1 MBytes   353 Mbits/sec  248    105 KBytes
[ 11]   0.00-1.00   sec  51.5 MBytes   432 Mbits/sec  121    225 KBytes
[ 13]   0.00-1.00   sec  35.4 MBytes   297 Mbits/sec  108    181 KBytes
[ 15]   0.00-1.00   sec  50.5 MBytes   424 Mbits/sec   77    257 KBytes
[ 17]   0.00-1.00   sec  36.4 MBytes   305 Mbits/sec  177    167 KBytes
[ 19]   0.00-1.00   sec  26.6 MBytes   223 Mbits/sec   75    106 KBytes
[ 21]   0.00-1.00   sec  34.3 MBytes   288 Mbits/sec   48    175 KBytes
[ 23]   0.00-1.00   sec  45.8 MBytes   385 Mbits/sec  167    177 KBytes
[SUM]   0.00-1.00   sec   419 MBytes  3.52 Gbits/sec  1475
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  51.2 MBytes   429 Mbits/sec   66    202 KBytes
[  7]   1.00-2.00   sec  45.7 MBytes   383 Mbits/sec   26    215 KBytes
[  9]   1.00-2.00   sec  43.8 MBytes   367 Mbits/sec   21    222 KBytes
[ 11]   1.00-2.00   sec  54.2 MBytes   454 Mbits/sec  128    700 KBytes
[ 13]   1.00-2.00   sec  33.8 MBytes   284 Mbits/sec   14    223 KBytes
[ 15]   1.00-2.00   sec  38.6 MBytes   324 Mbits/sec   18    249 KBytes
[ 17]   1.00-2.00   sec  34.6 MBytes   290 Mbits/sec    0    269 KBytes
[ 19]   1.00-2.00   sec  38.5 MBytes   323 Mbits/sec   11    205 KBytes
[ 21]   1.00-2.00   sec  32.3 MBytes   271 Mbits/sec   38    218 KBytes
[ 23]   1.00-2.00   sec  48.7 MBytes   409 Mbits/sec   32    205 KBytes
[SUM]   1.00-2.00   sec   421 MBytes  3.53 Gbits/sec  354
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  33.2 MBytes   279 Mbits/sec   81    209 KBytes
[  7]   2.00-3.00   sec  44.1 MBytes   370 Mbits/sec   45    208 KBytes
[  9]   2.00-3.00   sec  32.5 MBytes   273 Mbits/sec   47    228 KBytes
[ 11]   2.00-3.00   sec  40.0 MBytes   336 Mbits/sec  319    266 KBytes
[ 13]   2.00-3.00   sec  28.5 MBytes   239 Mbits/sec  116   1.41 KBytes
[ 15]   2.00-3.00   sec  43.6 MBytes   366 Mbits/sec  172    192 KBytes
[ 17]   2.00-3.00   sec  35.9 MBytes   301 Mbits/sec   76    195 KBytes
[ 19]   2.00-3.00   sec  35.1 MBytes   295 Mbits/sec   44    223 KBytes
[ 21]   2.00-3.00   sec  42.5 MBytes   357 Mbits/sec  117    230 KBytes
[ 23]   2.00-3.00   sec  42.8 MBytes   359 Mbits/sec   42    201 KBytes
[SUM]   2.00-3.00   sec   378 MBytes  3.17 Gbits/sec  1059
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  47.3 MBytes   397 Mbits/sec   47    170 KBytes
[  7]   3.00-4.00   sec  46.6 MBytes   391 Mbits/sec   61    170 KBytes
[  9]   3.00-4.00   sec  45.0 MBytes   377 Mbits/sec   76    170 KBytes
[ 11]   3.00-4.00   sec  36.2 MBytes   304 Mbits/sec  141    232 KBytes
[ 13]   3.00-4.00   sec  46.8 MBytes   393 Mbits/sec   27    291 KBytes
[ 15]   3.00-4.00   sec  31.1 MBytes   261 Mbits/sec   66   53.7 KBytes
[ 17]   3.00-4.00   sec  32.6 MBytes   273 Mbits/sec   95   65.0 KBytes
[ 19]   3.00-4.00   sec  31.3 MBytes   263 Mbits/sec   29   24.0 KBytes
[ 21]   3.00-4.00   sec  47.2 MBytes   396 Mbits/sec   78    156 KBytes
[ 23]   3.00-4.00   sec  47.4 MBytes   397 Mbits/sec    9    168 KBytes
[SUM]   3.00-4.00   sec   411 MBytes  3.45 Gbits/sec  629
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  48.6 MBytes   408 Mbits/sec   42    222 KBytes
[  7]   4.00-5.00   sec  46.3 MBytes   388 Mbits/sec   10    228 KBytes
[  9]   4.00-5.00   sec  38.8 MBytes   325 Mbits/sec   31    185 KBytes
[ 11]   4.00-5.00   sec  47.5 MBytes   398 Mbits/sec   45    222 KBytes
[ 13]   4.00-5.00   sec  50.8 MBytes   426 Mbits/sec   92    201 KBytes
[ 15]   4.00-5.00   sec  22.7 MBytes   191 Mbits/sec   92    139 KBytes
[ 17]   4.00-5.00   sec  22.4 MBytes   188 Mbits/sec   57    103 KBytes
[ 19]   4.00-5.00   sec  20.1 MBytes   168 Mbits/sec   16   97.6 KBytes
[ 21]   4.00-5.00   sec  43.3 MBytes   363 Mbits/sec   23    158 KBytes
[ 23]   4.00-5.00   sec  44.7 MBytes   375 Mbits/sec  108    225 KBytes
[SUM]   4.00-5.00   sec   385 MBytes  3.23 Gbits/sec  516
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   233 MBytes   391 Mbits/sec  429             sender
[  5]   0.00-5.00   sec   229 MBytes   385 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   227 MBytes   381 Mbits/sec  403             sender
[  7]   0.00-5.00   sec   223 MBytes   374 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   202 MBytes   339 Mbits/sec  423             sender
[  9]   0.00-5.00   sec   199 MBytes   334 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   229 MBytes   385 Mbits/sec  754             sender
[ 11]   0.00-5.00   sec   225 MBytes   377 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   195 MBytes   328 Mbits/sec  357             sender
[ 13]   0.00-5.00   sec   192 MBytes   322 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   187 MBytes   313 Mbits/sec  425             sender
[ 15]   0.00-5.00   sec   184 MBytes   309 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   162 MBytes   271 Mbits/sec  405             sender
[ 17]   0.00-5.00   sec   160 MBytes   269 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   152 MBytes   254 Mbits/sec  175             sender
[ 19]   0.00-5.00   sec   151 MBytes   253 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   200 MBytes   335 Mbits/sec  304             sender
[ 21]   0.00-5.00   sec   198 MBytes   332 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   229 MBytes   385 Mbits/sec  358             sender
[ 23]   0.00-5.00   sec   226 MBytes   380 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.97 GBytes  3.38 Gbits/sec  4033             sender
[SUM]   0.00-5.00   sec  1.94 GBytes  3.33 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up         98934   6562671          0      750202  1135349777          0
eth1  up         98609   6538442          0      699619  1058957255          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.