Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test Hash-Policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run the command interfaces bonding show on DUT0 and check whether the output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
fe80::dcad:beff:feef:6c00/64

Step 4: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.95

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Step 5: Ping the IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=421 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 421.250/421.250/421.250/0.000 ms

Step 6: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.95

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Step 7: Run the command interfaces ethernet clear on DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect the following output on DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 39950 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 39964 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 39980 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 39990 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 39998 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 40006 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 40014 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 40028 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 40032 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 40042 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  11.4 MBytes  95.7 Mbits/sec   36    116 KBytes
[  7]   0.00-1.00   sec  29.2 MBytes   245 Mbits/sec  108    197 KBytes
[  9]   0.00-1.00   sec  25.9 MBytes   217 Mbits/sec  125    171 KBytes
[ 11]   0.00-1.00   sec  23.0 MBytes   193 Mbits/sec   97    201 KBytes
[ 13]   0.00-1.00   sec  26.1 MBytes   219 Mbits/sec   89    153 KBytes
[ 15]   0.00-1.00   sec  20.7 MBytes   173 Mbits/sec   50    119 KBytes
[ 17]   0.00-1.00   sec  23.4 MBytes   196 Mbits/sec   42    201 KBytes
[ 19]   0.00-1.00   sec  29.9 MBytes   251 Mbits/sec   91    197 KBytes
[ 21]   0.00-1.00   sec  22.8 MBytes   191 Mbits/sec   99    205 KBytes
[ 23]   0.00-1.00   sec  25.6 MBytes   214 Mbits/sec  144    199 KBytes
[SUM]   0.00-1.00   sec   238 MBytes  2.00 Gbits/sec  881
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  17.2 MBytes   144 Mbits/sec   44    148 KBytes
[  7]   1.00-2.00   sec  18.1 MBytes   152 Mbits/sec   45    180 KBytes
[  9]   1.00-2.00   sec  18.1 MBytes   152 Mbits/sec    0    221 KBytes
[ 11]   1.00-2.00   sec  17.5 MBytes   147 Mbits/sec   70    182 KBytes
[ 13]   1.00-2.00   sec  17.3 MBytes   145 Mbits/sec    0    216 KBytes
[ 15]   1.00-2.00   sec  16.9 MBytes   142 Mbits/sec    0    192 KBytes
[ 17]   1.00-2.00   sec  17.5 MBytes   147 Mbits/sec   73    187 KBytes
[ 19]   1.00-2.00   sec  17.8 MBytes   150 Mbits/sec    0    243 KBytes
[ 21]   1.00-2.00   sec  17.8 MBytes   150 Mbits/sec   60    189 KBytes
[ 23]   1.00-2.00   sec  18.0 MBytes   151 Mbits/sec   73    187 KBytes
[SUM]   1.00-2.00   sec   176 MBytes  1.48 Gbits/sec  365
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  20.5 MBytes   172 Mbits/sec   14    191 KBytes
[  7]   2.00-3.00   sec  21.1 MBytes   177 Mbits/sec   76    187 KBytes
[  9]   2.00-3.00   sec  21.1 MBytes   177 Mbits/sec   63    164 KBytes
[ 11]   2.00-3.00   sec  20.1 MBytes   169 Mbits/sec   23    156 KBytes
[ 13]   2.00-3.00   sec  18.3 MBytes   154 Mbits/sec   15    132 KBytes
[ 15]   2.00-3.00   sec  21.6 MBytes   181 Mbits/sec   78    208 KBytes
[ 17]   2.00-3.00   sec  21.1 MBytes   177 Mbits/sec   66    189 KBytes
[ 19]   2.00-3.00   sec  20.6 MBytes   173 Mbits/sec   89    175 KBytes
[ 21]   2.00-3.00   sec  17.8 MBytes   149 Mbits/sec   40    119 KBytes
[ 23]   2.00-3.00   sec  18.9 MBytes   158 Mbits/sec   70    154 KBytes
[SUM]   2.00-3.00   sec   201 MBytes  1.69 Gbits/sec  534
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  19.2 MBytes   161 Mbits/sec   69    136 KBytes
[  7]   3.00-4.00   sec  17.8 MBytes   150 Mbits/sec   41    140 KBytes
[  9]   3.00-4.00   sec  18.2 MBytes   153 Mbits/sec   29    122 KBytes
[ 11]   3.00-4.00   sec  18.8 MBytes   158 Mbits/sec   17    158 KBytes
[ 13]   3.00-4.00   sec  19.3 MBytes   162 Mbits/sec    0    208 KBytes
[ 15]   3.00-4.00   sec  15.3 MBytes   128 Mbits/sec   40    132 KBytes
[ 17]   3.00-4.00   sec  19.6 MBytes   164 Mbits/sec   35    175 KBytes
[ 19]   3.00-4.00   sec  18.9 MBytes   158 Mbits/sec   61    165 KBytes
[ 21]   3.00-4.00   sec  17.7 MBytes   149 Mbits/sec    5    143 KBytes
[ 23]   3.00-4.00   sec  18.3 MBytes   153 Mbits/sec   25    156 KBytes
[SUM]   3.00-4.00   sec   183 MBytes  1.54 Gbits/sec  322
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  21.9 MBytes   184 Mbits/sec    6    191 KBytes
[  7]   4.00-5.00   sec  23.8 MBytes   200 Mbits/sec    0    229 KBytes
[  9]   4.00-5.00   sec  21.4 MBytes   180 Mbits/sec   12    182 KBytes
[ 11]   4.00-5.00   sec  23.1 MBytes   193 Mbits/sec    9    192 KBytes
[ 13]   4.00-5.00   sec  23.2 MBytes   194 Mbits/sec   28    204 KBytes
[ 15]   4.00-5.00   sec  22.4 MBytes   188 Mbits/sec    0    219 KBytes
[ 17]   4.00-5.00   sec  22.6 MBytes   190 Mbits/sec   14    195 KBytes
[ 19]   4.00-5.00   sec  22.8 MBytes   191 Mbits/sec   10    194 KBytes
[ 21]   4.00-5.00   sec  22.4 MBytes   188 Mbits/sec    5    163 KBytes
[ 23]   4.00-5.00   sec  22.9 MBytes   192 Mbits/sec   20    167 KBytes
[SUM]   4.00-5.00   sec   227 MBytes  1.90 Gbits/sec  104
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec  90.2 MBytes   151 Mbits/sec  169             sender
[  5]   0.00-5.01   sec  89.1 MBytes   149 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   110 MBytes   185 Mbits/sec  270             sender
[  7]   0.00-5.01   sec   108 MBytes   181 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   105 MBytes   176 Mbits/sec  229             sender
[  9]   0.00-5.01   sec   103 MBytes   173 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   102 MBytes   172 Mbits/sec  216             sender
[ 11]   0.00-5.01   sec   101 MBytes   169 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   104 MBytes   175 Mbits/sec  132             sender
[ 13]   0.00-5.01   sec   102 MBytes   171 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec  96.9 MBytes   163 Mbits/sec  168             sender
[ 15]   0.00-5.01   sec  95.6 MBytes   160 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   104 MBytes   175 Mbits/sec  230             sender
[ 17]   0.00-5.01   sec   103 MBytes   173 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   110 MBytes   185 Mbits/sec  251             sender
[ 19]   0.00-5.01   sec   108 MBytes   181 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec  98.5 MBytes   165 Mbits/sec  209             sender
[ 21]   0.00-5.01   sec  97.4 MBytes   163 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   104 MBytes   174 Mbits/sec  332             sender
[ 23]   0.00-5.01   sec   101 MBytes   170 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.00 GBytes  1.72 Gbits/sec  2206             sender
[SUM]   0.00-5.01   sec  1009 MBytes  1.69 Gbits/sec                  receiver

iperf Done.

Step 9: Run the command interfaces ethernet show counters on DUT0 and check whether the output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up         98898   6551027          0      734346  1111724905          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run the command interfaces bonding show on DUT0 and check whether the output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
fe80::dcad:beff:feef:6c00/64

Step 12: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.95

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Step 13: Ping the IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.344 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms

Step 14: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.95

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Step 15: Run the command interfaces ethernet clear on DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect the following output on DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 51988 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 52000 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 52002 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 52004 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 52012 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 52022 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 52038 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 52046 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 52060 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 52064 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  23.0 MBytes   192 Mbits/sec    0    451 KBytes
[  7]   0.00-1.00   sec  22.0 MBytes   184 Mbits/sec   52    277 KBytes
[  9]   0.00-1.00   sec  33.9 MBytes   284 Mbits/sec    0    574 KBytes
[ 11]   0.00-1.00   sec  24.0 MBytes   201 Mbits/sec   45    454 KBytes
[ 13]   0.00-1.00   sec  23.9 MBytes   200 Mbits/sec  104    421 KBytes
[ 15]   0.00-1.00   sec  34.2 MBytes   286 Mbits/sec    0    510 KBytes
[ 17]   0.00-1.00   sec  32.7 MBytes   274 Mbits/sec    0    536 KBytes
[ 19]   0.00-1.00   sec  33.0 MBytes   276 Mbits/sec    0    540 KBytes
[ 21]   0.00-1.00   sec  22.3 MBytes   187 Mbits/sec   31    318 KBytes
[ 23]   0.00-1.00   sec  24.1 MBytes   202 Mbits/sec   60    396 KBytes
[SUM]   0.00-1.00   sec   273 MBytes  2.29 Gbits/sec  292
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  19.5 MBytes   164 Mbits/sec  119    386 KBytes
[  7]   1.00-2.00   sec  18.5 MBytes   155 Mbits/sec    0    300 KBytes
[  9]   1.00-2.00   sec  31.8 MBytes   266 Mbits/sec   52    464 KBytes
[ 11]   1.00-2.00   sec  19.5 MBytes   163 Mbits/sec   90    359 KBytes
[ 13]   1.00-2.00   sec  20.4 MBytes   171 Mbits/sec  143    356 KBytes
[ 15]   1.00-2.00   sec  29.3 MBytes   245 Mbits/sec    6    416 KBytes
[ 17]   1.00-2.00   sec  25.7 MBytes   216 Mbits/sec   77    444 KBytes
[ 19]   1.00-2.00   sec  26.4 MBytes   221 Mbits/sec   25    411 KBytes
[ 21]   1.00-2.00   sec  19.1 MBytes   160 Mbits/sec   44    262 KBytes
[ 23]   1.00-2.00   sec  18.5 MBytes   155 Mbits/sec   45    310 KBytes
[SUM]   1.00-2.00   sec   229 MBytes  1.92 Gbits/sec  601
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  21.4 MBytes   180 Mbits/sec   65    301 KBytes
[  7]   2.00-3.00   sec  19.9 MBytes   167 Mbits/sec    0    321 KBytes
[  9]   2.00-3.00   sec  37.5 MBytes   316 Mbits/sec    0    529 KBytes
[ 11]   2.00-3.00   sec  21.0 MBytes   177 Mbits/sec    0    385 KBytes
[ 13]   2.00-3.00   sec  19.7 MBytes   166 Mbits/sec   45    281 KBytes
[ 15]   2.00-3.00   sec  35.5 MBytes   299 Mbits/sec    0    474 KBytes
[ 17]   2.00-3.00   sec  32.5 MBytes   273 Mbits/sec    0    494 KBytes
[ 19]   2.00-3.00   sec  30.8 MBytes   259 Mbits/sec    0    502 KBytes
[ 21]   2.00-3.00   sec  19.3 MBytes   162 Mbits/sec    5    230 KBytes
[ 23]   2.00-3.00   sec  20.0 MBytes   168 Mbits/sec    0    329 KBytes
[SUM]   2.00-3.00   sec   258 MBytes  2.17 Gbits/sec  115
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  21.4 MBytes   180 Mbits/sec    0    321 KBytes
[  7]   3.00-4.00   sec  22.1 MBytes   186 Mbits/sec    0    351 KBytes
[  9]   3.00-4.00   sec  36.4 MBytes   305 Mbits/sec    0    561 KBytes
[ 11]   3.00-4.00   sec  22.1 MBytes   186 Mbits/sec    0    399 KBytes
[ 13]   3.00-4.00   sec  21.8 MBytes   183 Mbits/sec    0    294 KBytes
[ 15]   3.00-4.00   sec  35.1 MBytes   294 Mbits/sec    0    502 KBytes
[ 17]   3.00-4.00   sec  32.4 MBytes   272 Mbits/sec    0    518 KBytes
[ 19]   3.00-4.00   sec  30.9 MBytes   259 Mbits/sec    0    527 KBytes
[ 21]   3.00-4.00   sec  21.3 MBytes   179 Mbits/sec    0    270 KBytes
[ 23]   3.00-4.00   sec  21.8 MBytes   183 Mbits/sec    0    339 KBytes
[SUM]   3.00-4.00   sec   265 MBytes  2.23 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  26.8 MBytes   225 Mbits/sec    0    331 KBytes
[  7]   4.00-5.00   sec  25.5 MBytes   214 Mbits/sec   45    284 KBytes
[  9]   4.00-5.00   sec  41.5 MBytes   348 Mbits/sec   61    413 KBytes
[ 11]   4.00-5.00   sec  25.6 MBytes   215 Mbits/sec    2    307 KBytes
[ 13]   4.00-5.00   sec  25.0 MBytes   210 Mbits/sec   29    255 KBytes
[ 15]   4.00-5.00   sec  40.4 MBytes   339 Mbits/sec   45    369 KBytes
[ 17]   4.00-5.00   sec  38.9 MBytes   327 Mbits/sec   83    386 KBytes
[ 19]   4.00-5.00   sec  35.8 MBytes   300 Mbits/sec   90    393 KBytes
[ 21]   4.00-5.00   sec  24.5 MBytes   206 Mbits/sec    0    297 KBytes
[ 23]   4.00-5.00   sec  24.9 MBytes   209 Mbits/sec   16    273 KBytes
[SUM]   4.00-5.00   sec   309 MBytes  2.59 Gbits/sec  371
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   112 MBytes   188 Mbits/sec  184             sender
[  5]   0.00-5.01   sec   110 MBytes   184 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   108 MBytes   181 Mbits/sec   97             sender
[  7]   0.00-5.01   sec   107 MBytes   179 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   181 MBytes   304 Mbits/sec  113             sender
[  9]   0.00-5.01   sec   178 MBytes   298 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   112 MBytes   188 Mbits/sec  137             sender
[ 11]   0.00-5.01   sec   110 MBytes   184 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   111 MBytes   186 Mbits/sec  321             sender
[ 13]   0.00-5.01   sec   108 MBytes   181 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   174 MBytes   293 Mbits/sec   51             sender
[ 15]   0.00-5.01   sec   172 MBytes   287 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   162 MBytes   272 Mbits/sec  160             sender
[ 17]   0.00-5.01   sec   160 MBytes   267 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   157 MBytes   263 Mbits/sec  115             sender
[ 19]   0.00-5.01   sec   155 MBytes   259 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   107 MBytes   179 Mbits/sec   80             sender
[ 21]   0.00-5.01   sec   105 MBytes   176 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   109 MBytes   183 Mbits/sec  121             sender
[ 23]   0.00-5.01   sec   107 MBytes   179 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.30 GBytes  2.24 Gbits/sec  1379             sender
[SUM]   0.00-5.01   sec  1.28 GBytes  2.19 Gbits/sec                  receiver

iperf Done.

Step 17: Run the command interfaces ethernet show counters on DUT0 and check whether the output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
-----------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets  Tx Bytes   Tx Errors
-----------------------------------------------------------------------------
eth0  up         48209   3188688          0      482625  730595664          0
eth1  up         38896   2581519          0      470732  712566886          0
eth2  down           0         0          0           0          0          0
eth3  down           0         0          0           0          0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.