FreeBSD 11.2RでConnectX-3 Pro ENで40GBASE-SR4環境を構築

  • FreeBSD 11.2-RELEASE-p7
  • Mellanox ConnectX-3 Pro EN (MCX314A-BCCT)
  • Mellanox Firmware Tools (MFT) 4.11.0

FreeBSD 10.4-RELEASEあたりから、ConnectX用のカーネルモジュールがGENERICに含まれるようになったため、mlx4enをkldloadするだけで使える。なお、以前のバージョンではmlx4とmlxenの2つに分かれていたっぽい。

mlx4enがConnectX-3以前用のモジュールで、mlx5enがConnectX-4以降用のモジュールとなる。大変に紛らわしい。

# kldload mlx4en
# echo 'mlx4en_load="YES"' >> /boot/loader.conf

正しく動いてればNICとしてmlxenが生えてくる。

$ ifconfig
mlxen0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=ed07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether e4:1d:2d:xx:yy:e0
        hwaddr e4:1d:2d:xx:yy:e0
        inet 192.168.123.1 netmask 0xffffff00 broadcast 192.168.123.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (40Gbase-CR4 <full-duplex,rxpause,txpause>)
        status: active
mlxen1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=ed07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether e4:1d:2d:xx:yy:e1
        hwaddr e4:1d:2d:xx:yy:e1
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier

Mellanox Firmware Tools (MFT)かmlxupを使ってカードのファームウェアの更新を行う。mlxupの方がコマンド一発で自動更新してくれて便利なんだけど、存在を知らずにMFTを使ってしまった…。MFTの方がいろいろユーティリティ付いてて良いんだもんね!(負け惜しみ

  1. MFTの動作にはpython2と/usr/bin/bashにbashが必要なので準備しておく。
  2. http://www.mellanox.com/page/management_toolsからFreeBSD用のMFTを落として展開。
    1. ちなみにmlxupはこっち→http://www.mellanox.com/page/mlxup_firmware_tool
  3. install.shを実行してインストール

FreeBSDの作法を無視して/usr/binに色々インストールしやがるけど気にしない。

無事インストールできれば、mst statusでカードの状態が表示される。

$ mst status
MST devices:
------------
  pci0:2:0:0    -       MT27520 Family [ConnectX-3 Pro]

カードの詳細情報を確認。-dの引数にはmst statusで得られたPCIバスを与える。

# flint -d pci0:2:0:0 q
Image type:            FS2
FW Version:            2.32.5100
FW Release Date:       3.9.2014
Product Version:       02.32.51.00
Rom Info:              type=PXE version=3.4.306 proto=ETH
Device ID:             4103
Description:           Node             Port1            Port2            Sys image
GUIDs:                 ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
MACs:                                       e41d2dxxyye0     e41d2dxxyye1
VSD:
PSID:                  MT_1090111023

ファームウェアの更新。

ファームはhttp://www.mellanox.com/page/firmware_downloadから当該カードを選んで落としてくだしあ。

# flint -d pci0:2:0:0 -i fw-ConnectX3Pro-rel-2_42_5000-MCX314A-BCC_Ax-FlexBoot-3.4.752.bin b

    Current FW version on flash:  2.32.5100
    New FW version:               2.42.5000

Burning FS2 FW image without signatures - OK
Restoring signature                     - OK

マシンを再起動して正しくファームが更新されてるか確認。

# flint -d pci0:2:0:0 q
パスワード:
Image type:            FS2
FW Version:            2.42.5000
FW Release Date:       5.9.2017
Product Version:       02.42.50.00
Rom Info:              type=PXE version=3.4.752
Device ID:             4103
Description:           Node             Port1            Port2            Sys image
GUIDs:                 ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
MACs:                                       e41d2dxxyye0     e41d2dxxyye1
VSD:
PSID:                  MT_1090111023

同じカードを搭載したWindowsクライアントとの間でiperfしてみる。サバクラの構成は下表のとおり。

サーバ クライアント
OS FreeBSD 11.2-RELEASE (x64) Windows 10 Pro. (x64)
M/B Supermicro X10DRi MSI X370 SLI PLUS
CPU Xeon E5-2648L v3 @1.8GHz ×2 Ryzen 7 1700 @3.0GHz
RAM Registered DDR4-2400 16GB×4 (2133MHz駆動) DDR4-2666 8GB×4
NIC接続 PCIe 3.0 x8 (CPU1側のx16に接続) PCIe 3.0 x8
PCIe 2.0 x4

iperf中の様子をタスクマネージャで見ると↓こんな感じ。瞬間風速20Gbpsがアツい。

クライアント側NICをPCI Express 2.0 x4接続した時の結果。

バス帯域が片方向20Gbpsのためか、ジャンボフレームにしても11Gbps止まりとなった。

MTU=1500

> iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 50129 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   848 MBytes  7.12 Gbits/sec
[  4]   1.00-2.00   sec  1.02 GBytes  8.73 Gbits/sec
[  4]   2.00-3.00   sec  1.03 GBytes  8.89 Gbits/sec
[  4]   3.00-4.00   sec  1.03 GBytes  8.82 Gbits/sec
[  4]   4.00-5.00   sec   984 MBytes  8.25 Gbits/sec
[  4]   5.00-6.00   sec   844 MBytes  7.08 Gbits/sec
[  4]   6.00-7.00   sec  1.07 GBytes  9.15 Gbits/sec
[  4]   7.00-8.00   sec  1.08 GBytes  9.29 Gbits/sec
[  4]   8.00-9.00   sec  1.08 GBytes  9.31 Gbits/sec
[  4]   9.00-10.00  sec  1.02 GBytes  8.76 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  9.94 GBytes  8.54 Gbits/sec                  sender
[  4]   0.00-10.00  sec  9.94 GBytes  8.54 Gbits/sec                  receiver

iperf Done.

MTU=9000

> iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 64419 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  1.23 GBytes  10.6 Gbits/sec
[  4]   1.00-2.00   sec  1.30 GBytes  11.1 Gbits/sec
[  4]   2.00-3.00   sec  1.30 GBytes  11.2 Gbits/sec
[  4]   3.00-4.00   sec  1.30 GBytes  11.2 Gbits/sec
[  4]   4.00-5.00   sec  1.30 GBytes  11.2 Gbits/sec
[  4]   5.00-6.00   sec  1.29 GBytes  11.1 Gbits/sec
[  4]   6.00-7.00   sec  1.27 GBytes  10.9 Gbits/sec
[  4]   7.00-8.00   sec  1.31 GBytes  11.2 Gbits/sec
[  4]   8.00-9.00   sec  1.30 GBytes  11.1 Gbits/sec
[  4]   9.00-10.00  sec  1.30 GBytes  11.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  12.9 GBytes  11.1 Gbits/sec                  sender
[  4]   0.00-10.00  sec  12.9 GBytes  11.1 Gbits/sec                  receiver

iperf Done.

クライアント側NICをPCI Express 3.0 x8接続した時の結果。

バス帯域は片方向64Gbpsとなり、十分な速度が出ている。とはいえ理論値の40Gbpsには及ばない。まだチューニングの余地はありそうだ。

MTU=1500

1スレッド

>iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 52041 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  1.55 GBytes  13.3 Gbits/sec
[  4]   1.00-2.00   sec  1.73 GBytes  14.9 Gbits/sec
[  4]   2.00-3.00   sec  1.70 GBytes  14.6 Gbits/sec
[  4]   3.00-4.00   sec  1.78 GBytes  15.3 Gbits/sec
[  4]   4.00-5.00   sec  1.84 GBytes  15.8 Gbits/sec
[  4]   5.00-6.00   sec  1.83 GBytes  15.7 Gbits/sec
[  4]   6.00-7.00   sec  1.79 GBytes  15.4 Gbits/sec
[  4]   7.00-8.00   sec  1.90 GBytes  16.3 Gbits/sec
[  4]   8.00-9.00   sec  2.26 GBytes  19.4 Gbits/sec
[  4]   9.00-10.00  sec  2.31 GBytes  19.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  18.7 GBytes  16.1 Gbits/sec                  sender
[  4]   0.00-10.00  sec  18.7 GBytes  16.1 Gbits/sec                  receiver

iperf Done.

2スレッド

>iperf3.exe -c 192.168.123.1 -P 2
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 52830 connected to 192.168.123.1 port 5201
[  6] local 192.168.123.2 port 52831 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  1.28 GBytes  11.0 Gbits/sec
[  6]   0.00-1.00   sec  1.27 GBytes  10.9 Gbits/sec
[SUM]   0.00-1.00   sec  2.54 GBytes  21.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  1.41 GBytes  12.1 Gbits/sec
[  6]   1.00-2.00   sec  1.41 GBytes  12.1 Gbits/sec
[SUM]   1.00-2.00   sec  2.82 GBytes  24.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  1.39 GBytes  11.9 Gbits/sec
[  6]   2.00-3.00   sec  1.39 GBytes  11.9 Gbits/sec
[SUM]   2.00-3.00   sec  2.78 GBytes  23.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  1.36 GBytes  11.7 Gbits/sec
[  6]   3.00-4.00   sec  1.36 GBytes  11.7 Gbits/sec
[SUM]   3.00-4.00   sec  2.72 GBytes  23.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  1.37 GBytes  11.7 Gbits/sec
[  6]   4.00-5.00   sec  1.36 GBytes  11.7 Gbits/sec
[SUM]   4.00-5.00   sec  2.73 GBytes  23.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  1.32 GBytes  11.3 Gbits/sec
[  6]   5.00-6.00   sec  1.32 GBytes  11.3 Gbits/sec
[SUM]   5.00-6.00   sec  2.64 GBytes  22.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  1.31 GBytes  11.3 Gbits/sec
[  6]   6.00-7.00   sec  1.31 GBytes  11.3 Gbits/sec
[SUM]   6.00-7.00   sec  2.62 GBytes  22.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  1.35 GBytes  11.6 Gbits/sec
[  6]   7.00-8.00   sec  1.35 GBytes  11.6 Gbits/sec
[SUM]   7.00-8.00   sec  2.69 GBytes  23.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  1.25 GBytes  10.7 Gbits/sec
[  6]   8.00-9.00   sec  1.24 GBytes  10.7 Gbits/sec
[SUM]   8.00-9.00   sec  2.49 GBytes  21.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  1.34 GBytes  11.5 Gbits/sec
[  6]   9.00-10.00  sec  1.34 GBytes  11.5 Gbits/sec
[SUM]   9.00-10.00  sec  2.68 GBytes  23.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  13.4 GBytes  11.5 Gbits/sec                  sender
[  4]   0.00-10.00  sec  13.4 GBytes  11.5 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  13.4 GBytes  11.5 Gbits/sec                  sender
[  6]   0.00-10.00  sec  13.4 GBytes  11.5 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  26.7 GBytes  23.0 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  26.7 GBytes  23.0 Gbits/sec                  receiver

iperf Done.

4スレッド

>iperf3.exe -c 192.168.123.1 -P 4
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 52840 connected to 192.168.123.1 port 5201
[  6] local 192.168.123.2 port 52841 connected to 192.168.123.1 port 5201
[  8] local 192.168.123.2 port 52842 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 52843 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   330 MBytes  2.76 Gbits/sec
[  6]   0.00-1.00   sec   324 MBytes  2.72 Gbits/sec
[  8]   0.00-1.00   sec   319 MBytes  2.68 Gbits/sec
[ 10]   0.00-1.00   sec   317 MBytes  2.66 Gbits/sec
[SUM]   0.00-1.00   sec  1.26 GBytes  10.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   508 MBytes  4.26 Gbits/sec
[  6]   1.00-2.00   sec   508 MBytes  4.26 Gbits/sec
[  8]   1.00-2.00   sec   507 MBytes  4.25 Gbits/sec
[ 10]   1.00-2.00   sec   506 MBytes  4.25 Gbits/sec
[SUM]   1.00-2.00   sec  1.98 GBytes  17.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   497 MBytes  4.17 Gbits/sec
[  6]   2.00-3.00   sec   497 MBytes  4.17 Gbits/sec
[  8]   2.00-3.00   sec   496 MBytes  4.16 Gbits/sec
[ 10]   2.00-3.00   sec   496 MBytes  4.16 Gbits/sec
[SUM]   2.00-3.00   sec  1.94 GBytes  16.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   518 MBytes  4.34 Gbits/sec
[  6]   3.00-4.00   sec   518 MBytes  4.34 Gbits/sec
[  8]   3.00-4.00   sec   517 MBytes  4.33 Gbits/sec
[ 10]   3.00-4.00   sec   517 MBytes  4.33 Gbits/sec
[SUM]   3.00-4.00   sec  2.02 GBytes  17.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   492 MBytes  4.12 Gbits/sec
[  6]   4.00-5.00   sec   491 MBytes  4.12 Gbits/sec
[  8]   4.00-5.00   sec   490 MBytes  4.11 Gbits/sec
[ 10]   4.00-5.00   sec   489 MBytes  4.10 Gbits/sec
[SUM]   4.00-5.00   sec  1.92 GBytes  16.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   446 MBytes  3.74 Gbits/sec
[  6]   5.00-6.00   sec   442 MBytes  3.71 Gbits/sec
[  8]   5.00-6.00   sec   440 MBytes  3.69 Gbits/sec
[ 10]   5.00-6.00   sec   438 MBytes  3.67 Gbits/sec
[SUM]   5.00-6.00   sec  1.72 GBytes  14.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   514 MBytes  4.31 Gbits/sec
[  6]   6.00-7.00   sec   514 MBytes  4.31 Gbits/sec
[  8]   6.00-7.00   sec   513 MBytes  4.30 Gbits/sec
[ 10]   6.00-7.00   sec   513 MBytes  4.30 Gbits/sec
[SUM]   6.00-7.00   sec  2.01 GBytes  17.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   528 MBytes  4.43 Gbits/sec
[  6]   7.00-8.00   sec   528 MBytes  4.43 Gbits/sec
[  8]   7.00-8.00   sec   528 MBytes  4.43 Gbits/sec
[ 10]   7.00-8.00   sec   527 MBytes  4.42 Gbits/sec
[SUM]   7.00-8.00   sec  2.06 GBytes  17.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   516 MBytes  4.33 Gbits/sec
[  6]   8.00-9.00   sec   516 MBytes  4.33 Gbits/sec
[  8]   8.00-9.00   sec   480 MBytes  4.02 Gbits/sec
[ 10]   8.00-9.00   sec   514 MBytes  4.32 Gbits/sec
[SUM]   8.00-9.00   sec  1.98 GBytes  17.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   552 MBytes  4.63 Gbits/sec
[  6]   9.00-10.00  sec   552 MBytes  4.63 Gbits/sec
[  8]   9.00-10.00  sec   551 MBytes  4.62 Gbits/sec
[ 10]   9.00-10.00  sec   551 MBytes  4.62 Gbits/sec
[SUM]   9.00-10.00  sec  2.16 GBytes  18.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  4.79 GBytes  4.11 Gbits/sec                  sender
[  4]   0.00-10.00  sec  4.78 GBytes  4.11 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  4.77 GBytes  4.10 Gbits/sec                  sender
[  6]   0.00-10.00  sec  4.77 GBytes  4.10 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  4.73 GBytes  4.06 Gbits/sec                  sender
[  8]   0.00-10.00  sec  4.73 GBytes  4.06 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  4.75 GBytes  4.08 Gbits/sec                  sender
[ 10]   0.00-10.00  sec  4.75 GBytes  4.08 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  19.0 GBytes  16.4 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  19.0 GBytes  16.4 Gbits/sec                  receiver

iperf Done.

8スレッド

>iperf3.exe -c 192.168.123.1 -P 8
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 52879 connected to 192.168.123.1 port 5201
[  6] local 192.168.123.2 port 52880 connected to 192.168.123.1 port 5201
[  8] local 192.168.123.2 port 52881 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 52882 connected to 192.168.123.1 port 5201
[ 12] local 192.168.123.2 port 52883 connected to 192.168.123.1 port 5201
[ 14] local 192.168.123.2 port 52884 connected to 192.168.123.1 port 5201
[ 16] local 192.168.123.2 port 52885 connected to 192.168.123.1 port 5201
[ 18] local 192.168.123.2 port 52886 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   234 MBytes  1.96 Gbits/sec
[  6]   0.00-1.00   sec   234 MBytes  1.96 Gbits/sec
[  8]   0.00-1.00   sec   232 MBytes  1.95 Gbits/sec
[ 10]   0.00-1.00   sec   230 MBytes  1.93 Gbits/sec
[ 12]   0.00-1.00   sec   226 MBytes  1.89 Gbits/sec
[ 14]   0.00-1.00   sec   224 MBytes  1.88 Gbits/sec
[ 16]   0.00-1.00   sec   224 MBytes  1.88 Gbits/sec
[ 18]   0.00-1.00   sec   224 MBytes  1.88 Gbits/sec
[SUM]   0.00-1.00   sec  1.78 GBytes  15.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   265 MBytes  2.22 Gbits/sec
[  6]   1.00-2.00   sec   265 MBytes  2.22 Gbits/sec
[  8]   1.00-2.00   sec   265 MBytes  2.22 Gbits/sec
[ 10]   1.00-2.00   sec   264 MBytes  2.22 Gbits/sec
[ 12]   1.00-2.00   sec   264 MBytes  2.22 Gbits/sec
[ 14]   1.00-2.00   sec   264 MBytes  2.22 Gbits/sec
[ 16]   1.00-2.00   sec   264 MBytes  2.22 Gbits/sec
[ 18]   1.00-2.00   sec   264 MBytes  2.22 Gbits/sec
[SUM]   1.00-2.00   sec  2.07 GBytes  17.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   267 MBytes  2.24 Gbits/sec
[  6]   2.00-3.00   sec   267 MBytes  2.24 Gbits/sec
[  8]   2.00-3.00   sec   266 MBytes  2.23 Gbits/sec
[ 10]   2.00-3.00   sec   266 MBytes  2.23 Gbits/sec
[ 12]   2.00-3.00   sec   266 MBytes  2.23 Gbits/sec
[ 14]   2.00-3.00   sec   266 MBytes  2.23 Gbits/sec
[ 16]   2.00-3.00   sec   264 MBytes  2.22 Gbits/sec
[ 18]   2.00-3.00   sec   264 MBytes  2.22 Gbits/sec
[SUM]   2.00-3.00   sec  2.08 GBytes  17.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   267 MBytes  2.24 Gbits/sec
[  6]   3.00-4.00   sec   267 MBytes  2.24 Gbits/sec
[  8]   3.00-4.00   sec   267 MBytes  2.24 Gbits/sec
[ 10]   3.00-4.00   sec   266 MBytes  2.24 Gbits/sec
[ 12]   3.00-4.00   sec   267 MBytes  2.24 Gbits/sec
[ 14]   3.00-4.00   sec   266 MBytes  2.24 Gbits/sec
[ 16]   3.00-4.00   sec   266 MBytes  2.23 Gbits/sec
[ 18]   3.00-4.00   sec   266 MBytes  2.23 Gbits/sec
[SUM]   3.00-4.00   sec  2.08 GBytes  17.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   192 MBytes  1.61 Gbits/sec
[  6]   4.00-5.00   sec   192 MBytes  1.61 Gbits/sec
[  8]   4.00-5.00   sec   191 MBytes  1.60 Gbits/sec
[ 10]   4.00-5.00   sec   190 MBytes  1.59 Gbits/sec
[ 12]   4.00-5.00   sec   189 MBytes  1.59 Gbits/sec
[ 14]   4.00-5.00   sec   188 MBytes  1.58 Gbits/sec
[ 16]   4.00-5.00   sec   186 MBytes  1.56 Gbits/sec
[ 18]   4.00-5.00   sec   186 MBytes  1.56 Gbits/sec
[SUM]   4.00-5.00   sec  1.48 GBytes  12.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   263 MBytes  2.21 Gbits/sec
[  6]   5.00-6.00   sec   263 MBytes  2.21 Gbits/sec
[  8]   5.00-6.00   sec   263 MBytes  2.21 Gbits/sec
[ 10]   5.00-6.00   sec   263 MBytes  2.20 Gbits/sec
[ 12]   5.00-6.00   sec   262 MBytes  2.20 Gbits/sec
[ 14]   5.00-6.00   sec   263 MBytes  2.20 Gbits/sec
[ 16]   5.00-6.00   sec   262 MBytes  2.20 Gbits/sec
[ 18]   5.00-6.00   sec   262 MBytes  2.20 Gbits/sec
[SUM]   5.00-6.00   sec  2.05 GBytes  17.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   214 MBytes  1.80 Gbits/sec
[  6]   6.00-7.00   sec   214 MBytes  1.80 Gbits/sec
[  8]   6.00-7.00   sec   214 MBytes  1.80 Gbits/sec
[ 10]   6.00-7.00   sec   214 MBytes  1.80 Gbits/sec
[ 12]   6.00-7.00   sec   214 MBytes  1.79 Gbits/sec
[ 14]   6.00-7.00   sec   214 MBytes  1.79 Gbits/sec
[ 16]   6.00-7.00   sec   214 MBytes  1.79 Gbits/sec
[ 18]   6.00-7.00   sec   213 MBytes  1.79 Gbits/sec
[SUM]   6.00-7.00   sec  1.67 GBytes  14.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   271 MBytes  2.27 Gbits/sec
[  6]   7.00-8.00   sec   271 MBytes  2.27 Gbits/sec
[  8]   7.00-8.00   sec   270 MBytes  2.27 Gbits/sec
[ 10]   7.00-8.00   sec   270 MBytes  2.27 Gbits/sec
[ 12]   7.00-8.00   sec   270 MBytes  2.26 Gbits/sec
[ 14]   7.00-8.00   sec   270 MBytes  2.27 Gbits/sec
[ 16]   7.00-8.00   sec   269 MBytes  2.26 Gbits/sec
[ 18]   7.00-8.00   sec   270 MBytes  2.26 Gbits/sec
[SUM]   7.00-8.00   sec  2.11 GBytes  18.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   227 MBytes  1.90 Gbits/sec
[  6]   8.00-9.00   sec   226 MBytes  1.90 Gbits/sec
[  8]   8.00-9.00   sec   226 MBytes  1.89 Gbits/sec
[ 10]   8.00-9.00   sec   226 MBytes  1.89 Gbits/sec
[ 12]   8.00-9.00   sec   226 MBytes  1.89 Gbits/sec
[ 14]   8.00-9.00   sec   226 MBytes  1.89 Gbits/sec
[ 16]   8.00-9.00   sec   225 MBytes  1.89 Gbits/sec
[ 18]   8.00-9.00   sec   224 MBytes  1.88 Gbits/sec
[SUM]   8.00-9.00   sec  1.76 GBytes  15.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   214 MBytes  1.79 Gbits/sec
[  6]   9.00-10.00  sec   213 MBytes  1.79 Gbits/sec
[  8]   9.00-10.00  sec   212 MBytes  1.78 Gbits/sec
[ 10]   9.00-10.00  sec   211 MBytes  1.77 Gbits/sec
[ 12]   9.00-10.00  sec   212 MBytes  1.78 Gbits/sec
[ 14]   9.00-10.00  sec   212 MBytes  1.78 Gbits/sec
[ 16]   9.00-10.00  sec   209 MBytes  1.75 Gbits/sec
[ 18]   9.00-10.00  sec   208 MBytes  1.74 Gbits/sec
[SUM]   9.00-10.00  sec  1.65 GBytes  14.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  2.36 GBytes  2.02 Gbits/sec                  sender
[  4]   0.00-10.00  sec  2.36 GBytes  2.02 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  2.36 GBytes  2.02 Gbits/sec                  sender
[  6]   0.00-10.00  sec  2.35 GBytes  2.02 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  2.35 GBytes  2.02 Gbits/sec                  sender
[  8]   0.00-10.00  sec  2.35 GBytes  2.02 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  2.34 GBytes  2.01 Gbits/sec                  sender
[ 10]   0.00-10.00  sec  2.34 GBytes  2.01 Gbits/sec                  receiver
[ 12]   0.00-10.00  sec  2.34 GBytes  2.01 Gbits/sec                  sender
[ 12]   0.00-10.00  sec  2.34 GBytes  2.01 Gbits/sec                  receiver
[ 14]   0.00-10.00  sec  2.34 GBytes  2.01 Gbits/sec                  sender
[ 14]   0.00-10.00  sec  2.34 GBytes  2.01 Gbits/sec                  receiver
[ 16]   0.00-10.00  sec  2.33 GBytes  2.00 Gbits/sec                  sender
[ 16]   0.00-10.00  sec  2.33 GBytes  2.00 Gbits/sec                  receiver
[ 18]   0.00-10.00  sec  2.33 GBytes  2.00 Gbits/sec                  sender
[ 18]   0.00-10.00  sec  2.32 GBytes  2.00 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  18.7 GBytes  16.1 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  18.7 GBytes  16.1 Gbits/sec                  receiver

iperf Done.

MTU=9000

1スレッド

>iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 52963 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  2.70 GBytes  23.2 Gbits/sec
[  4]   1.00-2.00   sec  2.78 GBytes  23.9 Gbits/sec
[  4]   2.00-3.00   sec  3.05 GBytes  26.2 Gbits/sec
[  4]   3.00-4.00   sec  3.05 GBytes  26.2 Gbits/sec
[  4]   4.00-5.00   sec  3.06 GBytes  26.3 Gbits/sec
[  4]   5.00-6.00   sec  3.06 GBytes  26.3 Gbits/sec
[  4]   6.00-7.00   sec  3.01 GBytes  25.8 Gbits/sec
[  4]   7.00-8.00   sec  3.04 GBytes  26.2 Gbits/sec
[  4]   8.00-9.00   sec  3.05 GBytes  26.2 Gbits/sec
[  4]   9.00-10.00  sec  3.07 GBytes  26.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  29.9 GBytes  25.7 Gbits/sec                  sender
[  4]   0.00-10.00  sec  29.9 GBytes  25.7 Gbits/sec                  receiver

iperf Done.

2スレッド

>iperf3.exe -c 192.168.123.1 -P 2
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 53014 connected to 192.168.123.1 port 5201
[  6] local 192.168.123.2 port 53015 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  1.55 GBytes  13.3 Gbits/sec
[  6]   0.00-1.00   sec  1.48 GBytes  12.7 Gbits/sec
[SUM]   0.00-1.00   sec  3.03 GBytes  26.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  1.63 GBytes  14.0 Gbits/sec
[  6]   1.00-2.00   sec  1.62 GBytes  13.9 Gbits/sec
[SUM]   1.00-2.00   sec  3.25 GBytes  27.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  1.60 GBytes  13.8 Gbits/sec
[  6]   2.00-3.00   sec  1.60 GBytes  13.7 Gbits/sec
[SUM]   2.00-3.00   sec  3.20 GBytes  27.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  1.32 GBytes  11.3 Gbits/sec
[  6]   3.00-4.00   sec  1.31 GBytes  11.3 Gbits/sec
[SUM]   3.00-4.00   sec  2.63 GBytes  22.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  1.65 GBytes  14.2 Gbits/sec
[  6]   4.00-5.00   sec  1.64 GBytes  14.1 Gbits/sec
[SUM]   4.00-5.00   sec  3.29 GBytes  28.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  1.61 GBytes  13.8 Gbits/sec
[  6]   5.00-6.00   sec  1.60 GBytes  13.8 Gbits/sec
[SUM]   5.00-6.00   sec  3.21 GBytes  27.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  1.66 GBytes  14.2 Gbits/sec
[  6]   6.00-7.00   sec  1.65 GBytes  14.2 Gbits/sec
[SUM]   6.00-7.00   sec  3.31 GBytes  28.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  1.65 GBytes  14.2 Gbits/sec
[  6]   7.00-8.00   sec  1.65 GBytes  14.1 Gbits/sec
[SUM]   7.00-8.00   sec  3.30 GBytes  28.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  1.33 GBytes  11.4 Gbits/sec
[  6]   8.00-9.00   sec  1.32 GBytes  11.4 Gbits/sec
[SUM]   8.00-9.00   sec  2.65 GBytes  22.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  1.66 GBytes  14.2 Gbits/sec
[  6]   9.00-10.00  sec  1.65 GBytes  14.2 Gbits/sec
[SUM]   9.00-10.00  sec  3.31 GBytes  28.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  15.6 GBytes  13.4 Gbits/sec                  sender
[  4]   0.00-10.00  sec  15.6 GBytes  13.4 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  15.5 GBytes  13.3 Gbits/sec                  sender
[  6]   0.00-10.00  sec  15.5 GBytes  13.3 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  31.2 GBytes  26.8 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  31.2 GBytes  26.8 Gbits/sec                  receiver

iperf Done.

4スレッド

>iperf3.exe -c 192.168.123.1 -P 4
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 53045 connected to 192.168.123.1 port 5201
[  6] local 192.168.123.2 port 53046 connected to 192.168.123.1 port 5201
[  8] local 192.168.123.2 port 53047 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 53048 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   800 MBytes  6.71 Gbits/sec
[  6]   0.00-1.00   sec   794 MBytes  6.66 Gbits/sec
[  8]   0.00-1.00   sec   791 MBytes  6.63 Gbits/sec
[ 10]   0.00-1.00   sec   779 MBytes  6.53 Gbits/sec
[SUM]   0.00-1.00   sec  3.09 GBytes  26.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   896 MBytes  7.50 Gbits/sec
[  6]   1.00-2.00   sec   894 MBytes  7.49 Gbits/sec
[  8]   1.00-2.00   sec   888 MBytes  7.44 Gbits/sec
[ 10]   1.00-2.00   sec   887 MBytes  7.43 Gbits/sec
[SUM]   1.00-2.00   sec  3.48 GBytes  29.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   574 MBytes  4.82 Gbits/sec
[  6]   2.00-3.00   sec   573 MBytes  4.82 Gbits/sec
[  8]   2.00-3.00   sec   565 MBytes  4.75 Gbits/sec
[ 10]   2.00-3.00   sec   562 MBytes  4.72 Gbits/sec
[SUM]   2.00-3.00   sec  2.22 GBytes  19.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   780 MBytes  6.55 Gbits/sec
[  6]   3.00-4.00   sec   780 MBytes  6.55 Gbits/sec
[  8]   3.00-4.00   sec   777 MBytes  6.52 Gbits/sec
[ 10]   3.00-4.00   sec   775 MBytes  6.50 Gbits/sec
[SUM]   3.00-4.00   sec  3.04 GBytes  26.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   889 MBytes  7.46 Gbits/sec
[  6]   4.00-5.00   sec   888 MBytes  7.45 Gbits/sec
[  8]   4.00-5.00   sec   886 MBytes  7.43 Gbits/sec
[ 10]   4.00-5.00   sec   884 MBytes  7.41 Gbits/sec
[SUM]   4.00-5.00   sec  3.46 GBytes  29.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   911 MBytes  7.64 Gbits/sec
[  6]   5.00-6.00   sec   911 MBytes  7.64 Gbits/sec
[  8]   5.00-6.00   sec   910 MBytes  7.64 Gbits/sec
[ 10]   5.00-6.00   sec   910 MBytes  7.63 Gbits/sec
[SUM]   5.00-6.00   sec  3.56 GBytes  30.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   900 MBytes  7.54 Gbits/sec
[  6]   6.00-7.00   sec   899 MBytes  7.53 Gbits/sec
[  8]   6.00-7.00   sec   896 MBytes  7.51 Gbits/sec
[ 10]   6.00-7.00   sec   897 MBytes  7.51 Gbits/sec
[SUM]   6.00-7.00   sec  3.51 GBytes  30.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   828 MBytes  6.95 Gbits/sec
[  6]   7.00-8.00   sec   826 MBytes  6.94 Gbits/sec
[  8]   7.00-8.00   sec   822 MBytes  6.91 Gbits/sec
[ 10]   7.00-8.00   sec   821 MBytes  6.90 Gbits/sec
[SUM]   7.00-8.00   sec  3.22 GBytes  27.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   951 MBytes  7.98 Gbits/sec
[  6]   8.00-9.00   sec   950 MBytes  7.97 Gbits/sec
[  8]   8.00-9.00   sec   947 MBytes  7.94 Gbits/sec
[ 10]   8.00-9.00   sec   946 MBytes  7.93 Gbits/sec
[SUM]   8.00-9.00   sec  3.70 GBytes  31.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   953 MBytes  7.99 Gbits/sec
[  6]   9.00-10.00  sec   953 MBytes  7.99 Gbits/sec
[  8]   9.00-10.00  sec   952 MBytes  7.98 Gbits/sec
[ 10]   9.00-10.00  sec   951 MBytes  7.98 Gbits/sec
[SUM]   9.00-10.00  sec  3.72 GBytes  31.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  8.28 GBytes  7.11 Gbits/sec                  sender
[  4]   0.00-10.00  sec  8.28 GBytes  7.11 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  8.27 GBytes  7.10 Gbits/sec                  sender
[  6]   0.00-10.00  sec  8.27 GBytes  7.10 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  8.24 GBytes  7.07 Gbits/sec                  sender
[  8]   0.00-10.00  sec  8.23 GBytes  7.07 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  8.21 GBytes  7.06 Gbits/sec                  sender
[ 10]   0.00-10.00  sec  8.21 GBytes  7.05 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  33.0 GBytes  28.3 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  33.0 GBytes  28.3 Gbits/sec                  receiver

iperf Done.

8スレッド

>iperf3.exe -c 192.168.123.1 -P 8
Connecting to host 192.168.123.1, port 5201
[  4] local 192.168.123.2 port 53107 connected to 192.168.123.1 port 5201
[  6] local 192.168.123.2 port 53108 connected to 192.168.123.1 port 5201
[  8] local 192.168.123.2 port 53109 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 53110 connected to 192.168.123.1 port 5201
[ 12] local 192.168.123.2 port 53111 connected to 192.168.123.1 port 5201
[ 14] local 192.168.123.2 port 53112 connected to 192.168.123.1 port 5201
[ 16] local 192.168.123.2 port 53113 connected to 192.168.123.1 port 5201
[ 18] local 192.168.123.2 port 53114 connected to 192.168.123.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   412 MBytes  3.45 Gbits/sec
[  6]   0.00-1.00   sec   416 MBytes  3.49 Gbits/sec
[  8]   0.00-1.00   sec   411 MBytes  3.45 Gbits/sec
[ 10]   0.00-1.00   sec   405 MBytes  3.40 Gbits/sec
[ 12]   0.00-1.00   sec   397 MBytes  3.33 Gbits/sec
[ 14]   0.00-1.00   sec   390 MBytes  3.27 Gbits/sec
[ 16]   0.00-1.00   sec   386 MBytes  3.23 Gbits/sec
[ 18]   0.00-1.00   sec   375 MBytes  3.14 Gbits/sec
[SUM]   0.00-1.00   sec  3.12 GBytes  26.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   286 MBytes  2.40 Gbits/sec
[  6]   1.00-2.00   sec   296 MBytes  2.48 Gbits/sec
[  8]   1.00-2.00   sec   290 MBytes  2.44 Gbits/sec
[ 10]   1.00-2.00   sec   283 MBytes  2.37 Gbits/sec
[ 12]   1.00-2.00   sec   278 MBytes  2.33 Gbits/sec
[ 14]   1.00-2.00   sec   267 MBytes  2.24 Gbits/sec
[ 16]   1.00-2.00   sec   258 MBytes  2.17 Gbits/sec
[ 18]   1.00-2.00   sec   247 MBytes  2.07 Gbits/sec
[SUM]   1.00-2.00   sec  2.15 GBytes  18.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   348 MBytes  2.92 Gbits/sec
[  6]   2.00-3.00   sec   360 MBytes  3.02 Gbits/sec
[  8]   2.00-3.00   sec   354 MBytes  2.97 Gbits/sec
[ 10]   2.00-3.00   sec   345 MBytes  2.89 Gbits/sec
[ 12]   2.00-3.00   sec   334 MBytes  2.80 Gbits/sec
[ 14]   2.00-3.00   sec   319 MBytes  2.68 Gbits/sec
[ 16]   2.00-3.00   sec   308 MBytes  2.59 Gbits/sec
[ 18]   2.00-3.00   sec   293 MBytes  2.46 Gbits/sec
[SUM]   2.00-3.00   sec  2.60 GBytes  22.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   462 MBytes  3.88 Gbits/sec
[  6]   3.00-4.00   sec   477 MBytes  4.00 Gbits/sec
[  8]   3.00-4.00   sec   471 MBytes  3.95 Gbits/sec
[ 10]   3.00-4.00   sec   465 MBytes  3.90 Gbits/sec
[ 12]   3.00-4.00   sec   449 MBytes  3.77 Gbits/sec
[ 14]   3.00-4.00   sec   435 MBytes  3.65 Gbits/sec
[ 16]   3.00-4.00   sec   419 MBytes  3.51 Gbits/sec
[ 18]   3.00-4.00   sec   392 MBytes  3.29 Gbits/sec
[SUM]   3.00-4.00   sec  3.49 GBytes  29.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   445 MBytes  3.73 Gbits/sec
[  6]   4.00-5.00   sec   461 MBytes  3.87 Gbits/sec
[  8]   4.00-5.00   sec   456 MBytes  3.83 Gbits/sec
[ 10]   4.00-5.00   sec   450 MBytes  3.78 Gbits/sec
[ 12]   4.00-5.00   sec   438 MBytes  3.67 Gbits/sec
[ 14]   4.00-5.00   sec   422 MBytes  3.54 Gbits/sec
[ 16]   4.00-5.00   sec   408 MBytes  3.42 Gbits/sec
[ 18]   4.00-5.00   sec   383 MBytes  3.22 Gbits/sec
[SUM]   4.00-5.00   sec  3.38 GBytes  29.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   454 MBytes  3.80 Gbits/sec
[  6]   5.00-6.00   sec   466 MBytes  3.91 Gbits/sec
[  8]   5.00-6.00   sec   459 MBytes  3.85 Gbits/sec
[ 10]   5.00-6.00   sec   451 MBytes  3.78 Gbits/sec
[ 12]   5.00-6.00   sec   442 MBytes  3.71 Gbits/sec
[ 14]   5.00-6.00   sec   429 MBytes  3.60 Gbits/sec
[ 16]   5.00-6.00   sec   414 MBytes  3.47 Gbits/sec
[ 18]   5.00-6.00   sec   390 MBytes  3.28 Gbits/sec
[SUM]   5.00-6.00   sec  3.42 GBytes  29.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   351 MBytes  2.95 Gbits/sec
[  6]   6.00-7.00   sec   365 MBytes  3.06 Gbits/sec
[  8]   6.00-7.00   sec   360 MBytes  3.02 Gbits/sec
[ 10]   6.00-7.00   sec   355 MBytes  2.98 Gbits/sec
[ 12]   6.00-7.00   sec   342 MBytes  2.87 Gbits/sec
[ 14]   6.00-7.00   sec   322 MBytes  2.70 Gbits/sec
[ 16]   6.00-7.00   sec   320 MBytes  2.69 Gbits/sec
[ 18]   6.00-7.00   sec   302 MBytes  2.53 Gbits/sec
[SUM]   6.00-7.00   sec  2.65 GBytes  22.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   389 MBytes  3.26 Gbits/sec
[  6]   7.00-8.00   sec   400 MBytes  3.36 Gbits/sec
[  8]   7.00-8.00   sec   396 MBytes  3.32 Gbits/sec
[ 10]   7.00-8.00   sec   385 MBytes  3.23 Gbits/sec
[ 12]   7.00-8.00   sec   377 MBytes  3.17 Gbits/sec
[ 14]   7.00-8.00   sec   362 MBytes  3.04 Gbits/sec
[ 16]   7.00-8.00   sec   353 MBytes  2.96 Gbits/sec
[ 18]   7.00-8.00   sec   332 MBytes  2.78 Gbits/sec
[SUM]   7.00-8.00   sec  2.92 GBytes  25.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   458 MBytes  3.85 Gbits/sec
[  6]   8.00-9.00   sec   475 MBytes  3.99 Gbits/sec
[  8]   8.00-9.00   sec   472 MBytes  3.96 Gbits/sec
[ 10]   8.00-9.00   sec   464 MBytes  3.89 Gbits/sec
[ 12]   8.00-9.00   sec   448 MBytes  3.76 Gbits/sec
[ 14]   8.00-9.00   sec   431 MBytes  3.62 Gbits/sec
[ 16]   8.00-9.00   sec   416 MBytes  3.49 Gbits/sec
[ 18]   8.00-9.00   sec   393 MBytes  3.30 Gbits/sec
[SUM]   8.00-9.00   sec  3.47 GBytes  29.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   452 MBytes  3.79 Gbits/sec
[  6]   9.00-10.00  sec   466 MBytes  3.91 Gbits/sec
[  8]   9.00-10.00  sec   460 MBytes  3.86 Gbits/sec
[ 10]   9.00-10.00  sec   456 MBytes  3.83 Gbits/sec
[ 12]   9.00-10.00  sec   444 MBytes  3.72 Gbits/sec
[ 14]   9.00-10.00  sec   428 MBytes  3.59 Gbits/sec
[ 16]   9.00-10.00  sec   414 MBytes  3.48 Gbits/sec
[ 18]   9.00-10.00  sec   391 MBytes  3.28 Gbits/sec
[SUM]   9.00-10.00  sec  3.43 GBytes  29.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  3.96 GBytes  3.40 Gbits/sec                  sender
[  4]   0.00-10.00  sec  3.96 GBytes  3.40 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  4.08 GBytes  3.51 Gbits/sec                  sender
[  6]   0.00-10.00  sec  4.08 GBytes  3.51 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  4.03 GBytes  3.46 Gbits/sec                  sender
[  8]   0.00-10.00  sec  4.03 GBytes  3.46 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  3.96 GBytes  3.41 Gbits/sec                  sender
[ 10]   0.00-10.00  sec  3.96 GBytes  3.41 Gbits/sec                  receiver
[ 12]   0.00-10.00  sec  3.86 GBytes  3.31 Gbits/sec                  sender
[ 12]   0.00-10.00  sec  3.86 GBytes  3.31 Gbits/sec                  receiver
[ 14]   0.00-10.00  sec  3.72 GBytes  3.19 Gbits/sec                  sender
[ 14]   0.00-10.00  sec  3.72 GBytes  3.19 Gbits/sec                  receiver
[ 16]   0.00-10.00  sec  3.61 GBytes  3.10 Gbits/sec                  sender
[ 16]   0.00-10.00  sec  3.61 GBytes  3.10 Gbits/sec                  receiver
[ 18]   0.00-10.00  sec  3.42 GBytes  2.93 Gbits/sec                  sender
[ 18]   0.00-10.00  sec  3.42 GBytes  2.93 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  30.6 GBytes  26.3 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  30.6 GBytes  26.3 Gbits/sec                  receiver

iperf Done.

ジャンボフレームにすると流石の速度。スレッド数を増やすと速度も伸びるという情報があったが、自分の環境では4スレッドの時が最大で、単純に増やせば速くなるってものでもなかった。ここまで来ると、メモリ速度やその時その時のバス使用率など、マシンの足回りの影響が大きそう。

  • freebsd/freebsd_11.2r_40gbe_with_connectx-3_pro_en.txt
  • 最終更新: 2020-12-03 19:36
  • by Decomo