Hello,
Mellanox NIC info:
Model: MCX354A
PSID: MT_1090110019
Driver: mlx4_en
version: 2.2-1.0.1 (Jun 13 2014)
firmware-version: 2.31.5050
We installed 2 Mellanox NIC on serverA and 2 of them on serverB.
Our systems are identical with the following characteristics:
ServerA-B:
-Dell poweredge R720xd
-CPU: 32 CPU each 2.9 GHz (Sandy Bridge): Numa0: 0-2-4-...30, Numa1:
1-3-...-31
-6 slot PCIe 8GT/s (16 lane)
-RAM: 128 GB DDR3
-OS: ubuntu 12.04 LTS (Kernel: 3.11.0.22)
We have read muliple times the Mellanox user manual and performance for
Linux and modified the recommended parameters to achieve high data bit
rates such as affinity config, mtu9000, rxqueu 8192, TCP.timestap config
We have arrived to 39.6 Gbps in TX mode using a QSFP+ cable by using iperf
software: iperf -c192.168.14.214 -t43200 -i1 -P2
1.1 But when we activate TX/RX both, the TX is 27.5 Gbps however RX is 28.5
Gbps. Totally 56 Gbps. Should we expect 2*40Gbps? and how to acheive it?
1.2 When we activate dual port (eth14 and eth15) in the same card, the sum
of bandwidth are not exceeding 56Gbps. Should we expect 2*40Gbps? and how
to acheive it?