Re: Does anyone know how to optimize Infiniband network so that I can get a...
Hello: man,how are you doing ? Thank you a lot for your message. I'd like to know about how to optimize infiniband between infiniband protocol,because there several protocol can run on infiniband...
View ArticleRe: How to stack two Voltaire 4036
To figure out performance problem start with making sure you use up to date drivers (WinOF 4.80 released today) as well as switch and HCA firmware (see release notes for recommended HCA fw -...
View ArticleRe: Does anyone know how to optimize Infiniband network so that I can get a...
What are driver and fw versions for HCA, what OS and switch model/version? What numbers are you getting? Start with checking that IB utilities give you expected BW for IB links (32Gb/s data for QDR and...
View ArticleRe: ConnectX-HCA and 2.9.1000 brings serious trouble ?
Thank you very much for your suggestion. We will try it. Anyway, we have to do version up firmware or HCA.
View ArticleRe: How to stack two Voltaire 4036
andre, thank you very much again for your detailed answer. I did some further tests using ntttcp and I am getting a solid and constant 10Gb/s. Now I would like to ask you what should I check or modify...
View ArticleClik here to view.
Re: How to stack two Voltaire 4036
See sections 5.1, 5.3 and 5.4 for a good step by step guidance for IB performance troubleshooting: http://www.mellanox.com/related-docs/prod_software/MLNX_VPI_WinOF_User_Manual_v4.80.pdfHave you done...
View Articleibdump live capture filtering
Is it possible to do ibdump live capture filtering as one can do with tcpdump? Is there a way to only capture RDMA Read and Write packets between a set of nodes performing MPI communications?When...
View ArticleClik here to view.
Windows 2008 R2 Drivers Mellanox ConnectX-2 IPoIB adaptor
Hi, we are doing some tests with IB cards.On one a Windows 2012 R2 machine. (Hardware is HP Proliant server) Works like a charm, no drivers needed, only the HP drivers pack for a ProLiant server. Our...
View ArticleRe: Does anyone know how to optimize Infiniband network so that I can get a...
I just want to know what I should care about optimizing infiniband network? Some of the our customers ask about it.
View ArticleConnectX-3 Pro: 40GbE QSA under Linux
I'm looking at the MCX313A-BCCT and/or MCX314A-BCCT cards in combination with a QSA module and a 4x 10GbE breakout cable. 1) Will using a QSA / 10GbE lanes impact performance or available features...
View ArticleRe: Windows 2008 R2 Drivers Mellanox ConnectX-2 IPoIB adaptor
Hi Chris, Assuming you have rebooted the machine after installing it on 2008R2. I have a few questions. 1. How much memory do you have on that server ?2.Have you installed the driver on top of an inbox...
View ArticleRe: wo have MT4099 IB card，not use EOIB，
Hi, Do you mean you are seeing these prints in syslog even though you did not configure vnic and are not planning on using EoIB ? or you are planning on using it and you have a BridgeX, if so, can you...
View ArticleRe: i2C writing interface to A0 and A2 tables using ConnectX3 ???
Can you please provide more details about what you are trying to do?
View ArticleClik here to view.
Re: write throughput for SRP vs. local mount?
Even your SSD's local max of 500 MB/s is only 4 Gb/s which is nowhere near of PCIe ver2 limit of about 25Gb/s for x8 slot (ConnectX3 cards are x8 and I assume you have it in x8 slot).To eliminate...
View ArticleAbaqus MPI with Connect-IB: rdma error
Hello, the connect-ib runs with MLNX_OFED_LINUX-2.3-1.0.1-rhel6.5-x86_64,abaqus (FEM Software) comes with it's own mpi and shows the following error : mpirun: IBM Platform MPI Community Edition:...
View ArticleExpected bandwidth performance from ib_send_bw
Hi, I'm trying to measure my ib bandwidth by using ib_send_bw. Im using the Connect X-3 with 56GbE. I connect two machine point to point with infiniband. [mimos@wnode4 ~]$ ibstatusInfiniband device...
View ArticleClik here to view.
Beginners guide to Infiniband
I ended up dumping my Infiniband experience to a blog post to hopefully try and help other people not make the same mistakes I did. Let me know if I missed anything or incorrect. Introduction to...
View ArticleRe: Trying to "rate limit" a VF in SR-IOV enabled Mellanox ConnectX-3 HCA
Hi,It is possible to set QoS over SR-IOV in either VST or VGT mode using the mlnx_qos command. Refer to HowTo Configure QoS over SR-IOVThanks,Ophir.
View ArticleClik here to view.
Troubleshooting the iSER enable on Mellanox ConnectX-2 EN and running iSCSI...
Hi, I have folowing card on my system.lspci | grep -i mellanox02:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0) I am running CentOs 6.5.uname...
View Article