Re: how do I configure Mellanox sn2700 to connect to a 40Gb port on a RS8264...
Ok thank you I will try that. But are there any special instruction I have to give to make the connectivity happen? I only have experience with Cisco and Brocade switch.
View ArticleRe: how do I configure Mellanox sn2700 to connect to a 40Gb port on a RS8264...
Change port speed, insert the right cable and check the port status. Similar to all other switches.If there is no interoperability issue the link will be up. Besides that you might want to configure...
View ArticleRe: how do I configure Mellanox sn2700 to connect to a 40Gb port on a RS8264...
OK thanks, I will make sure all that is set. The only thing I can remember not setting is the port speed, I left that as auto.... All other settings I did them.I am not getting any connectivity between...
View ArticleRe: how do I configure Mellanox sn2700 to connect to a 40Gb port on a RS8264...
You can use any port, there is not differences between the ports in this switch.if you have another SN2700 or any other Mellanox switch, I suggest to try connecting them with copper cable 40G and make...
View ArticleClik here to view.
Re: how do I configure Mellanox sn2700 to connect to a 40Gb port on a RS8264...
Ok I do have a SB7700 across the isle... I will test with that switch.
View Articlepermanent setting log_num_mtt and log_mtts_per_seg
I am using MHEH29 with MLNX_OFED 1.5.3. on centos 6.2.To increase memory size, I set log_num_mtt and log_mtts_per_seg as#echo "22" > /sys/module/mlx4_core/parameters/log_num_mtt#echo "1" >...
View ArticleClik here to view.
SM LID is not configured warning
Hi All, I have a pair of 4036 switches connected to a few server nodes. Each server node has a dual port Connectx2 card with one link to each switch. The switches then have two connections between...
View ArticleRe: SM LID is not configured warning
Sorry, you mention those scripts as depreciated. Is there a newer set i should be using to test this?
View ArticleRe: SM LID is not configured warning
So LID 1 is other switch. So this also a is false warning from that script. ibnetdiscover says 4xQDR for all your links so this looks right. That would be 10 Gbps (signaling rate) derated to 8 Gbps...
View ArticleRe: SM LID is not configured warning
Those scripts were deprecated back in April 2011. Try ibqueryerrors I don't know if this exists in Windows environment though.
View ArticleRe: SM LID is not configured warning
Running ntttcp.exe per http://www.mellanox.com/related-docs/prod_software/Performance_Tuning_Guide_for_Mellanox_Network_Adapters.pdfThroughput(MB/s) = 1531.362Results are similar with file copy or...
View ArticleRe: SM LID is not configured warning
Are you running single NTttcp receiver/sender between servers or are there multiple of these going on concurrently ? Is PortXmitWait increasing ? It is indicative of congestion. Perhaps some machine is...
View ArticleRe: SM LID is not configured warning
Hi Hal,Thanks for the help on this.I am running between two servers with the following:ntttcp.exe -r -a 16 -t 15 -m 16,*,10.1.4.11ntttcp.exe -s -a 16 -t 15 -m 16,*,10.1.4.11 Which two servers does not...
View ArticleRe: SM LID is not configured warning
PortXmitWait on sending side means some link is slow (I suspect sending side is faster than receiving side). I'm not familiar with Windows performance tuning. Is ntttcp throughput in bytes/sec or...
View ArticleRe: SM LID is not configured warning
Here is the full output, throughput is MegaBytes/Sec. To compare a normal 1GBE connection usually tests round 112 MB/S. These have been in the 1500-2000 range.Copyright Version 5.31Network activity...
View ArticleRe: SM LID is not configured warning
112MB/s * 8 bits/byte = 892 Mb/s which is close to 1 Gbps so that makes sense to me. 1500-2000 MB/s = 12-16 Gb/s. 40 Gbps IB is 32 Gbps data rate max so that's .375-.5 of the 4x QDR IB "line" rate.
View ArticleClik here to view.
Re: SM LID is not configured warning
Indeed, I feel like 75-90% of line rate is what I should expect. My experience with infiniband is pretty much none though, so maybe this is the expected throughput for IPoIB? I kinda doubt it. It...
View ArticleRe: SM LID is not configured warning
In general, IPoIB does not show off IB performance but this largely depends on packet sizes used. The fact that the throughput is independent of which machines used indicates that it's either host...
View ArticleRe: SM LID is not configured warning
Thanks Hal, I appreciate the help. I will probably create a fresh question about speed benchmarks/tuning as its a bit off topic from what this started as.
View ArticleSlow speeds and PortXmitWait - Any tips?
Hi Everyone,I have a new setup using 3 windows server hosts running WinOF with dual port Connectx-2 cards. These connect to two 4036 switches (one port to each switch and two links between switches)....
View Article