http://blog.gmane.org/gmane.linux.drivers.openib hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.linux.drivers.openib/58856 This is the Agenda for the OFED meeting today: 1. Bug list review: 1421 blo raisch< at >de.ibm.com ipoib/ehca crash when bouncing network 1413 cri jackm< at >mellanox.co.il rmmod mlx4_ib deadlock - on work 1384 maj eli< at >mellanox.co.il netperf latency small messages increase 5% - UD mode issue, seems caused by LRO 1386 maj eli< at >mellanox.co.il ofed 1.4 - iperf tcp connected mode BW large messages dec... - RC mode - not reproduced for now 1395 maj vu< at >mellanox.com kernel panic during SRP HA test - on work 1419 maj vlad< at >mellanox.co.il Iperf-2.0.4 fails: page allocation failure. order:5 1423 maj jackm< at >mellanox.co.il RDMA_Write RC small message bw degradation jitter of 6% - doing more measurements 2. UNH Logo testing update 3. Issue with new Intel MPI Benchmark (IMB, known as Pallas). In OFED 1.3 we used IMB 3.0 and in OFED 1.4 we upgraded the IMB to 3.1 version. During our performance verification we found 5% latency degradation with IMB 3.1 multi PingPong benchmark (we compare th Tziporet Koren 2008-12-01T16:21:17 http://comments.gmane.org/gmane.linux.drivers.openib/58855 Does anyone know why this value is being altered by OFED? "net.ipv4.tcp_timestamps" is being set to 0 during OFED installation.  Default value of this parameter is set to 1 on standard RHEL/SLES distros which OFED installation script modifies to 0.  Also, when OFED is uninstalled, it does not reset these sysctl parameters to their original values. This parameter is specifically recommended to be turned ON for High performance network.  This is a TCP option that can be used to calculate the Round Trip Measurement in a better and more accurate way than the retransmission timeout method can.  Accurate value of retransmission timeout should be determined to avoid unnecessary retransmissions and hence to improve TCP performance.  RFC 1323 talks about this TCP extension for High Performance.  When the parameter net.ipv4.tcp_timestamps=1, then it adds extra 12 bytes into TCP header increasing its size.  This has an obvious effect of decrease in bandwidth as we have some extra data flowing.  Is this t John Russo 2008-12-01T15:33:27 http://comments.gmane.org/gmane.linux.drivers.openib/58854 John Russo 2008-12-01T15:29:03 http://comments.gmane.org/gmane.linux.drivers.openib/58852 Set from two patches for support IPv6 protocol in RMDA CM Changes: Use two patches instead of six. This patch adds IPv6 support for IB address resolution. From: Aleksey Senin <alekseys< at >voltaire.com> Date: Mon, 1 Dec 2008 13:55:01 +0200 Subject: [PATCH] IB addr IPv6 support Support for network discovery in addr_send_arp function. Local IPv6 address resolution. Added remote IPv6 address resolusion for RDMA CM. Function addr_resolve_remote used as wrapper for two other functions: addr4_resolve_remote ( original addr_resolve_remote ) addr6_resolve_remote ( new function ) Signed-off-by: Aleksey Senin <alekseys< at >voltaire.com> :100644 100644 f95d21f... d9170c6... Mdrivers/infiniband/core/addr.c diff --git a/drivers/infiniband/core/addr.c b/drivers/infiniband/core/addr.c index f95d21f..d9170c6 100644 --- a/drivers/infiniband/core/addr.c +++ b/drivers/infiniband/core/addr.c < at >< at > -43,6 +43,7 < at >< at > #include <net/netevent.h> #include <net/addrconf.h> #include <rdma/ib_addr.h> +#include <net/ip6_route.h> MODU Aleksey Senin 2008-12-01T13:16:44 http://comments.gmane.org/gmane.linux.drivers.openib/58851 mlx4_ib: Fix MTT leakage in resize_cq. MTTs associated with the old CQE buffer were not deallocated (i.e., returned to the free pool). As a result, the MTT free pool was eventually completely emptied (for users of resize_cq). Once the resize_cq command returns successfully from FW, FW no longer accesses the old CQE buffer, so it is safe to deallocate the MTT entries used by the old CQE buffer. Finally, if the resize_cq command fails, the MTTs allocated for the new CQEs buffer also need to be de-allocated. Signed-off-by: Jack Morgenstein <jackm< at >dev.mellanox.co.il> --- Roland, Resize_cq is already in kernel 2.6.27, so I think this fix should go into a "latest stable" kernel version (say, 2.6.27.8). For heavy resize_cq users, such as MPI, this fix is significant. There is no need to call mlx4_mtt_cleanup separately for userspace and kernel-space paths -- this way the call is made in only one place. Actually, we cannot call mlx4_mtt_cleanup inside a spinlock anyway, because it may sleep (it indirectly Jack Morgenstein 2008-12-01T12:32:38 http://comments.gmane.org/gmane.linux.drivers.openib/58850 This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_4/linux-2.6.git git_branch: ofed_kernel Common build parameters: Passed: Passed on i686 with linux-2.6.16 Passed on i686 with linux-2.6.17 Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.27 Passed on x86_64 with linux-2.6.16 Passed on x86_64 with linux-2.6.16.21-0.8-smp Passed on x86_64 with linux-2.6.16.43-0.3-smp Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.17 Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-1.2798.fc6 Passed on x86_64 with linux-2.6.18-8.el5 Passed on x86_64 with linux-2.6.18-53.el5 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.18-93.el5 Passed on x86_64 with linux-2.6.22 Passed on x86_64 with li Vladimir Sokolovsky (Mellanox 2008-12-01T11:20:34 http://comments.gmane.org/gmane.linux.drivers.openib/58847 Hi, This is not necessary the best place to post it but I was wondering why is ofed's gitweb so slow on the main page? It takes only a few seconds to display all the repository on kernel.org (and there's a lot more) but it takes nearly a minute to display the OFED git main page... I know it's probably not the most critical issue you have to work on but I connect quite often on this page and it starts to be really bugging me. And I'm probably not the only one ;) Thanks in advance Nicolas Morey-Chaisemartin Nicolas Morey Chaisemartin 2008-12-01T07:11:31 http://comments.gmane.org/gmane.linux.drivers.openib/58835 Sasha, This patch adds language to show_usage for the --do_mesh_analysis flag. Regards, Bob Pearson Signed-off-by: Bob Pearson <rpearson< at >systemfabricworks.com> Robert Pearson 2008-11-30T18:51:53 http://comments.gmane.org/gmane.linux.drivers.openib/58834 Sasha, This patch adds some descriptive language to current_routing.txt and opensm.8.in. Regards, Bob Pearson Signed-off-by: Bob Pearson <rpearson< at >systemfabricworks.com> Robert Pearson 2008-11-30T18:39:53 http://comments.gmane.org/gmane.linux.drivers.openib/58822 This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_4/linux-2.6.git git_branch: ofed_kernel Common build parameters: Passed: Passed on i686 with linux-2.6.16 Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.17 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.27 Passed on x86_64 with linux-2.6.16 Passed on x86_64 with linux-2.6.16.43-0.3-smp Passed on x86_64 with linux-2.6.16.21-0.8-smp Passed on x86_64 with linux-2.6.17 Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-8.el5 Passed on x86_64 with linux-2.6.18-1.2798.fc6 Passed on x86_64 with linux-2.6.18-53.el5 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.18-93.el5 Passed on x86_64 with linux-2.6.22 Passed on x86_64 with li Vladimir Sokolovsky (Mellanox 2008-11-30T11:20:52 http://comments.gmane.org/gmane.linux.drivers.openib/58821 ib_mthca: Fix dispatch of IB_EVENT_LID_CHANGE When snooping a portinfo MAD, its client_reregister bit is checked. If the bit is ON then a CLIENT_REREGISTER event is dispatched, otherwise a LID_CHANGE event is dispatched. This ignores the cases where the MAD changes the LID along with an instruction to reregister (so a necessary LID_CHANGE event won't be dispatched), or the MAD is neither of these (and an unnecessary LID_CHANGE event is dispatched). This patch dispatches an event if the client_reregister bit is set. In addition, the patch compares the LID in the MAD to the current LID. If and only if they are not identical, a LID_CHANGE event is dispatched. From: Moni Shoua <monis< at >voltaire.com> Signed-off-by: Moni Shoua <monis< at >voltaire.com> Signed-off-by: Jack Morgenstein <jackm< at >dev.mellanox.co.il> Signed-off-by: Yossi Etigin <yosefe< at >voltaire.com> --- Roland, Here is Moni's patch separated into two patches, one for mlx4_ib and one for ib_mthca. Jack Index: infiniband/drivers/infiniband/hw/mthca/mthca Jack Morgenstein 2008-11-30T08:29:01 http://comments.gmane.org/gmane.linux.drivers.openib/58817 This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_4/linux-2.6.git git_branch: ofed_kernel Common build parameters: Passed: Passed on i686 with linux-2.6.16 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.17 Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.27 Passed on x86_64 with linux-2.6.16 Passed on x86_64 with linux-2.6.16.43-0.3-smp Passed on x86_64 with linux-2.6.16.21-0.8-smp Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.17 Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-1.2798.fc6 Passed on x86_64 with linux-2.6.18-8.el5 Passed on x86_64 with linux-2.6.18-53.el5 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.18-93.el5 Passed on x86_64 with linux-2.6.22 Passed on x86_64 with li Vladimir Sokolovsky (Mellanox 2008-11-29T11:20:09 http://comments.gmane.org/gmane.linux.drivers.openib/58816 We discovered a strange problem running OFED; We're not sure if it is a OFED problem but we post it here anyway. Short description: We have a program that allocates a set of buffers with valloc, sends them with ibv_post_send and free them. This is run in loop; We have a "caching"-algorithm so that we register memory only the first time we come across a buffer address. We starts getting wrong data for parts of sends after a couple of iterations There are a few things worth mentioning: - We must use valloc; the test works with malloc - We must have a malloc allocating a too large chunk before starting the loop (the malloc fails) We have modified the "rdma_lat.c" program to show the error (attached) Regards Asmund /* * Copyright (c) 2005 Topspin Communications. All rights reserved. * Copyright (c) 2005 Mellanox Technologies Ltd. All rights reserved. * Copyright (c) 2005 Hewlett Packard, Inc (Grant Grundler) * * This software is available to you under a choice of one of two * licenses. You may Asmund Ostvold 2008-11-29T09:00:42 http://comments.gmane.org/gmane.linux.drivers.openib/58812 This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_4/linux-2.6.git git_branch: ofed_kernel Common build parameters: Passed: Passed on i686 with linux-2.6.16 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.17 Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.27 Passed on x86_64 with linux-2.6.16 Passed on x86_64 with linux-2.6.16.43-0.3-smp Passed on x86_64 with linux-2.6.16.21-0.8-smp Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.17 Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-1.2798.fc6 Passed on x86_64 with linux-2.6.18-8.el5 Passed on x86_64 with linux-2.6.18-53.el5 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.18-93.el5 Passed on x86_64 with linux-2.6.22 Passed on x86_64 with li Vladimir Sokolovsky (Mellanox 2008-11-28T11:28:01 http://comments.gmane.org/gmane.linux.drivers.openib/58802 This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_4/linux-2.6.git git_branch: ofed_kernel Common build parameters: Passed: Passed on i686 with linux-2.6.16 Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.17 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.27 Passed on x86_64 with linux-2.6.16 Passed on x86_64 with linux-2.6.16.43-0.3-smp Passed on x86_64 with linux-2.6.16.21-0.8-smp Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.17 Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-1.2798.fc6 Passed on x86_64 with linux-2.6.18-8.el5 Passed on x86_64 with linux-2.6.18-53.el5 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.18-93.el5 Passed on x86_64 with linux-2.6.21.1 Passed on x86_64 with Vladimir Sokolovsky (Mellanox 2008-11-27T11:24:29 http://comments.gmane.org/gmane.linux.drivers.openib/58801 Hi all, We have recently been experimenting with IB on debian, and in the course of this work I have built a basic set of OFED-1.3.1 debian packages for our internal use. With a bit more effort the packages could be worked into a state suitable for inclusion into the main Debian archives. Before I start this I would like ensure that I am not re-inventing the wheel; is anyone else working on this? Cheers, Guy Guy Coates 2008-11-27T10:36:15 http://comments.gmane.org/gmane.linux.drivers.openib/58800 Yicheng Jia 2008-11-26T22:18:48 http://comments.gmane.org/gmane.linux.drivers.openib/58794 Changes from v3: This set of patches based on the latest, 2.6.28-rc4 kernel. From: Aleksey Senin <alekseys< at >voltaire.com> Date: Wed, 13 Aug 2008 09:55:33 +0300 Subject: [PATCH] AF_INET6 support for rdma_bind_addr Signed-off-by: Aleksey Senin <alekseys< at >voltaire.com> --- drivers/infiniband/core/cma.c | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/drivers/infiniband/core/cma.c b/drivers/infiniband/core/cma.c index d951896..4728265 100644 --- a/drivers/infiniband/core/cma.c +++ b/drivers/infiniband/core/cma.c < at >< at > -2073,7 +2073,7 < at >< at > int rdma_bind_addr(struct rdma_cm_id *id, struct sockaddr *addr) struct rdma_id_private *id_priv; int ret; -if (addr->sa_family != AF_INET) +if (addr->sa_family != AF_INET && addr->sa_family != AF_INET6) return -EAFNOSUPPORT; id_priv = container_of(id, struct rdma_id_private, id); Aleksey Senin 2008-11-26T17:51:39 http://comments.gmane.org/gmane.linux.drivers.openib/58792 Marina Lipshteyn 2008-11-26T16:07:41 http://comments.gmane.org/gmane.linux.drivers.openib/58790 This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_4/linux-2.6.git git_branch: ofed_kernel Common build parameters: Passed: Passed on i686 with linux-2.6.16 Passed on i686 with linux-2.6.17 Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.27 Passed on x86_64 with linux-2.6.16 Passed on x86_64 with linux-2.6.16.43-0.3-smp Passed on x86_64 with linux-2.6.16.21-0.8-smp Passed on x86_64 with linux-2.6.17 Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-1.2798.fc6 Passed on x86_64 with linux-2.6.18-8.el5 Passed on x86_64 with linux-2.6.18-53.el5 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.18-93.el5 Passed on x86_64 with linux-2.6.21.1 Passed on x86_64 with Vladimir Sokolovsky (Mellanox 2008-11-26T11:23:50 http://comments.gmane.org/gmane.linux.drivers.openib/58789 Add 10G IP router device id for grouping. Signed-off-by: Sasha Khapyorsky <sashak< at >voltaire.com> --- infiniband-diags/include/grouping.h | 1 + infiniband-diags/src/grouping.c | 3 ++- 2 files changed, 3 insertions(+), 1 deletions(-) diff --git a/infiniband-diags/include/grouping.h b/infiniband-diags/include/grouping.h index 3ba872c..e54efef 100644 --- a/infiniband-diags/include/grouping.h +++ b/infiniband-diags/include/grouping.h < at >< at > -91,6 +91,7 < at >< at > struct AllChassisList { #define VTR_DEVID_ISR20120x5a39 #define VTR_DEVID_SFB20040x5a40 #define VTR_DEVID_ISR20040x5a41 +#define VTR_DEVID_SRB20040x5a42 enum ChassisType { UNRESOLVED_CT, ISR9288_CT, ISR9096_CT, ISR2012_CT, ISR2004_CT }; enum ChassisSlot { UNRESOLVED_CS, LINE_CS, SPINE_CS, SRBD_CS }; diff --git a/infiniband-diags/src/grouping.c b/infiniband-diags/src/grouping.c index e2b4488..f1a996f 100644 --- a/infiniband-diags/src/grouping.c +++ b/infiniband-diags/src/grouping.c < at >< at > -242,7 +242,8 < at >< at > static int is_spine(Node *node) sta Sasha Khapyorsky 2008-11-26T11:00:49 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.linux.drivers.openib