http://blog.gmane.org/gmane.mail.imap.dbmail.devel hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13167 <pre> The following issue has been SUBMITTED. ====================================================================== http://www.dbmail.org/mantis/view.php?id=1007 ====================================================================== Reported By: jvanvelden Assigned To: ====================================================================== Project: DBMail Issue ID: 1007 Category: Database layer Reproducibility: N/A Severity: minor Priority: normal Status: new target: ====================================================================== Date Submitted: 20-May-13 03:58 CEST Last Modified: 20-May-13 03:58 CEST ====================================================================== Summary: Enable support for postgres SSL Description: Currently there is no way to connect to a postgres DB using SSL Libzdb has support for this, but there is currently no way to enable it from the dbmail.conf configuration file. According to the libzdb documentation it is just a matter of appending "?use-ssl=true" to the db connection url. IE: postgresql://root:swordfish&lt; at &gt;localhost/test?use-ssl=true I'm am trying to use dbmail in a virtual server environment where the traffic between dbmail and postgres occurs on a shared network. Could this support please be added to dbmail Thank you ====================================================================== Issue History Date Modified Username Field Change ====================================================================== 20-May-13 03:58 jvanvelden New Issue ====================================================================== </pre> Mantis Bug Tracker 2013-05-20T01:58:53 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13166 <pre> At Thu, 14 Feb 2013 14:30:26 +0100, Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; wrote: It does not help. As I understand problem: - start timsieved for example - connect using telnet tool - timsieved gets socket_write_cb() but there is nothing to write and nothing to read, so it eats 100% CPU in empty loop on inactive connection. I saw the same with imapd server. Strace shown that poll continuously returns pollout for fd=1, but probably imapd has nothing to send. </pre> Sergej Pupykin 2013-05-17T12:56:04 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13165 <pre> The following issue has been SUBMITTED. ====================================================================== http://www.dbmail.org/mantis/view.php?id=1006 ====================================================================== Reported By: santa Assigned To: ====================================================================== Project: DBMail Issue ID: 1006 Category: Database layer Reproducibility: always Severity: minor Priority: normal Status: new target: ====================================================================== Date Submitted: 16-May-13 13:02 CEST Last Modified: 16-May-13 13:02 CEST ====================================================================== Summary: DBMail dies with SIGSEGV if no db connections are available Description: DBMail gets SIGSEGV if db_connect() gets NULL from ConnectionPool_getConnection(). SIGSEGV is received either when some imap command is processed and database is going down or when dbmail server starts and database is already down. ====================================================================== Issue History Date Modified Username Field Change ====================================================================== 16-May-13 13:02 santa New Issue 16-May-13 13:02 santa File Added: connection-sigsegv-fix.diff ====================================================================== </pre> Mantis Bug Tracker 2013-05-16T11:02:50 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13164 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via 41e06486d9dfdce008b86060eb34fb15b1b0e4f4 (commit) from 81b6fe03ca7eb4b25246dd58b8512f3a7ed2c654 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 41e06486d9dfdce008b86060eb34fb15b1b0e4f4 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Tue May 7 15:44:55 2013 +0200 IMAP: use raw headers instead of gmime parsed ones during bodystructure commands ----------------------------------------------------------------------- Summary of changes: src/dm_misc.c | 115 +++++++++++++++++++++++++++++++++----------- test/check_dbmail.h | 30 ++++++++++++ test/check_dbmail_imapd.c | 15 +++++- 3 files changed, 129 insertions(+), 31 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-05-07T13:45:00 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13163 <pre> A NOTE has been added to this issue. ====================================================================== http://www.dbmail.org/mantis/view.php?id=1005 ====================================================================== Reported By: sergej Assigned To: ====================================================================== Project: DBMail Issue ID: 1005 Category: general delivery Reproducibility: always Severity: major Priority: normal Status: new target: ====================================================================== Date Submitted: 04-Apr-13 19:16 CEST Last Modified: 05-Apr-13 17:57 CEST ====================================================================== Summary: dbmail break quoted printable headers Description: dbmail breaks quoted printable subject header on delivery by wrong line wrapping. May be the bug is in gmime 2.4. Each line of folded quoted printable encoded subject should be prefixed by =?UTF-8?Q? ====================================================================== ---------------------------------------------------------------------- (0003520) paul (administrator) - 05-Apr-13 15:27 http://www.dbmail.org/mantis/view.php?id=1005#c3520 ---------------------------------------------------------------------- This only happens if there is no Return-Path header on the message during delivery. DBMail adds such a header (fixes http://www.dbmail.org/mantis/view.php?id=145) which should have been done by the MTA - rfc2821, and that triggers the unexpected behaviour in gmime. I've contacted the gmime maintainer to see if we can solve this. In the mean time: fix your MTA or add a Return-Path if you are manually inserting messages without using an MTA. ---------------------------------------------------------------------- (0003521) paul (administrator) - 05-Apr-13 17:57 http://www.dbmail.org/mantis/view.php?id=1005#c3521 ---------------------------------------------------------------------- initial feedback from the gmime author indicates a broken utf7 encoded header (no space before the encoded part) the broken folding looks like a gmime bug alright. we'll work on a workaround fix in both gmime and dbmail for this Issue History Date Modified Username Field Change ====================================================================== 04-Apr-13 19:16 sergej New Issue 05-Apr-13 15:27 paul Note Added: 0003520 05-Apr-13 17:57 paul Note Added: 0003521 ====================================================================== </pre> Mantis Bug Tracker 2013-04-05T15:57:26 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13162 <pre> A NOTE has been added to this issue. ====================================================================== http://dbmail.org/mantis/view.php?id=1005 ====================================================================== Reported By: sergej Assigned To: ====================================================================== Project: DBMail Issue ID: 1005 Category: general delivery Reproducibility: always Severity: major Priority: normal Status: new target: ====================================================================== Date Submitted: 04-Apr-13 19:16 CEST Last Modified: 05-Apr-13 15:27 CEST ====================================================================== Summary: dbmail break quoted printable headers Description: dbmail breaks quoted printable subject header on delivery by wrong line wrapping. May be the bug is in gmime 2.4. Each line of folded quoted printable encoded subject should be prefixed by =?UTF-8?Q? ====================================================================== ---------------------------------------------------------------------- (0003520) paul (administrator) - 05-Apr-13 15:27 http://dbmail.org/mantis/view.php?id=1005#c3520 ---------------------------------------------------------------------- This only happens if there is no Return-Path header on the message during delivery. DBMail adds such a header (fixes http://dbmail.org/mantis/view.php?id=145) which should have been done by the MTA - rfc2821, and that triggers the unexpected behaviour in gmime. I've contacted the gmime maintainer to see if we can solve this. In the mean time: fix your MTA or add a Return-Path if you are manually inserting messages without using an MTA. Issue History Date Modified Username Field Change ====================================================================== 04-Apr-13 19:16 sergej New Issue 05-Apr-13 15:27 paul Note Added: 0003520 ====================================================================== </pre> Mantis Bug Tracker 2013-04-05T13:27:16 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13161 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via 81b6fe03ca7eb4b25246dd58b8512f3a7ed2c654 (commit) via 7a8608ccb15ba93776c467fe6d07dd5eba6a4b4d (commit) via 6d539b3923cfac6d7b2877289ecf57072105740c (commit) from e10143b6804824bffc20752251578de734a01df8 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 81b6fe03ca7eb4b25246dd58b8512f3a7ed2c654 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Fri Apr 5 17:57:36 2013 +0200 activate gmime rfc2047 workaround and add test case for #1005 commit 7a8608ccb15ba93776c467fe6d07dd5eba6a4b4d Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Fri Apr 5 17:54:26 2013 +0200 style cleanup commit 6d539b3923cfac6d7b2877289ecf57072105740c Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Fri Apr 5 17:54:04 2013 +0200 defer updating stream ----------------------------------------------------------------------- Summary of changes: src/dbmail-message.c | 4 -- src/dm_misc.c | 6 ++- src/export.c | 2 +- src/httpd.c | 2 +- src/main.c | 2 +- src/maintenance.c | 2 +- src/server.c | 2 +- test/check_dbmail.h | 7 ++++ test/check_dbmail_deliver.c | 2 +- test/check_dbmail_imapd.c | 4 +- test/check_dbmail_mailbox.c | 2 +- test/check_dbmail_mailboxstate.c | 2 +- test/check_dbmail_message.c | 58 +++++++++++++++++++++++++++++-------- test/check_dbmail_misc.c | 2 +- test/check_dbmail_server.c | 2 +- 15 files changed, 68 insertions(+), 31 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-04-05T15:57:40 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13160 <pre> The following issue has been SUBMITTED. ====================================================================== http://dbmail.org/mantis/view.php?id=1005 ====================================================================== Reported By: sergej Assigned To: ====================================================================== Project: DBMail Issue ID: 1005 Category: general delivery Reproducibility: always Severity: major Priority: normal Status: new target: ====================================================================== Date Submitted: 04-Apr-13 19:16 CEST Last Modified: 04-Apr-13 19:16 CEST ====================================================================== Summary: dbmail break quoted printable headers Description: dbmail breaks quoted printable subject header on delivery by wrong line wrapping. May be the bug is in gmime 2.4. Each line of folded quoted printable encoded subject should be prefixed by =?UTF-8?Q? ====================================================================== Issue History Date Modified Username Field Change ====================================================================== 04-Apr-13 19:16 sergej New Issue ====================================================================== </pre> Mantis Bug Tracker 2013-04-04T17:16:12 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13159 <pre> A NOTE has been added to this issue. ====================================================================== http://dbmail.org/mantis/view.php?id=1000 ====================================================================== Reported By: svepie Assigned To: ====================================================================== Project: DBMail Issue ID: 1000 Category: Command-Line programs (dbmail-users, dbmail-util) Reproducibility: always Severity: major Priority: normal Status: new target: ====================================================================== Date Submitted: 10-Jan-13 17:14 CET Last Modified: 01-Apr-13 12:21 CEST ====================================================================== Summary: dbmail-export creates empty mailboxes Description: Starting dbmail-export creates empty maildir and mailboxes. We inject Mails via dbmail-deliver just fine and can read them via dbmail-imapd in thunderbird. but when trying to export mails into mbox or maildir format it just creates empty mailboxes. We are Using dbmail with postfix and mysql. Only dbmail-export isnt running ====================================================================== ---------------------------------------------------------------------- (0003513) paul (administrator) - 15-Jan-13 10:25 http://dbmail.org/mantis/view.php?id=1000#c3513 ---------------------------------------------------------------------- looks to me like your exporting an empty mailbox. ---------------------------------------------------------------------- (0003514) svepie (reporter) - 15-Jan-13 10:40 http://dbmail.org/mantis/view.php?id=1000#c3514 ---------------------------------------------------------------------- After looking into the sourcecode, i spotted that the default value on the IMAP SEARCH string is not working properly. Running dbmail-export -u &lt;username&gt; -s 1:* seems to work properly. ---------------------------------------------------------------------- (0003519) sergej (reporter) - 01-Apr-13 12:21 http://dbmail.org/mantis/view.php?id=1000#c3519 ---------------------------------------------------------------------- The same issue on Arch Linux. Thanks for workaround. Issue History Date Modified Username Field Change ====================================================================== 10-Jan-13 17:14 svepie New Issue 15-Jan-13 10:25 paul Note Added: 0003513 15-Jan-13 10:40 svepie Note Added: 0003514 01-Apr-13 12:21 sergej Note Added: 0003519 ====================================================================== </pre> Mantis Bug Tracker 2013-04-01T10:21:54 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13158 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via e10143b6804824bffc20752251578de734a01df8 (commit) from 210485dd5592bf23ac9335a2d3f5711e62753605 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit e10143b6804824bffc20752251578de734a01df8 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Fri Feb 8 09:58:06 2013 +0100 audit signal handling and memory cleanups ----------------------------------------------------------------------- Summary of changes: src/dbmail-imapsession.c | 20 ++++++++++++---- src/dm_debug.c | 4 +- src/dm_mempool.c | 2 +- src/server.c | 55 ++++++++++++++++++++++++-------------------- test/check_dbmail_imapd.c | 1 + 5 files changed, 49 insertions(+), 33 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-03-29T15:45:59 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13157 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via 210485dd5592bf23ac9335a2d3f5711e62753605 (commit) from f131b2ec6c605b66e4ba1187a202ce970d485f6e (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 210485dd5592bf23ac9335a2d3f5711e62753605 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Wed Mar 27 15:38:50 2013 +0100 IMAP: use faster query for flag counting ----------------------------------------------------------------------- Summary of changes: src/dm_mailboxstate.c | 31 ++++++++++++---------------- test/check_dbmail_mailboxstate.c | 41 +++++++++++++++++++++++++++++++++++-- 2 files changed, 51 insertions(+), 21 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-03-27T14:38:53 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13155 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via f131b2ec6c605b66e4ba1187a202ce970d485f6e (commit) via 40cc8756609155fc598379327317199ee42b2c50 (commit) from 71c4f90c17fd120589225044ae2fcdc61fd84613 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit f131b2ec6c605b66e4ba1187a202ce970d485f6e Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Fri Mar 1 11:25:40 2013 +0100 IMAP: imaptest fixes commit 40cc8756609155fc598379327317199ee42b2c50 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Fri Mar 1 10:47:24 2013 +0100 IMAP: fix tree error ----------------------------------------------------------------------- Summary of changes: src/dbmail-imapsession.c | 2 +- src/dbmail-message.c | 2 +- src/dm_mailboxstate.c | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-03-01T10:25:49 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13154 <pre> Paul, I won't do that :) Will test with released versions only, git only if needed, </pre> Jorge Bastos 2013-03-01T09:32:33 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13153 <pre> Jorge, Don't test git-master on your production server. That is *not* what I meant. </pre> Paul J Stevens 2013-03-01T08:35:39 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13152 <pre>Paul, You know I always did testing, just haven't done it due to lack of time. ASAP I'll restart work on it, my configuration may be very interesting to be tested. XEON E3 1230 12GB RAM ECC 2x 1TB SATA3 disks on Linux RAID 1. Database size of 160GB About 2000 users Daily traffic maybe about 20/30 connections per second on a primary dedicated 5Mbit uplink, and a 1Mbit upload (a mix of roundrobin and/or backup for particular domains) I need to start the upgrade, and when I do it I'll give you feedback. I'm with a version about in 2.3.6, that needs to be upgraded! Jorge, </pre> Jorge Bastos 2013-02-28T23:48:22 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13151 <pre> Excusez moi le mot, but how the f*ck should I know. I can only test so much you know. A lot of the 'leakage' mentioned here and there is not leakage at all, but memory fragmentation or side effects from GLib's slice allocator. I've added a memory pool implementation to isolate a lot of the allocation and have been testing jemalloc. Results are much the same all over. You can test those features: Activate the experimental memory pool: export DM_POOL=yes De-activate the slice allocator: export G_SLICE=all Use jemalloc: ../configure --with-jemalloc=yes There probably still is some leakage in the imap code, which will occur under severe concurrency pressure. Restarting is the only solution atm. I've been thinking about adding a additional layer to take care of automatic restarts. A bit like 2.2's preforking: - one master process and one forked child to handle the workload. - the master process can then fire up a new child when needed, and gracefully shut down the stale one. </pre> Paul J Stevens 2013-02-28T15:11:54 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13150 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via 71c4f90c17fd120589225044ae2fcdc61fd84613 (commit) via 72b77e760e06d1e43c78dc48f24e6182e25ec79f (commit) via 01096285571ff3054ceaa6f2290e9edde3867166 (commit) from 1f43e8926da69409ce5e4b22a44cf0f9ec9268ff (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 71c4f90c17fd120589225044ae2fcdc61fd84613 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Thu Feb 28 15:55:27 2013 +0100 use more prepared statements; bug #1004 commit 72b77e760e06d1e43c78dc48f24e6182e25ec79f Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Thu Feb 28 15:01:29 2013 +0100 fix deadlock in unit-test commit 01096285571ff3054ceaa6f2290e9edde3867166 Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Thu Feb 28 15:00:40 2013 +0100 fix unit-test ----------------------------------------------------------------------- Summary of changes: src/dbmail-mailbox.c | 87 ++++++++++++++++++++++------------------- src/dbmail-message.c | 48 ++++++++++++++-------- src/dm_db.c | 39 ++++++++++++++---- src/dm_mailboxstate.c | 94 ++++++++++++++++++++++++++++++++------------ src/dm_string.c | 1 + test/check_dbmail_imapd.c | 1 - test/check_dbmail_string.c | 2 +- 7 files changed, 178 insertions(+), 94 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-02-28T14:55:31 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13149 <pre>Hi Paul, Allow me to ask, with this job, you the remaining memory leaks were killed? Jorge, </pre> Jorge Bastos 2013-02-28T13:54:36 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13148 <pre>This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Paul's DBMail tree". The branch, master has been updated via 1f43e8926da69409ce5e4b22a44cf0f9ec9268ff (commit) via d4bd29851a5cb6b43e6790c550568db96060208a (commit) from 1cc3789d0bf70bb134224612515495294f58f8bd (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 1f43e8926da69409ce5e4b22a44cf0f9ec9268ff Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Thu Feb 28 12:45:41 2013 +0100 disable the experimental memory pool by default use DM_POOL=yes to activate the memory pool commit d4bd29851a5cb6b43e6790c550568db96060208a Author: Paul J Stevens &lt;paul-oMN9YZNO2BY&lt; at &gt;public.gmane.org&gt; Date: Thu Feb 28 11:10:18 2013 +0100 closing fd and memory leaks ----------------------------------------------------------------------- Summary of changes: src/clientbase.c | 271 +++++++++++++++++++++++----------------------- src/clientsession.c | 99 +++++++++++++++-- src/dbmail-imapsession.c | 11 ++- src/dbmail-imapsession.h | 2 +- src/dm_dsn.c | 9 ++- src/dm_mailboxstate.c | 9 +- src/dm_mempool.c | 4 +- src/imap4.c | 5 +- src/imapcommands.c | 2 +- src/lmtp.c | 5 +- src/pop3.c | 51 +++------ src/server.c | 64 ++++++++---- 12 files changed, 315 insertions(+), 217 deletions(-) hooks/post-receive -- Paul's DBMail tree </pre> Paul J Stevens 2013-02-28T11:46:12 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13147 <pre> The following issue has been SUBMITTED. ====================================================================== http://www.dbmail.org/mantis/view.php?id=1004 ====================================================================== Reported By: santa Assigned To: ====================================================================== Project: DBMail Issue ID: 1004 Category: Database layer Reproducibility: have not tried Severity: tweak Priority: normal Status: new target: ====================================================================== Date Submitted: 28-Feb-13 09:40 CET Last Modified: 28-Feb-13 09:40 CET ====================================================================== Summary: Migrate remaining plain text SQLs to prepared statements Description: dbmail have a number of SQLs, created like this: r = db_query(c, "SELECT 0,COUNT(*) FROM %smessages WHERE mailbox_idnr=%llu ", ...); where the actual parameter is printf'd into the SQL string. This produces a number of similar requests with different WHERE condition and pollutes database query cache and leads to a performance penalty. Can this be improved with a prepared statements? ====================================================================== Issue History Date Modified Username Field Change ====================================================================== 28-Feb-13 09:40 santa New Issue ====================================================================== </pre> Mantis Bug Tracker 2013-02-28T08:40:40 http://permalink.gmane.org/gmane.mail.imap.dbmail.devel/13146 <pre> A NOTE has been added to this issue. ====================================================================== http://www.dbmail.org/mantis/view.php?id=957 ====================================================================== Reported By: gcth Assigned To: paul ====================================================================== Project: DBMail Issue ID: 957 Category: IMAP daemon Reproducibility: always Severity: major Priority: normal Status: confirmed target: ====================================================================== Date Submitted: 27-Jan-12 11:07 CET Last Modified: 27-Feb-13 13:06 CET ====================================================================== Summary: imapd leaks sockets Description: I'm currently using latest git dbmail with imap only, and I've noticed that it refuses connections after few hours of working. lsof shows lots of open sockets: dbmail-im 24466 dbmail 1352u sock 0,6 0t0 1917799 can't identify protocol dbmail-im 24466 dbmail 1353u sock 0,6 0t0 1917800 can't identify protocol dbmail-im 24466 dbmail 1354u sock 0,6 0t0 1917801 can't identify protocol dbmail-im 24466 dbmail 1355u sock 0,6 0t0 1917802 can't identify protocol dbmail-im 24466 dbmail 1356u sock 0,6 0t0 1917803 can't identify protocol dbmail-im 24466 dbmail 1357u sock 0,6 0t0 1917804 can't identify protocol dbmail-im 24466 dbmail 1358u sock 0,6 0t0 1917805 can't identify protocol they are increasing in time leading to saturation of nofiles ulimit. This problem applies to imapd, I could not reproduce this problem with pop3. Typical clients connects with latest thundderbird, mostly from local LAN. Increasing ulimit -n to 8192 allows enough leaks to last for whole day, so now as a workaround I restart dbmail every night. I'm attaching munin graph for: lsof -ln -u dbmail | grep ^dbmail-im | fgrep sock\ -c during normal work hours. ====================================================================== ---------------------------------------------------------------------- (0003392) paul (administrator) - 27-Jan-12 16:35 http://www.dbmail.org/mantis/view.php?id=957#c3392 ---------------------------------------------------------------------- I can confirm this. Looks like there is a thread-race in the imap code. ---------------------------------------------------------------------- (0003429) gcth (reporter) - 03-Apr-12 17:07 http://www.dbmail.org/mantis/view.php?id=957#c3429 ---------------------------------------------------------------------- In current master this bug is still present. Any chances for a fix? What else do you need to debug this? ---------------------------------------------------------------------- (0003449) vampyre (reporter) - 15-May-12 19:46 http://www.dbmail.org/mantis/view.php?id=957#c3449 ---------------------------------------------------------------------- Hello Paul, Could you please share your assumptions if you have some, as this is quite major issue and it is important to get it fixed as fast as possible. Thank you. ---------------------------------------------------------------------- (0003456) JensKapitza (reporter) - 06-Jun-12 17:32 http://www.dbmail.org/mantis/view.php?id=957#c3456 ---------------------------------------------------------------------- Can be produced with going offline in thunderbird seems to be a problem in gooing offine (closing thunderbird) works ---------------------------------------------------------------------- (0003505) nickdb161 (reporter) - 02-Nov-12 14:48 http://www.dbmail.org/mantis/view.php?id=957#c3505 ---------------------------------------------------------------------- I am using Postfix/Dovecot proxy/DBMail and get this problem of running out of file descriptors (although the sockets seem to close correctly - none remaining in netstat?). I have enclosed extracts of the debugging output which indicates where the problem might be occurring: dbmail/imap4d[18505]: [0x822fc0] Notice:[imap] _ic_logout(+179): [0x883220] userid:[0] dbmail/imap4d[18505]: [0x822fc0] Debug:[imap] imap_handle_input(+396): imap4 returned [2] dbmail/imap4d[18505]: [0x822fc0] Debug:[imap] imap_handle_exit(+262): [0x883220] state [4] command_status [0] [LOGOUT] returned with status [2] dbmail/imap4d[18505]: [0x822fc0] Info:[clientbase] ci_write(+312): [0x9a9020] S &gt; [7/7:* BYE#015#012] dbmail/imap4d[18505]: [0x822fc0] Debug:[clientbase] client_error_cb(+134): [0x9a9020] 18 Broken pipe[32], 0x9a9020 dbmail/imap4d[18505]: [0x822fc0] Debug:[imap] imap_session_printf(+201): ci_write failed [Unknown error 18446744073709551615] dbmail/imap4d[18505]: [0x822fc0] Debug:[imap] dbmail_imap_session_set_state(+1562): state [6] dbmail/imap4d[18505]: [0x822fc0] Debug:[imap] dbmail_imap_session_set_state(+1591): [0x883220] state [4]-&gt;[6] I am having to restart dbmail-imapd at least once per day to avoid this. I do not want to increase the file descriptors. Hope this is of some use. ---------------------------------------------------------------------- (0003508) vampyre (reporter) - 07-Dec-12 09:58 http://www.dbmail.org/mantis/view.php?id=957#c3508 ---------------------------------------------------------------------- Hello Paul, It looks like a lot of work has been done to improve the situation, could you please announce expected delivery date of some release candidate. Thank you. ---------------------------------------------------------------------- (0003512) vampyre (reporter) - 10-Jan-13 08:46 http://www.dbmail.org/mantis/view.php?id=957#c3512 ---------------------------------------------------------------------- Hello Paul, Is there any new information regarding "delivery date"? Looking forward to to hearing from you. ---------------------------------------------------------------------- (0003518) santa (reporter) - 27-Feb-13 13:06 http://www.dbmail.org/mantis/view.php?id=957#c3518 ---------------------------------------------------------------------- Hi! Possible solution attached (master branch). Issue History Date Modified Username Field Change ====================================================================== 27-Jan-12 11:07 gcth New Issue 27-Jan-12 11:07 gcth File Added: sockets.png 27-Jan-12 16:35 paul Note Added: 0003392 27-Jan-12 16:35 paul Assigned To =&gt; paul 27-Jan-12 16:35 paul Status new =&gt; confirmed 03-Apr-12 17:07 gcth Note Added: 0003429 15-May-12 19:46 vampyre Note Added: 0003449 06-Jun-12 17:32 JensKapitza Note Added: 0003456 02-Nov-12 14:48 nickdb161 Note Added: 0003505 07-Dec-12 09:58 vampyre Note Added: 0003508 10-Jan-13 08:46 vampyre Note Added: 0003512 27-Feb-13 13:05 santa File Added: socket-fd-leak.diff 27-Feb-13 13:06 santa Note Added: 0003518 ====================================================================== </pre> Mantis Bug Tracker 2013-02-27T12:06:15 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.mail.imap.dbmail.devel