http://blog.gmane.org/gmane.mail.imap.dbmail hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.mail.imap.dbmail/14657 <pre>I'm running DBMail from Git (e10143b6804824bffc20752251578de734a01df8) and I'm getting the following error whenever I try to deliver a message with LMTP. Can you spot what I'm doing wrong, or can I do anything to help fix this? Would any more details be helpful? ubuntu&lt; at &gt;ip-10-242-78-228:~$ telnet localhost 24 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 ip-10-242-78-228 LMTP LHLO example.com 250-ip-10-242-78-228 250-PIPELINING 250-ENHANCEDSTATUSCODES 250 SIZE MAIL FROM:&lt;alice&lt; at &gt;example.com&gt; 500 Sender already received. Use RSET to clear. </pre> Jack Bates 2013-05-17T15:18:46 http://comments.gmane.org/gmane.mail.imap.dbmail/14654 <pre>Hi. I just was going to look at the wiki and see if the dbmail upgrade instructions for 2.2 -&gt; 3.0 need to be improved, but I found this on the wiki start page: Floor lamps will be the latest bright idea in design with fun new models. Whatever lighting solution you have to enhance your indoor or outdoor living, choose fashionable lamps any room can be illuminated by you with a touch of charm. Floor lamps Looking at http://www.dbmail.org/dokuwiki/doku.php/start?do=revisions it seems there's been quite a bit of this spam recently. Maybe remove those users and put some extra checks in place ? (and/or only allow certain users/groups to edit things like the start page too ...) -- or make changes to existing - and important - pages to be moderated? (I could help out here if needed) Regards </pre> Thomas Raschbacher 2013-05-17T06:31:12 http://comments.gmane.org/gmane.mail.imap.dbmail/14649 <pre>I'm working on an upgrade from 2.2.1 to 3.0.2 I know, I should have done this a while ago, but I've been running Ubuntu and have not been able to get it to compile, nor are there any version out there in a repository (at least not a repository that I know about.). Anyway, the wiki documentation is non existent on upgrade instructions. Is there a document out there about how to upgrade the database? Do I need to run the scripts incrementally. beyond the database upgrade the rest of it should be "make install" Thanks in advance, Curtis </pre> Curtis Maurand 2013-05-15T16:58:47 http://comments.gmane.org/gmane.mail.imap.dbmail/14643 <pre>Has anyone gotten dbmail to successfully build in Ubuntu 12.04. I keep getting stupid stuff like: And I'm still trying to get "configure" to finish. sudo ./configure --prefix=/usr The following packages have unmet dependencies: libzdb-dev : Depends: libzdb7 (= 2.9-1) but it is not going to be installed E: Unable to correct problems, you have held broken packages. cmaurand&lt; at &gt;canon:~/dbmail-3.0.2$ sudo apt-get install libzdb-dev libzdb7 Reading package lists... Done Building dependency tree Reading state information... Done Some packages could not be installed. This may mean that you have requested an impossible situation or if you are using the unstable distribution that some required packages have not yet been created or been moved out of Incoming. The following information may help to resolve the situation: The following packages have unmet dependencies: libzdb7 : Depends: libmysqlclient16 (&gt;= 5.1.50-1) but it is not installable E: Unable to correct problems, you have held broken packages. Any help would be appreciated. thanks, Curtis </pre> Curtis Maurand 2013-05-14T18:57:40 http://comments.gmane.org/gmane.mail.imap.dbmail/14642 <pre>Hi, Now Debian 7 "Wheezy" is out, please could wheezy packages be made available on http://debian.nfgd.net/ ? -Joel van Velden </pre> Joel van Velden 2013-05-08T01:51:07 http://comments.gmane.org/gmane.mail.imap.dbmail/14639 <pre>hi. I just ran dbmail-util to check for errors/header stuff and I keep getting the following errors: Error when running dbmail-util -tbvy: Repairing DBMAIL for cached envelopes... Ok. Found [1] missing envelope values. May 05 22:33:11 lordvan.com dbmail-util[20498]: [0xb0b6c0] Error:[message] dbmail_message_cache_envelope(+1840): SQLException: ERROR: invalid byte sequence for encoding "UTF8": 0xbd May 05 22:33:11 lordvan.com dbmail-util[20498]: [0xb0b6c0] Error:[message] dbmail_message_cache_envelope(+1842): insert envelope failed [("Mon, 29 Apr 2013 14:25:21 +0900" "You have a new PRIVATE MESSAGE!" (("Notification" NIL "B58CD62FB" "ando-sayaka.net")) (("Notification" NIL "B58CD62FB" "ando-sayaka.net")) ((NIL NIL "64A208281" "amcustomersupport.com")) (("User python" NIL "python" "gentoo.org")) NIL NIL NIL {44} &lt;DDB21ED5-3852-1239-87AE-1FD5471AFC18&lt; at &gt;½à ÃÃ3&gt;)] ..--- checking envelope cache took 0 seconds The message is junk mail anyway, but what bothers me is the error itself and how an invalid byte sequence did get this far - and if dbmail-util shouldn't somehow be able to fix this as I think this means I do not see this in my message lists since there is no header cache correct? I think it might be good if at least dbmail-util could fix these automatically by replacing them with something valid instead ? Regards _______________________________________________ DBmail mailing list DBmail&lt; at &gt;dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail </pre> Thomas Raschbacher 2013-05-05T20:39:31 http://comments.gmane.org/gmane.mail.imap.dbmail/14629 <pre>Hi there, I'm trying to implement Mail Archiving solution using dbmail. I'm following the document: http://www.dbmail.org/dokuwiki/doku.php/archiving-howto Everything was made by the document, but I can't receive messages. My dbmai.conf: http://dpaste.com/1073240/ I've created a user: dbmail-users -a junix -w password After that I create a forward: dbmail-users -x junix -t junix&lt; at &gt;mydomain.com After that I create a archive forward: dbmail-users -x junix -t junix&lt; at &gt;archive-inbound.mydomain.com dbmail-users -x junix -t junix&lt; at &gt;archive-outbound.mydomain.com My postfix main.cf: http://dpaste.com/1073259/ /etc/postfix/virtual_alias_maps.cf: user = postfix password = DBPASSWD hosts = unix:/var/lib/mysql/mysql.sock dbname = dbmailarc query = SELECT alias FROM dbmail_aliases WHERE alias = '%s' /etc/postfix/transport: archive-inbound.mydomain.com dbmail-archive-inbound: archive-outbound.mydomain.com dbmail-archive-outbound: /etc/postfix/master.cf: # # DBMail # dbmail-lmtp unix - - n - - lmtp dbmail-archive-inbound unix - n n - - pipe flags=RDO user=dbmail argv=/usr/local/sbin/dbmail-archive-inbound ${recipient} dbmail-archive-outbound unix - n n - - pipe flags=RDO user=dbmail argv=/usr/local/sbin/dbmail-archive-outbound ${recipient} /usr/local/sbin/dbmail-archive-inbound: #!/bin/sh # email account should be passed as $1 cat - | /usr/sbin/dbmail-deliver -u "$1" -m "INBOX/Incoming/$(/bin/date +%Y)/$(/bin/date +%m)" /usr/local/sbin/dbmail-archive-outbound: #!/bin/sh # email account should be passed as $1 cat - | /usr/sbin/dbmail-deliver -u "$1" -m "INBOX/Outgoing/$(/bin/date +%Y)/$(/bin/date +%m)" When I try to send some message, I've got this: maillog: http://dpaste.com/1073254/ In my database the messages table is zero rows. =( Thank you. </pre> Alfredo Saldanha 2013-04-25T14:32:12 http://comments.gmane.org/gmane.mail.imap.dbmail/14626 <pre>hello ;-) running the dbmail-util -ay each night. since 2 days i do receive the following error Repairing DBMAIL for cached header values... Ok. Found [1] un-cached physmessages. Apr 23 23:14:49 ex4 dbmail-util[12790]: [0x60a010] Error:[message] _header_value_get_id(+1535): SQLException: Deadlock found when trying to get lock; try restarting transaction Apr 23 23:14:50 ex4 dbmail-util[12790]: [0x60a010] Error:[message] _header_insert(+1563): SQLException: Duplicate entry '40909-5-355411' for key 'PRIMARY' Apr 23 23:14:51 ex4 dbmail-util[12790]: [0x60a010] Error:[message] _header_insert(+1563): SQLException: Duplicate entry '40909-7-355412' for key 'PRIMARY' Apr 23 23:14:51 ex4 dbmail-util[12790]: [0x60a010] Error:[message] _header_insert(+1563): SQLException: Duplicate entry '40909-9-15155' for key 'PRIMARY' Apr 23 23:14:52 ex4 dbmail-util[12790]: [0x60a010] Error:[message] _header_insert(+1563): SQLException: Duplicate entry '40909-57-355416' for key 'PRIMARY' Apr 23 23:14:53 ex4 dbmail-util[12790]: [0x60a010] Error:[message] _header_insert(+1563): SQLException: Duplicate entry '40909-33-2287' for key 'PRIMARY' We suggest running dbmail-util again to confirm that all errors were repaired. if i do run dbmail-util manually again it says there are no errors if it runs the next night via cronjob again the same error appears. is this something i need to worry about? if so ... how can this be fixed? thanks for such a nice piece of software ;-) all the best becki </pre> Administrator Beckspaced.com 2013-04-24T07:25:36 http://comments.gmane.org/gmane.mail.imap.dbmail/14622 <pre>hi. i was just reading http://dbmail.org/dokuwiki/doku.php/shared-mbox and was wondering .. has anyone tried this on dbmail 3.x? do the instructions still apply as-is? </pre> Thomas Raschbacher 2013-04-23T06:48:18 http://comments.gmane.org/gmane.mail.imap.dbmail/14616 <pre>Hi. I was just wondering is there a reason why I should - or should not - upgrade to a newer DB Server version? Did someone make performance comparisions with dbmail for postgresql 8.3 / 9.1 ? Since (as seen in my previous email to the list) I need to import a lot of mails soon and if there is a good reason to upgrade postgresql first then I'd rather do ith with a 700MB db than with one with like 20GB ^^ Regards </pre> Thomas Raschbacher 2013-04-15T10:03:58 http://comments.gmane.org/gmane.mail.imap.dbmail/14615 <pre>Hi. I'm going to have to import ~ 25GB of Thunderbird mails into DBMail. what is the best way to do this? 1) Just add imap server and start copying over? 2) is there some script maybe? (contrib only has for maildir) 3) use a thunderbird extension (like https://addons.mozilla.org/en-us/thunderbird/addon/importexporttools/) to export to maildir and then use the script? What seems to be the best way? most important is that nothing is lost, so the priority is on that of course. It'd be nice to not having to do it manually (there are a lot of folders), but if the rest is considered unreliable / someone has encountered problems with it then I guess i'd have to do that.. Regards </pre> Thomas Raschbacher 2013-04-15T09:49:31 http://comments.gmane.org/gmane.mail.imap.dbmail/14613 <pre>Hello, I use dbmail-util -ay for dbmail 2.2.18 and I get about hundred lines like .Apr 11 06:11:09 ods3 dbmail-util[21423]: Error:[sql] dbmysql.c,db_query(+290): [Duplicate entry '468946-1970-01-01 00:00:00' for key 'physmessage_id'] [INSERT INTO dbmail_datefield (physmessage_id, datefield) VALUES (468946,'1970-01-01 00:00:00')] Apr 11 06:11:09 ods3 dbmail-util[21423]: Error:[message] dbmail-message.c,insert_field_cache(+1122): insert datefield failed [INSERT INTO dbmail_datefield (physmessage_id, datefield) VALUES (468946,'1970-01-01 00:00:00')] What can I do? Greetings Ralph </pre> Ralph Ballier 2013-04-11T04:18:10 http://comments.gmane.org/gmane.mail.imap.dbmail/14609 <pre>Hello i have hire some one to install and configure exim4+dbmail+SpamAssasi+ClamAV ,when he finished his work i found these problems: - SMTP not using any authentication -SMTP can work only on port 587 and to be able to send any email you need to configure mail client to use STARTTLS as a connection security and set authentication method to normal password. after i asked him about this he said exim4 and dbmail can only work with this configuration,is this true? please i need your help to judgment his work? regard saad _______________________________________________ DBmail mailing list DBmail&lt; at &gt;dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail </pre> saad alhokail 2013-04-09T15:22:51 http://comments.gmane.org/gmane.mail.imap.dbmail/14594 <pre>Lots of spam seems to have been added to the wiki recently. See http://www.dbmail.org/dokuwiki/doku.php/start?do=recent for a list. There are several pages of new spammy articles. Who is able to delete pages from the wiki and/or deal with accounts that are used for spamming? I'm happy to help with this if assistance is needed. </pre> Robert C. Sheets 2013-04-01T13:53:17 http://comments.gmane.org/gmane.mail.imap.dbmail/14591 <pre> Hello, I accidentally deleted 'date' header from headername table and MUA shows current date for all emails now. How can I recover it, for example rebuild whole header* tables? </pre> Sergej Pupykin 2013-03-28T10:38:10 http://comments.gmane.org/gmane.mail.imap.dbmail/14576 <pre> Hi all, For the last 12 days the lists have been offline. I have no idea why, but hope to hear from Jitscale later today what was going on. If you sent a message to either of the lists, and don't see it appear over the next couple of hours, please re-send it. We won't hold it against you :-) Thanks to Thomas for alerting me to this. </pre> Paul J Stevens 2013-03-25T13:31:48 http://comments.gmane.org/gmane.mail.imap.dbmail/14575 <pre> Is it finally working again now? Don't answer that. Please ignore. </pre> Paul J Stevens 2013-03-25T13:25:25 http://comments.gmane.org/gmane.mail.imap.dbmail/14574 <pre>While seraching for the reason of the load on my server checked the used indices and the unused on. The query already discussed in the other thread does not use a good index, it uses mailbox_idnr_index. SELECT seen_flag, answered_flag, deleted_flag, flagged_flag, draft_flag, recent_flag, DATE_FORMAT(internal_date, GET_FORMAT(DATETIME,'ISO')), rfcsize, message_idnr FROM dbmail_messages m LEFT JOIN dbmail_physmessage p ON p.id = m.physmessage_id WHERE m.mailbox_idnr = 1465 AND m.status IN (0,1) ORDER BY message_idnr ASC; I created a new index: mailbox_idnr_status_index (mailbox_idnr, status) and the load time for the same query drop from 1,7 seconds to 0,06 seconds. as side effect the query: SELECT 0,COUNT(*) FROM dbmail_messages WHERE mailbox_idnr=718 AND (status &lt; 2) UNION SELECT 1,COUNT(*) FROM dbmail_messages WHERE mailbox_idnr=718 AND (status &lt; 2) AND seen_flag=1 UNION SELECT 2,COUNT(*) FROM dbmail_messages WHERE mailbox_idnr=718 AND (status &lt; 2) AND recent_flag=1; uses the same index for the query before the first union. so I created two more indices: CREATE INDEX mailbox_idnr_status_seen_index ON dbmail_messages (mailbox_idnr, status, seen_flag) USING BTREE; CREATE INDEX mailbox_idnr_status_recent_index ON dbmail_messages (mailbox_idnr, status, recent_flag) USING BTREE; and dropped the mailbox_idnr_status_index index. The load on my server drop to "zero" More investigion is needed but the messages table has many indices that all must be maintained so I tried to find indices that are not used by dbmail. For this I use pt-index-usage on my slow log for 0.3 queries so this is not really representative: ALTER TABLE `dbmail`.`dbmail_acl` DROP KEY `user_id_index`; -- type:non-unique ALTER TABLE `dbmail`.`dbmail_aliases` DROP KEY `alias_index`, DROP KEY `client_idnr_index`; -- type:non-unique ALTER TABLE `dbmail`.`dbmail_filters` DROP KEY `dbmail_filters_ibfk_1`; -- type:non-unique ALTER TABLE `dbmail`.`dbmail_header` DROP KEY `headername_id`, DROP KEY `headername_id_headervalue_id`, DROP KEY `headervalue_id`, DROP KEY `physmessage_id_headername_id`, DROP KEY `physmessage_id_headervalue_id`; </pre> Harald Leithner 2013-03-13T10:22:42 http://comments.gmane.org/gmane.mail.imap.dbmail/14566 <pre>Hi Paul is the current GIT working for you in any way? i tried the last one, but still the services are crashing not directly at start like older ones but very soon 8 daysIMAP: imaptest fixesHEADmasterPaul J Stevens2-2/+2 8 daysIMAP: fix tree errorPaul J Stevens1-1/+1 9 daysuse more prepared statements; bug #1004Paul J Stevens4-92/+176 9 daysfix deadlock in unit-testPaul J Stevens1-1/+0 9 daysfix unit-testPaul J Stevens2-1/+2 9 daysdisable the experimental memory pool by defaultPaul J Stevens1-2/+2 9 daysclosing fd and memory leaksPaul J Stevens11-215/+313 dbmail-3.0.2-1362841681.fc18.20130309.rh.f131b2ec6c605b66e4ba1187a202ce970d485f6e.x86_64 [root&lt; at &gt;testserver:~]$ cat messages Mar 9 16:09:42 testserver kernel: dbmail-pop3d[11794]: segfault at 64 ip 00007f6f50d7cfc4 sp 00007fff84d55b70 error 4 in libdbmail.so.0.0.0[7f6f50d4d000+64000] Mar 9 16:09:42 testserver systemd[1]: dbmail-pop3d.service: main process exited, code=killed, status=11/SEGV Mar 9 16:09:42 testserver systemd[1]: Unit dbmail-pop3d.service entered failed state Mar 9 16:09:43 testserver systemd[1]: dbmail-pop3d.service holdoff time over, scheduling restart. Mar 9 16:09:43 testserver systemd[1]: Stopping DBMail POP3 Server... Mar 9 16:09:43 testserver systemd[1]: Starting DBMail POP3 Server... Mar 9 16:09:43 testserver systemd[1]: Started DBMail POP3 Server. Mar 9 16:10:01 testserver systemd[1]: dbmail-lmtpd.service: main process exited, code=killed, status=6/ABRT Mar 9 16:10:01 testserver systemd[1]: Unit dbmail-lmtpd.service entered failed state Mar 9 16:10:02 testserver systemd[1]: dbmail-lmtpd.service holdoff time over, scheduling restart. Mar 9 16:10:02 testserver systemd[1]: Stopping DBMail LMTP Server... Mar 9 16:10:02 testserver systemd[1]: Starting DBMail LMTP Server... Mar 9 16:10:02 testserver systemd[1]: Started DBMail LMTP Server. _______________________________________________ DBmail mailing list DBmail&lt; at &gt;dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail </pre> Reindl Harald 2013-03-09T15:15:23 http://comments.gmane.org/gmane.mail.imap.dbmail/14565 <pre>Hi nmap -O -sV -T4 -d &lt;server-ip&gt; after that "dbmail-timsieved" runs with 100$ CPU until the service is restarted, this was also the case with dbmail 2.x and still present results in a lot of load on the ESXi cluster after each automated Nessus-Scan and prevents me from allow users to use sieve by themself because i hestitate to open the port for security reasons _______________________________________________ DBmail mailing list DBmail&lt; at &gt;dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail </pre> Reindl Harald 2013-03-09T14:42:08 http://comments.gmane.org/gmane.mail.imap.dbmail/14560 <pre>Hi, I have sometimes a problem on my dbmail server, it seams that one client kills the server. top - 17:16:51 up 11 days, 15:46, 1 user, load average: 9.63, 6.54, 4.99 Tasks: 128 total, 2 running, 126 sleeping, 0 stopped, 0 zombie %Cpu(s): 5.9 us, 1.5 sy, 0.0 ni, 80.7 id, 11.9 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem: 32992140 total, 29264076 used, 3728064 free, 296492 buffers KiB Swap: 0 total, 0 used, 0 free, 11474428 cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 6441 mysql 20 0 26.6g 15g 7028 S 800.0 49.3 1757:31 mysqld 19234 dbmail 20 0 1482m 686m 3964 S 427.3 2.1 56:05.00 dbmail-imapd After restart dbmail everything is fine again, I tried to check the mysql queries running in this situation, but I found only some of them for example: --- SELECT keyword FROM dbmail_keywords k LEFT JOIN dbmail_messages m ON k.message_idnr=m.message_idnr LEFT JOIN dbmail_mailboxes b ON m.mailbox_idnr=b.mailbox_idnr WHERE b.mailbox_idnr=6; --- The sometimes need a few seconds More Problems I have with this one --- SELECT 0,COUNT(*) FROM dbmail_messages WHERE mailbox_idnr=1211 AND (status &lt; 2) UNION SELECT 1,COUNT(*) FROM dbmail_messages WHERE mailbox_idnr=1211 AND (status &lt; 2) AND seen_flag=1 UNION SELECT 2,COUNT(*) FROM dbmail_messages WHERE mailbox_idnr=1211 AND (status &lt; 2) AND recent_flag=1; --- This could take up to 42 seconds, running multiple times for different mailboxes. Server running 32 GB Ram on 60 GB DB Storage, so not everything is in memory but the message tables has only 128 MB so should be in Memory completely. mysqltuner says everything is fine except this: [!!] Total fragmented tables: 11 [!!] Query cache efficiency: 7.2% (1M cached / 17M selects) [!!] Table cache hit rate: 7% (130 open / 1K opened) [!!] InnoDB data size / buffer pool: 57.8G/24.0G it suggests: query_cache_limit (&gt; 256M, or use smaller result sets) table_cache (&gt; 6000) innodb_buffer_pool_size (&gt;= 57G) The Total fragmented tables could be a problem or? Query cache efficiency say nothing in my opinion Table cache hit rate should not be a problem if I have table_cache 6000 or? Database Size should not be more then phys memory ;-) So I would like to find out which client it is and what it does and how I could fix it. Also I'm thinking that dbmail should cache mail_count, seen_flag_count and recent_flag_count, maybe by adding columns in mailbox table with triggers? </pre> Harald Leithner 2013-03-05T16:36:00 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.mail.imap.dbmail