http://blog.gmane.org/gmane.mail.bogofilter.general hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.mail.bogofilter.general/11646 <pre>For a very long time I've been training bogofilter with the command bash /usr/share/bogofilter/contrib/contrib/trainbogo.sh -c -H /home/anne/Maildir/.INBOX.Bogotrain_ham/cur/ -S /home/anne/Maildir/.INBOX.Bogotrain_spam/cur However, since I installed Scientific Linux 6 I find that I don't appear to have that file. I'm running bogofilter-1.0.2-6.el6.x86_64. I've got quite a store of training emails now. Could you please help me get back on track? Thanks Anne _______________________________________________ Bogofilter mailing list Bogofilter&lt; at &gt;bogofilter.org http://www.bogofilter.org/mailman/listinfo/bogofilter </pre> Anne Wilson 2012-05-21T13:45:07 http://comments.gmane.org/gmane.mail.bogofilter.general/11644 <pre>For those of you who use bogofilter-milter.pl, the Milter implementation of bogofilter filtering I wrote, there is a new version available at http://stuff.mit.edu/~jik/software/bogofilter-milter/bogofilter-milter.pl.txt &lt;http://stuff.mit.edu/%7Ejik/software/bogofilter-milter/bogofilter-milter.pl.txt&gt; which you should replace the version you're using with (David, please take this new version for the contrib directory in the bogofilter distribution). This fixes a bug in the handling of incoming messages larger than one million bytes, or whatever you change the $MAX_INCORE_MSG_LENGTH limit to in the script, if you change it. In particular, the bug caused messages at least this large to be "chunked" into blocks of that many bytes, with only the last chunk preserved to be fed into bogofilter and/or archived in $archive_mbox or $ham_archive_mbox. I am grateful for Stephen Davies for not only pointing out the bug to me, but also doing a great deal of troubleshooting on it and pointing me right at the</pre> Jonathan Kamens 2011-11-01T02:41:30 http://comments.gmane.org/gmane.mail.bogofilter.general/11642 <pre>Couple questions... Q1) I just started using bogofilter on my Kmail install, and it's flagging all mail coming from my mail server as spam. My server is not blacklisted anywhere, but IS in an old bogon IP range (98.129) that was released for use by the IANA some time back in 2006 (098/8)... and my fear is that my server's x-bogon is still being flagged by bogofilter as a bogon. If this is not the case, someone please show me where any bogon lists are kept and how I can verify that my MTA's primary IP is not in such a list. Q2) If I accidentally marked some HAM as spam.. how do I fix this? I can't find any good tutorials or anything on using bogotune (if that's eaven the right tool). Thanks! Tweeks _______________________________________________ Bogofilter mailing list Bogofilter&lt; at &gt;bogofilter.org http://www.bogofilter.org/mailman/listinfo/bogofilter </pre> Tweeks 2011-10-24T04:21:20 http://comments.gmane.org/gmane.mail.bogofilter.general/11635 <pre>My mail server has been upgraded to CentOS 6. Bogofilter is installed and appears to be tagging correctly. However, I'm having problems with retraining - bash /usr/share/bogofilter/contrib/contrib/trainbogo.sh -c -H /home/anne/Maildir/.INBOX.Bogotrain_ham/cur/ -S /home/anne/Maildir/.INBOX.Bogotrain_spam/cur/ bash: /usr/share/bogofilter/contrib/contrib/trainbogo.sh: No such file or directory On checking I find that there is no /usr/share/bogofilter directory, and no amount of searching is finding the scripts. Unfortunately I don't appear to have archived the messages where you originally helped me set this up. How can I get this working again? Anne </pre> Anne Wilson 2011-08-23T09:31:03 http://comments.gmane.org/gmane.mail.bogofilter.general/11628 <pre>I'm trying to tune bogofilter and can't get bogotune to work reliably. Below is a transcript. Why is bogotune having trouble locking onto good settings, when I've got 3121 ham messages and 5818 spam messages? Also, the settings I'm currently using, which were generated by an earlier, successful run of bogotune about four months ago, are working just fine, with my spam detection rate at above 99%. I've noticed a few more false positives than I prefer when I receive email from new entities, which is why I'm trying to retune. Before bogotune was having this particular problem, it was having another one... it kept reporting that it couldn't read my wordlist.db. That problem went away after I used bogoutil to remove tokens from the word list that haven't been seen in 180 days, a maintenance task I do periodically to keep the size of the word list reasonable. I've also recently dumped and reloaded the word list into a new file, which brought its size down from 9MB to 3MB, but that didn't help bogotu</pre> Jonathan Kamens 2011-06-23T01:23:01 http://comments.gmane.org/gmane.mail.bogofilter.general/11627 <pre>I have been running Bogofilter for several years and really like it. It works very well. I brought up bogofilter on a new system - This is the new system - slate:/usr/local/bin # bogofilter -V bogofilter-sqlite version 1.2.2     Database: SQLite 3.7.5 Copyright (C) 2002-2010 David Relson, Matthias Andree Copyright (C) 2002-2004 Greg Louis Copyright (C) 2002-2003 Eric S. Raymond, Adrian Otto, Gyepi Sam And this is the old system, I am currently using - bogofilter-sqlite version 1.2.2     Database: SQLite 3.7.3 Copyright (C) 2002-2010 David Relson, Matthias Andree Copyright (C) 2002-2004 Greg Louis Copyright (C) 2002-2003 Eric S. Raymond, Adrian Otto, Gyepi Sam I copied the database (wordlist.db) from the old system to the new. I am using the same procmail script. # filter mail through bogofilter, tagging it as Ham, Spam, or Unsure, # and updating the wordlist # :0fw: bogofilter.lock # | /usr/local/bin/bogofilter -u -e -p -l -d /home/admin/.bogofilter # if bogofilter failed, return the mail t</pre> Doug 2011-06-19T03:55:02 http://comments.gmane.org/gmane.mail.bogofilter.general/11626 <pre>I found out the other day that I have some kind of database missmatch. Trying to update spam and ham I get this: $ /usr/bin/bogofilter -nS &lt; ~/mail/newham Program version 5.1 doesn't match environment version 4.8 bogofilter[10955]: cannot join environment: DB_VERSION_MISMATCH: Database environment version mismatch $ /usr/bin/bogofilter -sN &lt; ~/mail/newspam Program version 5.1 doesn't match environment version 4.8 bogofilter[11001]: cannot join environment: DB_VERSION_MISMATCH: Database environment version mismatch And I can't find a way to dump with 4.8 and restore with 5.1 my wordlist. I'm on Debian testing and there is no db5.1-utils, which is quite odd. Any solutions? </pre> Martín Marqués 2011-05-12T14:54:36 http://comments.gmane.org/gmane.mail.bogofilter.general/11623 <pre>Hi, (I sent this message yesterday but it didn't make it to the list, maybe because the original version had an attachment.) I'm using Ubuntu Maverick's bogofilter 1.2.2 package to filter spam. Today I found that bogofilter was crashing with the error "flex scanner push-back overflow" and not filtering spam. I identified the two particular spam messages that were causing this problem, and I found that they would make bogofilter crash every time. I've also confirmed that they make bogofilter 1.2.2 crash on another machine, running FreeBSD, with no wordlist.db, so I think there is a real bug here. The spam messages seem to consider of a huge number of (long) separately koi8-encoded tokens. Their contents were identical except for the date and recipient address. I've posted one of the original messages at http://www.loyalty.org/~schoen/spam.bz2 </pre> Seth David Schoen 2011-05-07T21:24:07 http://comments.gmane.org/gmane.mail.bogofilter.general/11620 <pre>I send a message to myself using one email address to send and another to receive. Routinely it gets a bogosoity of 1.0 and gets sent to the Spam folder. I move it from Spam to Ham and rerun bogofilter. Then I run a similar or identical test message and it goes to Spam again. When I run my spam filter script I get numbers like these: </pre> John Culleton 2011-04-12T19:13:04 http://comments.gmane.org/gmane.mail.bogofilter.general/11610 <pre>Hi everyone I use bogfilter since months now, and I still have a problem of classification between ham and spam. Half of my spam is still classified as ham. Description of the system : My bogofilter work on my mail server, the mail is delivered by postfix, bogofilter read it, rank it, mark it as spam or not ( ___SPAM___ in header) and make auto-update, and give it to postix again. Postfix give it to dovecot deliver which set it in the corresponding box on imap. If marked as spam, they go in INBOX.spam... After that, if I receive spam in my normal boxes, I put it in the spam box. End of process : each day, a script read the messages in INBOX.spam and learn those without ___SPAM___ (so, the mistaken) to be real spam. The contrary to the rare ham that were in the spam box. This script also run bogoutil -l wordlist.db and such things after having corrected the mistakes ... Unless all this sophisticated process, half of my spam has still a bogofilter score of around 0.42, close to be considered reall</pre> Stéphane Guedon 2011-04-04T16:40:01 http://comments.gmane.org/gmane.mail.bogofilter.general/11603 <pre>I'm having again problems with bogofilter DB. For some reason I can't get more spam and ham definitions in the DB. Also I can't get a dump from the DB: ~/.bogofilter$ alias spam alias spam='/usr/bin/bogofilter -sN &lt; ~/mail/newspam &amp;&amp; &gt; ~/mail/newspam' ~/.bogofilter$ spam PANIC: fatal region error detected; run recovery PANIC: fatal region error detected; run recovery bogofilter[20101]: DB_ENV-&gt;open, err: -30974, DB_RUNRECOVERY: Fatal error, run database recovery To recover, run: bogoutil -v --db-recover "/home/martin/.bogofilter" ~/.bogofilter$ bogoutil -v --db-recover "/home/martin/.bogofilter" PANIC: fatal region error detected; run recovery ~/.bogofilter$ db4.8_dump -r ~/.bogofilter/wordlist.db &gt; ~/.bogofilter/wordlist.saved db4.8_dump: PANIC: fatal region error detected; run recovery db4.8_dump: checksum error: page 561: catastrophic recovery required db4.8_dump: PANIC: DB_RUNRECOVERY: Fatal error, run database recovery db4.8_dump: /home/martin/.bogofilter/wordlist.db: pgin failed for page 561 db4.8_du</pre> Martín Marqués 2011-03-19T12:52:00 http://comments.gmane.org/gmane.mail.bogofilter.general/11602 <pre>When looking over my Spam folder I found some legitimate email that had been sent to the Spam folder--several from the New York Times and one from my local Knights of Columbus Council. I moved all those messages to my Ham folder and created a special filter in KMail for the NYT mail. I run the following script each night: /usr/local/bogofilter-1.2.1/contrib/trainbogo.sh -c -H /home/safe/.kde/share/apps/kmail/mail/Ham/cur/ -S /home/safe/.kde/share/apps/kmail/mail/Spam/cur/ Kmail on slackware 13.0 Linux. </pre> John Culleton 2011-03-11T14:18:43 http://comments.gmane.org/gmane.mail.bogofilter.general/11601 <pre>(Sorry about the runon lines and dupe message; hopefully this looks better) Hi, newbie to the list. I've been running bogofilter 1.1.5 under Ubuntu 8.04 on a user-by-user basis for some time and it works well. Each user maintains ham and spam email folders and the wordlist.db were set up individually for each user under their ~/.bogofilter dirs. Filtering is done through procmail. But increasingly the discrimination was not working as well as before and I've looked at how to improve that. Recently I tried improving discrimination results by running bogotune on a collection of all users' ham and spam corpus (I save these) and entering the resulting parameters into /etc/bogofilter.cf. The results were much better than the defaults that I had been using. But I would prefer going all the way to a single, centralized wordlist as (I think) it doesn't make sense to have a centralized parameter set, yet separate users' wordlists. I have been struggling to get this working for a couple of days and there appe</pre> Mike Klein 2011-02-21T01:51:51 http://comments.gmane.org/gmane.mail.bogofilter.general/11600 <pre>Hi, newbie to the list. I've been running bogofilter 1.1.5 under Ubuntu 8.04 on a user-by-user basis for some time and it works well. Each user maintains ham and spam email folders and the wordlist.db were set up individually for each user under their ~/.bogofilter dirs. Filtering is done through procmail. But increasingly the discrimination was not working as well as before and I've looked at how to improve that. Recently I tried improving discrimination results by running bogotune on a collection of all users' ham and spam corpus (I save these) and entering the resulting parameters into /etc/bogofilter.cf. The results were much better than the defaults that I had been using. But I would prefer going all the way to a single, centralized wordlist as (I think) it doesn't make sense to have a centralized parameter set, yet separate users' wordlists. I have been struggling to get this working for a couple of days and there appears to be very little on the web that my searches have found about how to get</pre> Mike Klein 2011-02-21T01:37:03 http://comments.gmane.org/gmane.mail.bogofilter.general/11593 <pre>Sent again, cause my first mail seemed to got lost. Hello, I use bogofilter with KMail successfully for filtering spam. Now I want to use it for another filtering task. Everybody knows these notification mail from forums, facebook, ... (New reply, New message, ...) I want to use bogofilter to sort them in a seperate folder. I created a new configuration dir: % cat ~/.bogofilter-notifications/bogofilter.cf spam_header_name=X-Bogo-Notification And use bogofilter like that from kmail: bogofilter -s -d /home/florian/.bogofilter-notifications to classify a message as notification. but: bogofilter -p -vv -e -d ~/.bogofilter-notifications &lt; mail does not work as expected. - it adds an X-Bogosity header, though I have changed the config option. - it crashes when adding -vv: 16560 segmentation fault (core dumped) I have attached the core dump (if it won't be filtered by the list [removed]) and will be happy to give further help. OS ist Archlinux, bogofilter 1.2.2. Thanks, Florian _________________</pre> Florian Lindner 2011-01-18T17:04:29 http://comments.gmane.org/gmane.mail.bogofilter.general/11586 <pre>-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, As far as I know, bogoutil can calculate the probability estimate for tokens that were never seen during the training period. I have a wordslist.db with spam and ham tokens. However, when I run "bogoutil -r path/to/wordslist.db" it returns nothing to STDOUT. Help? Thanks in advance! - -- Kind Regards, Mahmoud Khonji Research Assistant Khalifa University mkhonji&lt; at &gt;ku.ac.ae -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQEcBAEBAgAGBQJNDa9aAAoJEFzU5FSSWE7KTjsH/0GOJPE1++mRJ/PxizvWqtGD FT7zKIOb3kWAswC4TRStBU/87ttDPDgBdO8mHVgoroiNTJclZmcSIXJMcnU+Cbnz qeYATys3vg0ZFtP4X2uZHKuIMJschfJTNhQ+wHj8zHj+qfIjpcjYq8ndNrK4CG/L 6VKlCHCLSeMq0pzUNOWwzSBe6L2yHkXmoN6Jq2MRa6577jBobU+ne/5QkDHv3X3U Zhk+tKbusx3IqppTsz6IJalqv+x9Riefo1LNfxO9nKiO7jfX9rCjiPsswKV9gjtu NtVCN+RsgNZIc3AK5jf1DM09ECmZHJIwM7ZxBtljAZkYdBkCE+ON98mP7+Sq8uw= =8lgq -----END PGP SIGNATURE----- ____________________________________</pre> Mahmoud Khonji 2010-12-19T07:08:10 http://comments.gmane.org/gmane.mail.bogofilter.general/11578 <pre>I subscribe to Magnatune, so I get frequent emails from them describing new releases. Every time the email ends up in the Unsure folder. Every time, I copy it to the ham training folder, but the content is so variable, I think, that Bogofilter is never able to classify it properly. Is there any way that I can add weighting that would make this into definitely ham? Currently Bogofilter marks them with anything from 1% to 49.9999% probbility of being spam, with the majority being in the 47-49% range. Anne </pre> Anne Wilson 2010-12-04T10:13:29 http://comments.gmane.org/gmane.mail.bogofilter.general/11577 <pre>I subscribe to Magnatune, so I get frequent emails from them describing new releases. Every time the email ends up in the Unsure folder. Every time, I copy it to the ham training folder, but the content is so variable, I think, that Bogofilter is never able to classify it properly. Is there any way that I can add weighting that would make this into definitely ham? Currently Bogofilter marks them with anything from 1% to 49.9999% probbility of being spam, with the majority being in the 47-49% range. Anne </pre> Anne Wilson 2010-12-04T10:07:57 http://comments.gmane.org/gmane.mail.bogofilter.general/11568 <pre>Is there a way to set up bogofilter to automatically generate a bogus bounce message in reply to spam? Over time this would reduce the incoming from certain spam lists. I use kmail on Slackware Linux 13.0. </pre> John Culleton 2010-11-19T14:33:12 http://comments.gmane.org/gmane.mail.bogofilter.general/11564 <pre> Whenever I create a message to this remailer - bogofilter&lt; at &gt;bogofilter.org it is creating an incident report at godaddy.com - whomever runs this list please check the list emails and remove the godaddy email!!!! _______________________________________________ Bogofilter mailing list Bogofilter&lt; at &gt;bogofilter.org http://www.bogofilter.org/mailman/listinfo/bogofilter </pre> Doug 2010-10-31T15:42:23 http://comments.gmane.org/gmane.mail.bogofilter.general/11563 <pre>I have been running bogofilter for about 2 weeks and my wordlist size is now almost 120M 117240 -rw-rw---- 1 admin admin 119927808 Oct 31 01:04 wordlist.db at what rate can I expect this to grow? Does it just continually grow? If so I suppose at some point it becomes unusable? I am using Sqlite. Is there a way to compact it using Sqlite? _______________________________________________ Bogofilter mailing list Bogofilter&lt; at &gt;bogofilter.org http://www.bogofilter.org/mailman/listinfo/bogofilter </pre> Doug 2010-10-31T05:28:12 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.mail.bogofilter.general