http://blog.gmane.org/gmane.mail.spam.crm114 hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.mail.spam.crm114/9613 <pre>Markovian classifier tries to update the timestamp of the css file, but unfortunately has lost the filename to use. Here is a patch: --- crm_markovian.c.orig 2013-05-13 12:51:52.000000000 +0300 +++ crm_markovian.c 2013-05-13 12:53:15.000000000 +0300 &lt; at &gt;&lt; at &gt; -148,6 +148,8 &lt; at &gt;&lt; at &gt; // filename starts at i, ends at j. null terminate it. htext[j] = '\000'; + int filenameidx = i; + // and stat it to get it's length k = stat (&amp;htext[i], &amp;statbuf); &lt; at &gt;&lt; at &gt; -724,7 +726,7 &lt; at &gt;&lt; at &gt; { int hfd; // hashfile fd FEATURE_HEADER_STRUCT foo; - hfd = open (&amp;(htext[i]), O_RDWR); + hfd = open (&amp;(htext[filenameidx]), O_RDWR); dontcare = read (hfd, &amp;foo, sizeof(foo)); lseek (hfd, 0, SEEK_SET); dontcare = write (hfd, &amp;foo, sizeof(foo)); -- Kai.Risku-gEqm1mq8M50&lt; at &gt;public.gmane.org GSM +358-40-767 8282 Oy Arrak Software Ab http://www.arrak.fi ------------------------------------------------------------------------------ AlienVault Unifi</pre> Kai Risku 2013-05-14T05:58:28 http://comments.gmane.org/gmane.mail.spam.crm114/9609 <pre>Greetings, denizens of the list. I am investigating using libcrm114 for mass classification and I need to understand the run-time space and time characteristics. Has anyone else looked at this aspect? I have running test cases with different volumes of mail that has already been classified. What I see is that the time to classify a message increases in a generally linear fashion as the size of the classifier grows until I get a "large" classifier (15,000 messages or more) where the time required kicks up sharply. I am guessing that this is due to memory requirements and swapping starts to occur. Other than the process memory requirements, are there any other known issues with libcrm114 that make its performance non-linear for larger volumes of mail? If it is using a hash lookup then I expect see linear performance on insertion and lookup. Thanks, Martin Martin Thomas Research Tools Software Architect Risk and Compliance Security Research McAfee, Inc. 972.963.7680 Direct martin_thomas-pYQlhKXXLhvQT0</pre> Martin_Thomas-dDVk9ABzqyjQT0dZR+AlfA< at >public.gmane.org 2013-04-02T14:32:50 http://comments.gmane.org/gmane.mail.spam.crm114/9605 <pre>Hi, all, I've been mostly just letting my crm114 mailfilter installation just "sit" for a number of years and it just keeps on working, of course. However, along the way I think I may have expanded my css files too much, perhaps too concerned about packing density. I judge this from the fact that the learning seems entirely too sluggish compared to what it used to be. I assume so much has been trained by now that new training has less than the desired impact. This may have worsened due to the number of years the css files have been in use, and just how much spam has changed over that time. I would like some of the old training to "fall off the end" but I don't have the time required to just start over right now. I see nothing in the documentation to suggest that using cssmerge to move back into a smaller file would not work, and I'm wondering what to expect and how to optimize this. I would rather avoid being forced into a bout of heavy training. So I'm thinking about reducing the size of the css f</pre> Kurt Bigler 2012-12-17T23:29:06 http://comments.gmane.org/gmane.mail.spam.crm114/9604 <pre>hi crash, and everyone -- i'm running crm from the ubuntu apt repos, version 20100106. for some reason i tossed my old css files and started from scratch sometime last year. after the initial training period, things settled down, and spam vs. non-spam were sorted very nicely, with a handful of "unsure" messages on a daily basis. (i also greylist, which takes a lot of the load off of crm and the rest of my system.) 5 or 6 weeks ago i subscribed to the git (git-u79uwXL29TY76Z2rM5mHXA&lt; at &gt;public.gmane.org) mailing list, and as expected, a lot of it was classed as spam at first. but i train messages consistently, and i'd expect that to go away quickly. but it didn't. i've been consistently getting many messages from that list classed as UNSURE. this morning, for instance, i had 18 git messages classified as UNSURE, out of perhaps 80 that arrived overnight. i'll add that i do subscribe to some other vger.kernel.org lists, and don't have these problems with those -- though they tend to be lower volume; it's </pre> Paul Fox 2012-12-17T14:35:57 http://comments.gmane.org/gmane.mail.spam.crm114/9601 <pre>Hello, I have an email account that receives a fairly high volume (500-800) of daily emails (500-800), and would like to categorize/classify these emails automatically into about 100 categories/folders. The last two months I have been trying out POPFile with some limited success. (http://getpopfile.org/) After I have been inspecting keywords and decision trees in POPFile, it would seem to me like a classifier using phrases for classification might classify this type of emails better than the Naive Bayes implementation in POPFile. As I'm not a programmer, but trying to learn, I have been searching for preexisting tools that might work for what I want to achieve. Searching the web I can see that leaves me with the two options: CRM114 or OSBF-lua as classifiers and as I understand CRM114 now uses the OSBF classifier as the default! Are there any implementations/scripts out there that will allow multiple classes for general email sorting using CRM114 or OSBF-lua as the classification engine? It seems from wh</pre> Lars Bjærris 2012-12-12T13:17:29 http://comments.gmane.org/gmane.mail.spam.crm114/9600 <pre>Hello, Given a sample mail in file '1': MFOPTS="-u $HOME/mail/" MAILFILTER="$HOME/mail/mailreaver.crm" $MAILFILTER $MFOPTS &lt; 1 &gt; 2 2 now contains header X-CRM114-Status: UNSURE ( 6.88 ) The mail is ham, so I train it $MAILFILTER $MFOPTS --good &lt; 2 &gt; 3 3 contains X-CRM114-Action: LEARNED AND CACHED GOOD Great. Now in my setup, I want to re-inject this trained message into my mail. Historically (and now) I just save it to INBOX. But what I would really like to do is have my procmail recipe file it accordingly. Therefore I'd like to pipe it to e.g. sendmail to be redelivered. I invoke mailreaver via procmail so this would involve the trained mail being reclassified. Whenever I try this: $MAILFILTER $MFOPTS &lt; 3 &gt; 4 grep -i ^x-crm 4 X-CRM114-Action: LEARNED AND CACHED GOOD X-CRM114-Version: 20090807-BlameThorstenAndJenny ( TRE 0.8.0 (BSD) ) MR-B9CF6B05 X-CRM114-CacheID: sfid-20121123_140912_163398_EE104312 X-CRM114-Status: UNSURE ( 6.75 ) X-CRM114-Notice: Please train this message. </pre> Jon Dowland 2012-11-24T10:56:13 http://comments.gmane.org/gmane.mail.spam.crm114/9594 <pre>I'm writing a bot to find people to follow on Twitter who post relevant material on a given topic. I need to be able to avoid spammers, follow bots and Beliebers. What's the best classifier to use on short text like a tweet or a Twitter bio? I'm trying to make this bot behave more like a human, discovering content by crawling the social graph rather than just following a fixed set of hash tags. Chris -- "Nothing says, 'I love you,' like 200 feet of parachute cord and a cargo net." - Fred, Scooby-Doo! Mystery Incorporated ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://ad.doubleclick.net/clk;258768047;13503038;j? http://info.appdynamics.com/FreeJavaPerformanceDownload.html </pre> Chris Babcock 2012-09-16T18:44:37 http://comments.gmane.org/gmane.mail.spam.crm114/9593 <pre>Hello, I would like to build a FreeBSD port for libcrm114 and have some problems with the current .tar.gz file. Is it possible to prepare a new libcrm114 release tarball with - a Makefile for shared libraries, - single crm114.h as a public interface, - without compiled objects? Several Makefile versions have been written already, e.g. on github: https://github.com/pmundkur/libcrm114/blob/master/Makefile https://github.com/jflatow/libcrm114/blob/master/Makefile IMHO it would just be nice to have a canonical one to build upon. </pre> Martin Schütte 2012-06-04T11:39:05 http://comments.gmane.org/gmane.mail.spam.crm114/9592 <pre>Hello, I wrote a libcrm114 module for Perl and saw there are also modules for other languages. Maybe these could be mentioned in the Wiki: - Erlang (https://github.com/jflatow/erlcrm114) - Python (https://github.com/pmundkur/libcrm114) - PHP (http://gymx.net/php-crm114/) - Perl (https://metacpan.org/module/Text::AI::CRM114) </pre> Martin Schütte 2012-06-04T11:37:04 http://comments.gmane.org/gmane.mail.spam.crm114/9588 <pre>I have been successfully using priolist.mfp to match email addresses that I want to black/whitelist for ages. Now I want to block on a particular phrase such as: yahoo messenger online now which is from a particularly egregious sort of spam/scam my organization is receiving. I have tried putting the following combinations, none of which have worked: -yahoo messenger online now -yahoo\ messenger\ online\ now -yahoo\smessenger\sonline\snow -"yahoo messenger online now" and probably various others which I cannot now reproduce. I really expected the first one to work. I have finally stumbled upon a combination which does work: -yahoo.messenger.online.now Why would . work (I'm plenty familiar with regex and know it will match anything) but \s to match the spaces or simply raw spaces not work? Is there some unintentional parsing being done on the whitespace I put in which is breaking things? Thanks! </pre> Tracy Reed 2012-04-12T00:14:20 http://comments.gmane.org/gmane.mail.spam.crm114/9587 <pre>Hi Bill, It's been a long time since I last wrote to the list. I'm interested in playing around with libcrm and the SVM classifier, but am a bit confused. 1. Where might I find the "best" version of the library? The link on the wiki seems pretty old. For me, "best" means reliable enough for doing personal spam filtering. 2. The HowTo mentions CRM114_SVM, but I see that there is also CRM114_LIBSVM and that the two choices follow different code paths in crm114_base. Which should I use, or why might I choose one vs. the other? Best Regards, Steve ------------------------------------------------------------------------------ This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure </pre> Steve Pellegrin 2012-03-29T01:55:14 http://comments.gmane.org/gmane.mail.spam.crm114/9578 <pre>I was discussing a security issue with my new employer today, about scanning backups of servers that should not have confidential data on them for precisely such data. In the short term, scanning the email would do, especially if attachmants can be scanned. And I thought of CRM114 for the task, instead of the very slow and painful tools that are often used now. Is there a toolkit for such scanning? I'd much prefer to avoid take on the full integration project, but if anyone's already got such a toolkit assembled, even if it's a commercial toolkit, I'd love to review it for use at my new workplace. ------------------------------------------------------------------------------ Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d____________________________________</pre> Nico Kadel-Garcia 2012-02-28T03:22:22 http://comments.gmane.org/gmane.mail.spam.crm114/9577 <pre>Hi, All. I'm back to looking at CRM114, and I decided to update some of the documentation, working from "the (possibly) slightly unstable latest mainline version" -- thanks for the continued good work, and I hope the updates prove useful. This is the first. /Jskud --- crm114-20120205-ORIG/CLASSIFY_DETAILS.txt2009-09-11 11:25:57.000000000 -0700 +++ crm114-20120205/CLASSIFY_DETAILS.txt2012-02-06 07:49:00.000000000 -0800 &lt; at &gt;&lt; at &gt; -18,7 +18,8 &lt; at &gt;&lt; at &gt; The current distribution builds in this set of classifiers. The classifiers are: -1) SBPH Markovian (the default) This is an extension of Bayesian +1) SBPH Markovian (the default) - This classifier uses + Sparse Binary Polynomial Hashing (SBPH), an extension of Bayesian classification, mapping features in the input text into a Markov Random Field. This turns each token in the input into 2^(N-1) features, which gives high accuracy but at high computation &lt; at &gt;&lt; at &gt; -52,7 +53,7 &lt; at &gt;&lt; at &gt; other classifiers. It _will_ work against binary files, though, which n</pre> Jskud.CRM114-hFAK3oOPH3QAvxtiuMwx3w< at >public.gmane.org 2012-02-07T06:27:59 http://comments.gmane.org/gmane.mail.spam.crm114/9576 <pre>Hi, All. I'm back to looking at CRM114, and I decided to update some of the documentation, working from "the (possibly) slightly unstable latest mainline version" -- thanks for the continued good work, and I hope the updates prove useful. This is the second of two. I mostly reworked the formatting to make it consistent, and made the step titles consistent as well, fixing a few obvious typos in the process. /Jskud --- crm114-20120205-ORIG/CRM114_Mailfilter_HOWTO.txt2009-09-11 11:25:57.000000000 -0700 +++ crm114-20120205/CRM114_Mailfilter_HOWTO.txt2012-02-06 19:52:36.000000000 -0800 &lt; at &gt;&lt; at &gt; -7,7 +7,7 &lt; at &gt;&lt; at &gt; The CRM114 &amp; Mailfilter HOWTO -Bill Yerazunis, 2003-09-18 -(last update 2009-03-02) +(last update 2012-02-06) This is the CRM114 Mailfilter HOWTO. It describes how to set up CRM114 &lt; at &gt;&lt; at &gt; -31,7 +31,7 &lt; at &gt;&lt; at &gt; ---------------------------------------------------------- -That said, I hope CRM114, Mailreaver, and Mailreaver is useful to you; +That said, I hope CRM114, Mailfilter, and Mailre</pre> Jskud.CRM114-hFAK3oOPH3QAvxtiuMwx3w< at >public.gmane.org 2012-02-07T06:31:46 http://comments.gmane.org/gmane.mail.spam.crm114/9574 <pre> Hello Khalid Something is broken, either with my package for libcrm114.a or something else. When I set up pecl-crm114 I get this during the configure step: checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for a sed that does not truncate output... /usr/bin/sed checking for cc... cc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether cc accepts -g... yes checking for cc option to accept ISO C89... none needed checking how to run the C preprocessor... cc -E checking for icc... no checking for suncc... no checking whether cc understands -c and -o together... yes checking for system library directory... lib checking if compiler supports -R... no checking if compiler supports -Wl,-rpath,... yes check</pre> Thomas Spahni 2012-01-08T18:36:37 http://comments.gmane.org/gmane.mail.spam.crm114/9570 <pre>Hoi Zaeme, So, setting up crm114 for someone else led me to a seriously overdue cleanup of my own rewrites.mfp file. I decided that it's probably just doing string replacements to normalize the data, so it should deal just fine with an IPv6 colon separated address. So far, it seems to do so just fine, so, Bill, I think you can call crm114 "IPv6 compliant" Reto </pre> R A Lichtensteiger 2012-01-05T18:37:50 http://comments.gmane.org/gmane.mail.spam.crm114/9574 <pre> Hello Khalid Something is broken, either with my package for libcrm114.a or something else. When I set up pecl-crm114 I get this during the configure step: checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for a sed that does not truncate output... /usr/bin/sed checking for cc... cc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether cc accepts -g... yes checking for cc option to accept ISO C89... none needed checking how to run the C preprocessor... cc -E checking for icc... no checking for suncc... no checking whether cc understands -c and -o together... yes checking for system library directory... lib checking if compiler supports -R... no checking if compiler supports -Wl,-rpath,... yes check</pre> Thomas Spahni 2012-01-08T18:36:37 http://comments.gmane.org/gmane.mail.spam.crm114/9570 <pre>Hoi Zaeme, So, setting up crm114 for someone else led me to a seriously overdue cleanup of my own rewrites.mfp file. I decided that it's probably just doing string replacements to normalize the data, so it should deal just fine with an IPv6 colon separated address. So far, it seems to do so just fine, so, Bill, I think you can call crm114 "IPv6 compliant" Reto </pre> R A Lichtensteiger 2012-01-05T18:37:50 http://comments.gmane.org/gmane.mail.spam.crm114/9574 <pre> Hello Khalid Something is broken, either with my package for libcrm114.a or something else. When I set up pecl-crm114 I get this during the configure step: checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for a sed that does not truncate output... /usr/bin/sed checking for cc... cc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether cc accepts -g... yes checking for cc option to accept ISO C89... none needed checking how to run the C preprocessor... cc -E checking for icc... no checking for suncc... no checking whether cc understands -c and -o together... yes checking for system library directory... lib checking if compiler supports -R... no checking if compiler supports -Wl,-rpath,... yes check</pre> Thomas Spahni 2012-01-08T18:36:37 http://comments.gmane.org/gmane.mail.spam.crm114/9570 <pre>Hoi Zaeme, So, setting up crm114 for someone else led me to a seriously overdue cleanup of my own rewrites.mfp file. I decided that it's probably just doing string replacements to normalize the data, so it should deal just fine with an IPv6 colon separated address. So far, it seems to do so just fine, so, Bill, I think you can call crm114 "IPv6 compliant" Reto </pre> R A Lichtensteiger 2012-01-05T18:37:50 http://comments.gmane.org/gmane.mail.spam.crm114/9563 <pre>Hello everybody, Happy new year :-) I just released a php extension of the C-callable library crm114. I use it for a blogs platform, to detect the spam articles, since 2 weeks. Your library work fine. Are you agree to let me maintain a official php extension of the crm114 system to web developers ? Here is the futur project website : http://gymx.net/php-crm114/ The libcrm114 is staticely compiled with the php module. Based on your documentation, I have implemented the major functions. I'm open to discuss with you for any improvements or modifications. Regards, Khalid Ahsein ------------------------------------------------------------------------------ Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev_______________________________________________ Crm114-general mailing list Cr</pre> Khalid Ahsein 2012-01-03T18:25:14 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.mail.spam.crm114