gmane.mail.fetchmail.user

Re: getting fetchmail to work with postfix

Rob MacGregor — 2012-05-25T16:26:53

On Fri, May 25, 2012 at 1:53 PM, Jürgen Echter
<j.echter< at >echter-kuechen-elektro.de> wrote:

Your Postfix configuration doesn't support the domain - ensure you've
correctly configured it to support that domain, or tell fetchmail to
deliver to a domain the server is configured to support.

getting fetchmail to work with postfix

Jürgen Echter — 2012-05-25T12:53:24

Hi,

i try to setup fetchmail to get mails and send them with postfix to my 
local dovecot imapd.

If i try to run fetchmail i get this in the logs:

fetchmail[4514]: 1 message for test< at >mydomain.de at mailserver.external.de.
fetchmail[4514]: reading message test< at >mydomain< at >mailserver.external.de:1 
of 1 (649 header octets) (log message incomplete)
fetchmail[4514]: connection to localhost:smtp [::1/25] failed: 
Connection refused.
postfix/smtpd[4516]: connect from localhost[127.0.0.1]
postfix/smtpd[4516]: NOQUEUE: reject: RCPT from localhost[127.0.0.1]: 
550 5.1.1 <test< at >mydomain.de>: Recipient address rejected: mydomain.de; 
from=<j.echter< at >mydomain.de> to=<test< at >mydomain.de> proto=ESMTP 
helo=<mehlbox.workgroup.local>
fetchmail[4514]: SMTP error: 550 5.1.1 <test< at >mydomain.de>: Recipient 
address rejected: mydomain.de
fetchmail[4514]: connection to localhost:smtp [::1/25] failed: 
Connection refused.
postfix/smtpd[4519]: connect from localhost[127.0.0.1]
postfix/smtpd[4519]: NOQUEUE: reject: RCPT from localhost[127.0.0.1]: 
550 5.1.1 <j.echter< at >mydomain.de>: Recipient address rejected: 
mydomain.de; from=<> to=<j.echter< at >mydomain.de> proto=SMTP 
helo=<mehlbox.workgroup.local>
postfix/smtpd[4519]: disconnect from localhost[127.0.0.1]
postfix/smtpd[4516]: NOQUEUE: reject: RCPT from localhost[127.0.0.1]: 
550 5.1.1 <j.echter< at >mydomain.de>: Recipient address rejected: 
mydomain.de; from=<j.echter< at >mydomain.de> to=<j.echter< at >mydomain.de> 
proto=ESMTP helo=<mehlbox.workgroup.local>
fetchmail[4514]: can't even send to j.echter< at >echter-kuechen-elektro.de!
fetchmail[4514]:  flushed
postfix/smtpd[4516]: disconnect from localhost[127.0.0.1]
fetchmail[4514]: sleeping at Fr 25 Mai 2012 14:42:00 CEST for 300 seconds


my fetchmailrc looks like this:

set postmaster "j.echter< at >mydomain.de"
set bouncemail
set no spambounce
set properties ""
set syslog
set daemon 300

poll mailserver.external.de with proto IMAP
        user 'test< at >mydomain.de' there with password 's3cr3t' is 
'test< at >mydomain.de' here ssl

is the problem because i told fetchmail to send mails also to 
test< at >mydomain.de?

postfix looks up users via ldap, which works afaik

postmap -q test< at >mydomain.de ldap:/etc/postfix/ldap-aliases.cf
test< at >mydomain.de


sorry if this is too simple, for me its not easy to get whats wrong.

greets

juergen

Re: [solved] non-default "mailbox selectionfailed"

Travis Osterman — 2012-05-24T23:47:57

I tried that (.spam.missed/) and .spam/.missed/ both with no luck.  I
did however spend some more time reading through the man page on
'sa-learn' which does take the directory as an argument and I can then
delete them.  With this solution, I don't need procmail or a saved a
cleartext password (but is dependent on access to cron).

#!/bin/bash
# spam training
FALSE_NEGS=/home/tosterma/.maildir/.spam.missed/
sa-learn --spam $FALSE_NEGS > /dev/null 2>&1
rm -f $FALSE_NEGS/new/*
rm -f $FALSE_NEGS/cur/*

Still not sure why it didn't like that directory.

Re: non-default "mailbox selection failed"

Rob MacGregor — 2012-05-24T21:59:25

That's not a mailbox path - that's a file system path. Try passing the
mailbox as the argument (presumably .spam.missed).

non-default "mailbox selection failed"

Travis Osterman — 2012-05-24T18:03:26

Hello, I am trying to use fectchmail to fetch the contents of a folder
(.spam.missed/) from my courier-imap server so that I can send the
messages to spamassassin's learning program.  Using this as a guide:
http://wiki.apache.org/spamassassin/SingleUserUnixInstall#Enable_IMAP_LearnAsSpam_folder

When I invoke
$ /usr/bin/fetchmail -a -v -n --folder /home/USER/.maildir/.spam.missed/
-m '/usr/bin/sa-learn -D --spam' --fetchmailrc /home/USER/.spamtrainingpoprc

I get this:
[snip]
fetchmail: IMAP> A0004 LOGIN "USER" *
fetchmail: IMAP< A0004 OK LOGIN Ok.
fetchmail: IMAP> A0005 SELECT "/home/USER/.maildir/.spam.missed/"
fetchmail: IMAP< A0005 NO Mailbox does not exist, or must be subscribed to.
fetchmail: mailbox selection failed
fetchmail: IMAP> A0006 LOGOUT
fetchmail: IMAP< * BYE Courier-IMAP server shutting down
fetchmail: IMAP< A0006 OK LOGOUT completed
fetchmail: client/server synchronization error while fetching from
USER< at >domain.tld
fetchmail: 6.3.21 querying domain.tld (protocol IMAP) at Thu May 24
13:21:13 2012: poll completed
fetchmail: Query status=7 (ERROR)
fetchmail: normal termination, status 7

This is the fetchmailrc file I set up (to not conflict with my main
fetchmail file which works fine)

== ~/.spamtrainingpoprc ==
# used by spamassassin to train Bayes
poll domain.tld protocol IMAP:
user USER with password PASSWORD
=================


== system info ==
OS: gentoo
gcc version 4.4.5 (Gentoo 4.4.5 p1.3, pie-0.4.5)
fetchmail 6.3.21+RPA+NTLM+SDPS+SSL+NLS
courier-imap-4.5.0
=================

Any thoughts?  Thank you in advance.

Re: Fetchmail, gmail, and a new computer

Jim J — 2012-05-23T23:57:40


All,

Thanks for all the help. I ended up writing most of the script to generate
my fetchids file when I noticed that things were behaving properly! I have
no idea why I thought the setup was broken, I must have misinterpreted
something in the logs. *sigh* I hate it when that happens.

Thanks again.

Jim

Re: Fetchmail, gmail, and a new computer

grarpamp — 2012-05-23T05:16:53

I share this woe. I'm only on it due to legacy and
am slowly searching for one with minimally:

*  Free
*  IMAPS/POP3S + with proper delete semantics (unlike gmail)
*  SMTPS + allow setting GECOS field to whatever (single word nickname)
*  No source IP in headers of sent mail

Anyways, I use fetchmail a lot with not many problems, ever :)
Just some usage issues that a script should solve.

Re: Fetchmail, gmail, and a new computer

Jerry — 2012-05-22T11:59:06

On Mon, 21 May 2012 23:08:56 -0400
Jim J articulated:


I still cannot fathom why people use GMail. However, with that said,
perhaps one of these URLs might prove useful:

http://support.google.com/mail/bin/answer.py?hl=en&answer=13289&topic=1668962&path=1669040-1668950&ctx=leftnav

http://support.google.com/mail/bin/answer.py?hl=en&answer=47948

Re: Fetchmail, gmail, and a new computer

Carlos E. R. — 2012-05-22T09:29:58

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 2012-05-22 05:08, Jim J wrote:


gmail_name< at >gmail.com< at >pop.gmail.com GmailId113300b9c0231221
gmail_name< at >gmail.com< at >pop.gmail.com GmailId113301960baa2027
gmail_name< at >gmail.com< at >pop.gmail.com GmailId113301ca7d33b545


But I insist that you do not need it if you use imap.

- -- 
Cheers / Saludos,

Carlos E. R.
(from 11.4 x86_64 "Celadon" at Telcontar)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk+7XJYACgkQIvFNjefEBxoYUQCfeV0IAzPvyvAwvwTmw3GkIN8s
jVUAoKvVX24eLFj8bviJ8KuQ/smNFo1I
=HiuH
-----END PGP SIGNATURE-----

Re: Fetchmail, gmail, and a new computer

Jim J — 2012-05-22T03:08:56


Well, this is all terribly disappointing. I wish I'd known about the UIDL
flag to begin with. I think I'm going to try to generate a fetchids file
from my maildir, but I'm not entirely sure what it looks like. From the
source it looks like it might be a text file with lines something like:

<remote username>< at >pop.gmail.com <UID>

Can somebody verify this and/or post an example for me? It looks like the
UID comes from the Message-ID header field, though some of my emails don't
have one so I'm not yet sure what to do in that case.

Thanks,

Jim

Re: Fetchmail, gmail, and a new computer

Carlos E. R. — 2012-05-22T00:17:43

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 2012-05-22 00:00, Jim J wrote:


I use gmail on two computers, and both are happy; and one of them using
both thunderbird and fetchmail. But I access using _imap_, using pop3
would be a nightmare.

I do not keep a .fetchids file.

Gmail does not delete emails, it keeps track of what you downloaded
somehow, and this index can be reset. There is a configuration place in
the gmail webmail where you can say from what date you want to download
messages.

And it breaks with pop3, do not use it.

- -- 
Cheers / Saludos,

Carlos E. R.
(from 11.4 x86_64 "Celadon" at Telcontar)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk+62ycACgkQIvFNjefEBxqbJgCfcMlTsl/+vym7aNav5ECZ6bcn
X/EAoLZiZjArUTKkGGGf0cG+A061j0U0
=qJYa
-----END PGP SIGNATURE-----

Re: Fetchmail, gmail, and a new computer

Jim J — 2012-05-21T22:00:33



Yes, all of this was on the old box. I agree with you on the UIDL. Does
this mean that fetchmail doesn't generate anything that I can use to
maintain state across machines? It's some gmail magic then?

Jim

Re: Fetchmail, gmail, and a new computer

Rob MacGregor — 2012-05-21T21:49:04

Nothing there suggesting UIDL support - you are running this on the old box?


And the fetchmailrc you provided was from the old box?


I have no idea what Google does or how it behaves. All I can tell you
is that nothing you've posted to this list suggests that you have UIDL
support enabled.

Re: Fetchmail, gmail, and a new computer

Jim J — 2012-05-21T21:43:57


Sorry, had to stop working yesterday.

ps -ef | egrep fetchmail
110     3069        1   0  17:34 ?      00:00:00 /usr/bin/fetchmail -f
/etc/fetchmailrc --pidfile / var/run/fetchmail/fetchmail.pid --syslog
1000    3079  1013   0  17:35 tty1  00:00:00 egrep --color-auto fetchmail

find /etc -name fetchmailrc -print
/etc/fetchmailrc

It would be really unfortunate to have to download all my email again. Are
you telling me that Gmail can detect my particular fetchmail client through
the NAT on my firewall in order to feed it only new mail? If I do have to
redownload everything, do you think it would suffice to download it
somewhere new, grab the UIDL file, and then delete the emails?

Thanks for your help,

Jim

Re: Fetchmail, gmail, and a new computer

Rob MacGregor — 2012-05-20T20:22:41



The first command I asked for the output of would have told you ;)


That could be Google doing something then - neither their POP3 or IMAP
implementations are quite standard. I suspect you'll have to enable
UIDL in your configuration file and live with having to re-download
lots of email.

Re: Fetchmail, gmail, and a new computer

Jim J — 2012-05-20T19:45:06


/etc/fetchmailrc:
set daemon 300
poll pop.gmail.com port 995 with protocol pop3
    user 'myusername' there with password 'mypassword' is 'mylocaluser'
here
    options ssl
    mda 'procmail -d %T'

I have no idea what the invocation line is, I'm using the built in Ubuntu
init script to do the launching. Best I can guess from reading the init
script it's something like: "/usr/bin/fetchmail -f /etc/fetchmailrc
--pidfile /var/run/fetchmail/fetchmail.pid". I also know it's being run as
user 'fetchmail' which has a home directory at /var/lib/fetchmail.

I have not explicitly enabled UIDL anywhere that I know of, yet fetchmail
does what I want on my old machine across reboots.

Thanks for the help,

Jim

Re: Fetchmail, gmail, and a new computer

Rob MacGregor — 2012-05-20T19:44:21

I would expect it to be in /etc actually. What do the following
commands show (fetchmail needs to be running for the first):

ps -ef | egrep fetchmail
find /etc -name fetchmailrc -print

Re: Fetchmail, gmail, and a new computer

Rob MacGregor — 2012-05-20T19:23:40

What does your fetchmail configuration file and command line look like?

If you've configured it to use UIDL then there is a file to track what
has been downloaded. Being able to see the fetchmail configuration
file and the command line will allow us to either tell you where it
is, or make a reasonable guess.

Fetchmail, gmail, and a new computer

Jim J — 2012-05-20T19:22:34

Thanks. I've actually been looking for that file. I can't find it. I'm
running fetchmail as a daemon from Ubuntu's init script. From what I can
tell it should be in /var/lib/fetchmail but there are no files in there
(using sudo ls -al).

I'm using pop. Honestly I don't remember exactly why just that I couldn't
get IMAP to work.

Thanks,

Jim

On Sunday, May 20, 2012, Carlos E. R. wrote:

Re: Fetchmail, gmail, and a new computer

Carlos E. R. — 2012-05-20T19:08:06

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 2012-05-20 20:24, Jim J wrote:


.fetchids


Are you using pop or imap? gmail has both, and imap works better.



- -- 
Cheers / Saludos,

Carlos E. R.
(from 11.4 x86_64 "Celadon" at Telcontar)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk+5QRYACgkQIvFNjefEBxp7KACfVeJ08WV4EGskJMeqj9JIqkov
zsUAn1tuFgmneeVEzaJj59a6k7crhLp7
=BLhY
-----END PGP SIGNATURE-----

Fetchmail, gmail, and a new computer

Jim J — 2012-05-20T18:24:20

I'm using fetchmail 6.3.18 (from Ubuntu Oneiric) to pull email from gmail
using POP3. It works fine. The first time I ran it it downloaded all of my
email. Every time I've run it since then it's downloaded only new email.
Gmail is configured to archive the email after it's been accessed via POP3.

Now I have a new computer (fetchmail 6.3.21, Ubuntu Precise). I would like
my new computer to pick up where the old left off. Fetchmail doesn't seem
to want to do this by default. Instead, it wants to download my entire
Gmail account. How do I make my new installation pick up where the other
one left off? Since fetchmail didn't download everything every time, even
after a reboot, it seems logical that there's a file somewhere I could copy
over, but I can't find one.

Thanks,

Jim