gmane.comp.python.pywikipediabot.general

Rewrite logging headers

Russell Blau — 2013-05-15T20:08:13

On the rewrite branch, how does one suppress the 20+ lines of logging
header that are output at the beginning of every script?

Re: redirect.py should (or at least give you the option to) tag for deletion broken redirects if the bot has not sysop rights

Marco Aurelio — 2013-05-15T20:07:01

Hi,

Thanks for your reply. My bot works currently at meta.wikimedia.org (Meta-Wiki). The speedy deletion tag is {{delete}} and accepts optional comments such as {{delete|1=Broken redirect.}}.

Regards,
M
----- Mensaje original -----
De: pywikipedia-l-request< at >lists.wikimedia.org
Enviado: 13-05-13 14:00
Para: pywikipedia-l< at >lists.wikimedia.org
Asunto: Pywikipedia-l Digest, Vol 70, Issue 9

Send Pywikipedia-l mailing list submissions to pywikipedia-l< at >lists.wikimedia.org To subscribe or unsubscribe via the World Wide Web, visit https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l or, via email, send a message with subject or body 'help' to pywikipedia-l-request< at >lists.wikimedia.org You can reach the person managing the list at pywikipedia-l-owner< at >lists.wikimedia.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Pywikipedia-l digest..." Today's Topics: 1. Re: redirect.py should (or at least give you the option to) tag for deletion broken redirects if the bot has not sysop rights (info< at >gno.de) 2. Re: Two wikidata bots (Jan Dudík) ---------------------------------------------------------------------- Message: 1 Date: Sun, 12 May 2
 013 17:58:20 +0200 (CEST) From: info< at >gno.de To: pywikipedia-l< at >lists.wikimedia.org Subject: Re: [Pywikipedia-l] redirect.py should (or at least give you the option to) tag for deletion broken redirects if the bot has not sysop rights Message-ID: <215129750.383650.1368374300935.JavaMail.ngmail< at >webmail08.arcor-online.net> Content-Type: text/plain; charset=ISO-8859-1 This behaviour was not changed in past. Maybe the corresponding deletion tag has been changed. At which wiki are you working whith it? xqt ----- Original Nachricht ---- Von: Marco Aurelio <maurelio< at >gmx.es> An: Lista pywikibot <pywikipedia-l< at >lists.wikimedia.org> Datum: 10.05.2013 19:36 Betreff: [Pywikipedia-l] redirect.py should (or at least give you the option to) tag for deletion broken redirects if the bot has not sysop rights
  > Hi, > > I run my bot in some projects where I do handle broken/double redirects > repairs. IIRC in the past the redirect.py script did tagged for deletion the > broken redirects if the bot didn't had sysop rights (or a sysop was not in > the 'sysopnames' var in user_config). > > Why was this functionality removed? Did it gave problems? - I would be > interested in having it back. I even remember having translated some > messages in translatewiki.net for that. > > Thank you, > -M. > > > -------------------------------- > > _______________________________________________ > Pywikipedia-l mailing list > Pywikipedia-l< at >lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l >
_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: SVN reaching end of life - migration plan needed

Chad Horohoe — 2013-05-15T11:33:50

Ooh, you found my tool :) Cleaning up those rule files should be
pretty trivial, then we can convert all of the wanted history pretty
quickly. I've gone ahead and drafted a page on mw.org based on
the rules you wrote along with a survey of the existing SVN layout.

https://www.mediawiki.org/wiki/Git/Conversion/pywikipedia



I'm afraid I won't be making it this year.

-Chad
_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: SVN reaching end of life - migration plan needed

Merlijn van Deen — 2013-05-15T08:19:35

Hi Chad,

In December, I think the consensus was to move to Gerrit [1] -
basically with the goal to keep it as close as possible to mediawiki,
hopefully also easing contributions (to mw for pwb developers and vice
versa). I have put some initial work into the migration (see
https://github.com/pywikibot/svn2git ), but I have not had the time to
smooth out the wrinkles.

Will you be at the Hackathon next week? I think this would be a good
topic to discuss there.

Merlijn

[1] http://lists.wikimedia.org/pipermail/pywikipedia-l/2012-December/007657.html

On 15 May 2013 01:37, Chad Horohoe <chorohoe< at >wikimedia.org> wrote:

_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

SVN reaching end of life - migration plan needed

Chad Horohoe — 2013-05-14T23:37:44

Hi all,

The time has finally come upon us--I'm finally moving forward with shutting
down SVN and making it a read-only service. As Pywikipedia is the only
consumer of SVN anymore, I wanted to reach out to the community to find
out what everyone wants to do. As I see it, there's three courses of action
that Pywikipedia can go in:

1) Move to Gerrit
2) Move to Git elsewhere (Github, Google Code, etc)
3) Move to some other SVN service

I'm more than willing to help with any of these choices--the first two would
involve a conversion of the history to Git, along with importing it to the
destination of choice. Staying with SVN is also potentially possible, I'm
more than  happy to provide full SVN dumps if someone's wanting to setup
that service elsewhere.

What are people's thoughts? I've not come up with a firm date yet, but
coming to consensus sooner rather than later would be nice.

Thanks!

-Chad H.
_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: Two wikidata bots

Jan Dudík — 2013-05-12T20:00:13

Sorry, I am not able to change scripts in that way - I am only user,
not developer ;-)

I meant - there are some infoboxes, which have
| foo = bar
but in artice is it presented as

Foo: [[bar]]

(example: [[cs:šablona:Infobox okres]])


JAnD
2013/5/11 Maarten Dammers <maarten< at >mdammers.nl>:

Re: redirect.py should (or at least give you the option to) tag for deletion broken redirects if the bot has not sysop rights

2013-05-12T15:58:20

This behaviour was not changed in past. Maybe the corresponding deletion tag has been changed. At which wiki are you working whith it?

xqt


----- Original Nachricht ----
Von:     Marco Aurelio <maurelio< at >gmx.es>
An:      Lista pywikibot <pywikipedia-l< at >lists.wikimedia.org>
Datum:   10.05.2013 19:36
Betreff: [Pywikipedia-l] redirect.py should (or at least give you the option
 to) tag for deletion broken redirects if the bot has not sysop rights


_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: Two wikidata bots

Amir Ladsgroup — 2013-05-12T06:18:39

I think we should do this even for upcoming data types (date, number) in
the Hackathon, together

I'll do that for the trunk branch :)


On Sat, May 11, 2013 at 7:38 PM, Maarten Dammers <maarten< at >mdammers.nl>wrote:

Re: Two wikidata bots

Maarten Dammers — 2013-05-11T15:08:59

Hi Jan,

Op 10-5-2013 9:38, Jan Dudík schreef:
You're welcome to expand it to support more data types! :-)

Maarten


_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

redirect.py should (or at least give you the option to) tag for deletion broken redirects if the bot has not sysop rights

Marco Aurelio — 2013-05-10T17:36:22

Hi,

I run my bot in some projects where I do handle broken/double redirects repairs. IIRC in the past the redirect.py script did tagged for deletion the broken redirects if the bot didn't had sysop rights (or a sysop was not in the 'sysopnames' var in user_config).

Why was this functionality removed? Did it gave problems? - I would be interested in having it back. I even remember having translated some messages in translatewiki.net for that.

Thank you,
-M.
_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: Two wikidata bots

Jan Dudík — 2013-05-10T07:38:56

It looks good,
but only works for [[links]], not for strings :-(

JAnD
2013/5/9 Maarten Dammers <maarten< at >mdammers.nl>:

Two wikidata bots

Maarten Dammers — 2013-05-09T21:06:10

Hi everyone,

Today I published and documented two scripts to mass add claims using 
the rewrite branch:
* claimit.py: A script to mass add Wikidata claims to a lot of items 
based on pages on Wikipedia [1]
* harvest_template.py: A script to mass add Wikidata claims based on 
information harvested from Wikipedia templates. [2]
Both are still a bit rough, but now it's possible to add claims on 
Wikidata without writing a single line of code. Just run these bots from 
the commandline.

I implemented it in rewrite because the I like the implementation of 
Wikidata more than in trunk. It would be nice if trunk could just have 
the same objects and interface as rewrite. Any opinions of this?

Maarten

[1] https://www.mediawiki.org/wiki/Manual:Pywikipediabot/claimit.py
[2] https://www.mediawiki.org/wiki/Manual:Pywikipediabot/harvest_template.py


_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Argument Parsing

David Narvaez — 2013-05-09T05:21:34

Hi all,

Would it ever make sense to change the whole -argumentname: command
line argument style? For instance, replace it with the standard
argument handling provided by Python[0] or (GNU) getopt[1]. As every
style change, this may just be me, but I can still list a couple of
reasons to do this:

- Standard command line arguments
- Offload the argument parsing code to tried and true libraries

Maybe in the rewrite branch?

David E. Narvaez

[0] http://docs.python.org/2/library/argparse.html
[1] http://docs.python.org/2/library/getopt.html

_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: Pywikipedia-l Digest, Vol 70, Issue 3

Michael Hamm — 2013-05-05T15:22:19

Sorawee Porncharoenwase <nullzero.free< at >gmail.com>:

And for me.  Many thanks!

Michael Hamm

_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: replacing based on two regexes not near eachother

Sorawee Porncharoenwase — 2013-05-03T12:09:25

Okay, This code works for me.

#------- user-fixes.py -------
import re

def homophix(match):
    return re.sub(r'(\{\{homophones\|)([^}=]*\}\})',
                  r'\1lang={{subst:langrev|'+match.group(1)+r'}}|\2',
                  match.group(0)
                  )

fixes['homophones'] = {
    'regex': True,
    'msg': {'_default':u'add lang to homophones'},
    'replacements': [
        (r'(?m)^== *([^\n]+) *== *((?!==(?!=))[^\n]*\n)*', homophix)
    ]
}
#--------------

See
http://en.wiktionary.org/w/index.php?title=Wiktionary%3ASandbox&diff=20335085&oldid=20335084for
its edit.


On Fri, May 3, 2013 at 4:02 AM, Michael Hamm <msh210< at >gmail.com> wrote:

Re: replacing based on two regexes not near eachother

Michael Hamm — 2013-05-02T21:02:08

Several hours ago, I wrote, in part:

I've taken the advice I've gotten on-list, but the script still
doesn't work.  I'd appreciate any further ideas.

Thanks,

Michael Hamm

_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: replacing based on two regexes not near eachother

Michael Hamm — 2013-05-02T15:25:35

Bináris <wikiposta< at >gmail.com>:

Sorawee Porncharoenwase <nullzero.free< at >gmail.com>:

Thank you both very much.  Probably (I won't be able to test it until
later today) these were the problem -- or part of it.

Michael Hamm

_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: replacing based on two regexes not near eachother

Sorawee Porncharoenwase — 2013-05-02T08:32:26

< at >Bináris: "(?m)" means /^/ and /$/ will also match beginning and ending of
lines, while "(?s)" means /./ will also match "\n". These two flags are not
the same and can't use interchangeably.

< at >Michael Hamm: Beside Bináris's suggestion, re.escape should be used only
on pattern parameter, not replacing text; use match.group(1) instead of
re.escape(match.group(1))

On Thu, May 2, 2013 at 2:41 PM, Bináris <wikiposta< at >gmail.com> wrote:

Re: replacing based on two regexes not near eachother

Bináris — 2013-05-02T07:41:11

Try this first in replacements:

ur'(?m)^== *([a-zA-Z ]+) *==\n+ etc.
m for multiline (sometimes ?s works instead, I just use it without
understanding why), and space* in case there are spaces between == marks.

replacing based on two regexes not near each other

Michael Hamm — 2013-05-02T06:40:32

Hi,

Each ns:0 page on English Wiktionary is divided into a bunch of
sections headed by level-2 headers.  The text of each level-2 header
is the name of a language; e.g., ==English==.

I use (something like) the following JavaScript when editing pages:

txt =
  txt.replace
  ( /^==([a-zA-Z ]+)==\n+(?:(?:===|[^=]).*\n+)*/gm,
    function(section, langname)
    { return '' +
        section.replace
        ( /(\{\{homophones\|)([^=}]*\}\})/gm,
          '$1lang={'+'{subst:langrev|'+langname+'}}|$2'
        );
    }
  );

This searches for {{homophones|...}} without a lang= parameter and
adds the lang= parameter appropriate for the ==section== in which
{{homophones|...}} appears.  This works.

I want to automate this, so wish to use pywikipediabot.  So I've
translated the above into Python as best I could, and come up with the
following user-fixes.py :

def homophix(match):
    return re.sub(r'(\{\{homophones\|)([^}=]*\}\})',
                  r'\1lang={{subst:langrev|'+re.escape(match.group(1))+r'}}|\2',
                  match.group(0)
                  )

fixes['homophones'] = {
    'regex': True,
    'msg': {'_default':u'add lang to homophones'},
    'replacements': [
        (ur'^==([a-zA-Z ]+)==\n+(?:(?:===|[^=]).*\n+)*', homophix)
    ]
}

...which I then tried to call using
python replace.py -fix:homophones -page:accapare


(Note that [[wikt:en:accapare]] has {{homophones|...}} without = .)

Python told me:
No changes were necessary in [[accapare]]
0 pages were changed.

So I guess it's either not matching or not replacing.

What am I doing wrong?

And what can I do instead?

Thanks,

Michael Hamm

_______________________________________________
Pywikipedia-l mailing list
Pywikipedia-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: [rewrite] Using pywikibot.Timestamp instead of raw MediaWiki ones

Sorawee Porncharoenwase — 2013-04-29T13:07:20

In function getVersionHistory, it should be
"pywikibot.Timestamp.fromISOformat", not
"pywikibot.Timestamp.fromtimestampformat"


On Sat, Apr 27, 2013 at 6:34 PM, legoktm <legoktm.wikipedia< at >gmail.com>wrote: