gmane.org.wikimedia.mediawiki

Re: Problem loading wikipedia xml data to database using mwdumper

Khanh Nguyen — 2012-05-24T22:30:31

  I got this error in the middle of the process:
  ERROR 1064 (42000) at line 1803: You have an error in your SQL syntax;
check the manual that corresponds to your MySQL server version for the
right syntax to use near ''{{pp-move-indef}}\n{{Anarchism
sidebar}}\n\'\'\'Anarchism\'\'\' is a [[politica' at line 1

  I got the tables.sql file from here (
http://svn.wikimedia.org/viewvc/mediawiki/trunk/phase3/maintenance/tables.sql?view=markup)
and it does not even have more than 1500 lines so I'm not sure what the
line number above refer to.

  Again, here's the full output message if someone needs it:
http://pastebin.com/BEtGTEAA
  Also, I have seen some data in my wikidb.

  Thanks,

On Thu, May 24, 2012 at 6:19 PM, Khanh Nguyen <ndkhanh824< at >gmail.com> wrote:

Re: Problem loading wikipedia xml data to database using mwdumper

Khanh Nguyen — 2012-05-24T22:19:57

 Thank you very much Brion. That fixes my problem.

On Thu, May 24, 2012 at 6:05 PM, Brion Vibber <brion< at >pobox.com> wrote:

Re: Problem loading wikipedia xml data to database using mwdumper

Brion Vibber — 2012-05-24T22:05:04


mwdumper's conversion to SQL doesn't actually create the tables for you, it
just inserts data into them assuming they already exist.

You can grab maintenance/tables.sql from a MediaWiki download and source
that into your database first to create the empty tables.

Problem loading wikipedia xml data to database usingmwdumper

Khanh Nguyen — 2012-05-24T22:01:55

 Hi all,
 I'm loading compressed wikipedia xml data into mysql database using
mwdumper. The input is the following file gotten from
http://dumps.wikimedia.org/enwiki/latest/:

          enwiki-latest-pages-meta-history1.xml-p000000010p000002130.bz2

 In mysql, I have a user named wikiuser and have an empty database for that
user named wikidb.
 I run the following command to load data into my db:

          java -jar mwdumper.jar --format=sql:1.5 [the_bz2_file_name] |
mysql -u wikiuser -p wikidb

 However, I got this error: "ERROR 1146 (42S02) at line 33: Table
'wikidb.text' doesn't exist".
 You can see the detail output messages from the link below:
          http://pastebin.com/Y6WXhxnq

 Can someone help me fix this error please?

 Many thanks,
 Chepukha

Re: Bot for rewriting external links as wiki links?

Stip — 2012-05-24T20:20:05

Am 21.05.2012 18:55, schrieb Platonides:
It's http://www.mediawiki.org/wiki/Manual:Pywikipediabot
and the regex shouldnt be that ugly. At least if you dont want to do 
everything in one strike. I'd start with
"\[http://www.example.com/wiki/(.*?)#(.*?) (.*?)\]" "[[\1#\2 | \3]]" (or 
"{{there|\2|\1 | \3}}" if you prefer; I dont know any way to check if 
the link is to a section on the current page though; maybe with 
Extension:ParserFunctions: {{#ifeq: {{NAMESPACE}}:{{PAGENAME}} | \1 | 
{{here|\2|\3}} and some kind of substitution (safesubst?); one of the 
guys on our wiki probably could do this)
Then:
"\[http://www.example.com/wiki/(.*?) (.*?)\]" "[[\1 | \2]]"
and last:
"http://www.example.com/wiki/(.*?)" "[[\1]]"

Since you can tell the bot which pages to work on, you can exclude pages 
in help and project namespaces by simply telling it to work on the 
article namespace:

replace.py -start:! -regex "\[http://www.example.com/wiki/(.*?)#(.*?) 
(.*?)\]" "[[\1#\2 | \3]]" -summary:"internal links format"

Maybe http://www.mediawiki.org/wiki/Extension:Replace_Text could do the 
trick too, but I havent tried that Extension yet.

Short URL using rewriterule without rename wiki to w

Chee-Yang Chau — 2012-05-24T01:00:25

Hi,

Here is my environment:

1. Fedora Core 16
2. Apache httpd 2.2.22
3. MediaWiki 1.19

Most of the short url solution provided are using renaming method: e.g.:
wiki to w

What if I want to stay with wiki directory without renaming?  Can I enjoy
short url too ?

This is what I have tried:

File: LocalSettings.php:

  $wgArticlePath = "/wiki/$1";
  $wgUsePathInfo = true;

File: .htaccess

  RewriteEngine On
  RewriteRule ^wiki/index.php - [L]
  RewriteRule ^wiki/(.*)$ wiki/index.php/$1 [L,QSA]

When I access my wiki site:  http://localhost/wiki/

I get a page without skin.  Is there anything else I miss in rewriterule?

adding style sheets with http urls

Poornima Pochana — 2012-05-22T15:15:44

Hi,

I am creating a new theme with mediawiki 1.18.1 and 1.19.0 source code and I have a couple of style sheets from a remote site. I am not able to add these style sheets in the resource loader styles array with a url like 'http://mysite.com/css/screen.css'. When I do, I get the following errors:

For 1.18.1, the error is:

[error] [client ::1] PHP Warning:  filemtime(): stat failed for /home/user/public_html/mw-1.18.1/skins/https://mysite.com/brand/styles/3.0/css/bg/backsplash-green_bg.css in /home/user/public_html/mw-1.18.1/includes/resourceloader/ResourceLoaderFileModule.php on line 380

For 1.19.0, the error is:
error] [client ::1] PHP Warning:  array_map(): An error occurred while invoking the map callback in /home/user/public_html/mediawiki-1.19.0/includes/resourceloader/ResourceLoaderFileModule.php on line 589

I have to download the style sheets locally and mention a local file path to the styles array.  Is this a limitation/restriction in mediawiki to add style sheets only with a file path?

Thanks,
Poornima.

Re: Bot for rewriting external links as wiki links?

Platonides — 2012-05-21T16:55:17

You could perform it using pywikipedia and some ugly regex.

Bot for rewriting external links as wiki links?

David J. Biesack — 2012-05-21T16:41:34

Is there a bot which will repair external URL coded links to the same wikinand rewrite them as wiki links?

For example, if MediaWikis were installed in www.example.com/wiki and pages contains
links using external link notation

  blah http://www.example.com/wiki/Some_page blah
  blah [http://www.example.com/wiki/Some_page some text] blah
  blah [http://www.example.com/wiki/Some_page#some_section some text] blah

then the "What links here" feature would not work because such links are not recognized.

The bot would replace those with wiki links:

 blah [[Some page]] blah
 blah [[Some page | some text]] blah
 blah [[Some page#some_section | some text]] blah or  blah {{there|some section|Some page | some text}} blah

In addition, if the link is to a section of the current page, i.e. on [[Some page]],
the second link would be updated as

 {{here|some section|some text}}

There may need to be some way to disable this (i.e. in help or project pages
that discuss link notation).

Alternatively, could Special:WhatLinksHere be "taught" to recognize the
wiki's own URL and count those links?

I looked at http://en.wikipedia.org/wiki/Category:Wikipedia_bots_by_purpose
but none of those categories seemed to match what I'm looking for.

thanks,
djb

Re: php error message on update.php output

John W. Foster — 2012-05-17T14:14:20

On Wed, 2012-05-16 at 11:24 -0400, Chad wrote: 
-------------------------------------------
Thanks Chad for the solution.
Now is working like a charm.
frosty

Re: site mirror and master-slave question

Platonides — 2012-05-16T21:37:57

Heh, sure :)
I think I'm too used to work with it in a single way.

Thanks

Re: site mirror and master-slave question

Jeremy Baron — 2012-05-16T18:09:38

s/local/destination/; s/remote/source/;

_______________________________________________
MediaWiki-l mailing list
MediaWiki-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-l

Re: site mirror and master-slave question

Platonides — 2012-05-16T17:58:13

The --delete parameter of rsync makes it not only copy new files, but
also delete those local files which are not in the remote side.

Changes in files during normal MediaWiki operation will usually be image
uploads (deletions, thumbnailing...) and by extensions such as math
(that which powers <math> tags).

Re: php error message on update.php output

Chad — 2012-05-16T15:24:33

This is a mistake in your ini files for configuring PHP, not an issue
with MediaWiki. If you look at  /etc/php5/cli/conf.d/ming.ini (per
your error) and replace instances of "#" with ";" you'll be fine.

-Chad

_______________________________________________
MediaWiki-l mailing list
MediaWiki-l< at >lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-l

php error message on update.php output

John W. Foster — 2012-05-16T13:49:50

When I run update.php I get this error message, since last php update.
Any tips on clearing it.

PHP Deprecated:  Comments starting with '#' are deprecated
in /etc/php5/cli/conf.d/ming.ini on line 1 in Unknown on line 0
PHP Deprecated:  Comments starting with '#' are deprecated
in /etc/php5/cli/conf.d/ps.ini on line 1 in Unknown on line 0
MediaWiki 1.19.0 Updater

BTW: seems to update databases OK though.
Thanks
frosty

Re: site mirror and master-slave question

chris — 2012-05-14T14:38:47

I'm using mysql replication now for another application so I know what 
that's about.   But for rsync,  not sure what you mean about --delete 
the folder.
Would you suggest rsyncing the whole mediawiki folder ?  And I'm not 
sure what you mean about 'math changes'.


On 5/13/12 11:16 AM, Platonides wrote:

Re: Indexing Wikipedia with Solr/Lucene

Platonides — 2012-05-13T19:06:32

Does it help that they are also available in separate tables?

Indexing Wikipedia with Solr/Lucene

vineet yadav — 2012-05-13T18:53:27

Hi all,
I want to create Lucene/Solr index of wikipedia xml dump. I used Solr
example(http://wiki.apache.org/solr/DataImportHandler#Example:_Indexing_wikipedia)
to index wikipedia xml dump. Since in wikipedia, Category and external
links are part of wikipedia text, I am not able to index category and
external links separately.     I want to index  Category, Externals
links etc separately and store them in separate fields.
Would anyone please be kind enough to give me a bit of advice?
Thanks
Vineet Yadav

Re: MediaWiki:Sidebar

Stip — 2012-05-13T17:15:16

Am 13.05.2012 18:36, schrieb Platonides:
Thanks very much for this, works like a charm! :D

Greetings
Stip

Re: Issue with recent Php5 update

John W. Foster — 2012-05-13T16:41:20

On Sun, 2012-05-13 at 16:31 +0200, Platonides wrote: 

I actually did the Php5 updates when I was installing the php-curl
module. I did find some file missmatch errors so I decided to go ahead &
upgrade to mediawiki-1.19.0 to make sure all my dependencies were in
sync. That fixed the problem. Also; at least so far...no screen
artifacts, & the {{wikipedia::linktopage}} is now working fine. I'll
leave it be for a while. LOL!! 
Thanks!
frosty

Re: MediaWiki:Sidebar

Platonides — 2012-05-13T16:36:44

Ok, I wasn't testing with {{!}} template.

{{PAGENAME}} works by default in the sidebar, but not in the sidebar titles.



If you had:
*Search for this page
** http://example.net/{{PAGENAMEE}} | Link

you can add in [[MediaWiki:Common.css]]
#p-Search_for_this_page { display: none }
.ns-0 #p-Search_for_this_page { display: block }