http://blog.gmane.org/gmane.comp.web.planet.devel hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://permalink.gmane.org/gmane.comp.web.planet.devel/2308 <pre>Thanks Kevin, I have looked into this, and stuck what I gave found on a wiki page, http://wiki.davelevy.info/?p=371 Anyone considering writing a bespoke venus browser agent for Twitter API V1.1, consume it using JSON, convert to XML, cache it and convert as planet does with XML feeds. It’s beyond me, but is it possible? -- Dave david.levy&lt; at &gt;tiscali.co.uk From: Kevin Gmail [mailto:kevin.hamilton&lt; at &gt;gmail.com] Sent: 13 March 2013 00:59 To: Dave Levy Cc: &lt;devel&lt; at &gt;lists.planetplanet.org&gt; Subject: Re: Venus and Twitter Twitter is retiring that API https://dev.twitter.com/blog/planning-for-api-v1-retirement On Mar 12, 2013, at 6:57 PM, "Dave Levy" &lt;david.levy&lt; at &gt;tiscali.co.uk&gt; wrote: I have since March 4th got a 410 on my twitter feed. http://api.twitter.com/1/statuses/user_timeline.rss?screen_name=davelevy seems to work with wget and in browsers [http://api.twitter.com/1/statuses/user_timeline.rss?screen_name=davelevy] name = twitter message = http://twitter.com/davelevy face = http://twitter.com/favicon.ico :~/venus/venus &gt; planet.py mingle/mingle.ini INFO:planet.runner:Socket timeout set to 20 seconds INFO:planet.runner:Building work queue INFO:planet.runner:Feed https://api.twitter.com/1/statuses/user_timeline.rss?screen_name=davelevy gone My friendfeed also coughed, but when I refreshed the feed friendfeed pulled it down. Any ideas please? -- Dave david.levy&lt; at &gt;tiscali.co.uk </pre> Dave Levy 2013-03-29T11:40:20 http://permalink.gmane.org/gmane.comp.web.planet.devel/2307 <pre> Oh, fyi, Wikimedia (Wikipedia) also uses Planet Venus now and we have it puppetized. http://en.planet.wikimedia.org/ and several other languages: ar.planet.wm ca.planet.wm cs.planet.wm de.planet.wm en.planet.wm es.planet.wm gmq.planet.wm it.planet.wm ja.planet.wm pl.planet.wm pt.planet.wm ro.planet.wm ru.planet.wm sr.planet.wm zh.planet.wm https://wikitech.wikimedia.org/wiki/Planet https://wikitech.wikimedia.org/wiki/Planet#Where.27s_the_code.3F http://meta.wikimedia.org/wiki/Planet_Wikimedia </pre> Daniel Zahn 2013-03-28T22:32:45 http://permalink.gmane.org/gmane.comp.web.planet.devel/2306 <pre>Hello, Since there is a list of existing Planet (Venus) instances at &lt;http://www.planetplanet.org/&gt;, it may be appropriate to add this new one which I have just installed: Planète auto-hébergement &lt;http://planet.auto-hebergement.fr/&gt; It is in French, and about self-hosting on the Internet. Not sure of whether or not it is appropriate to list a French-speaking planet… </pre> Tanguy Ortolo 2013-03-28T16:42:15 http://permalink.gmane.org/gmane.comp.web.planet.devel/2305 <pre> Incidentally, have you ever considered switching to a markup language for the docs? E.g. Sphinx (i.e. ReStructuredText)? You could get fancy readthedocs.org Github integration that way. Hmpf. I'm tempted to investigate adding support for Mako templates and switching to that, instead of polishing this hack. Ah, to make the _test_ possible. I understand now. Marius Gedminas </pre> Marius Gedminas 2013-03-22T16:13:41 http://permalink.gmane.org/gmane.comp.web.planet.devel/2304 <pre> The can make their own hacks :) I pointed you to a test that verifies that the HTML produced is what is expected. If writing a test to verify that the ids actually show up in the output requires a change to a template, don't be shy; either provide a template that exercises this function or modify an existing one. - Sam Ruby </pre> Sam Ruby 2013-03-22T15:00:32 http://permalink.gmane.org/gmane.comp.web.planet.devel/2303 <pre> For the id_hash hack in tmpl.py? But that only adds it to people who use the built-in HTML templating language. What about people who use Django templates or XSLT? To make what possible? :) Marius Gedminas </pre> Marius Gedminas 2013-03-22T14:46:08 http://permalink.gmane.org/gmane.comp.web.planet.devel/2302 <pre> Add some documentation https://github.com/mgedmin/venus/blob/master/docs/templates.html And a test https://github.com/mgedmin/venus/blob/master/tests/test_apply.py And submit a pull request. Feel free to add or change one or more of the templates in the themes directory to make this possible. - Sam Ruby </pre> Sam Ruby 2013-03-22T13:39:59 http://permalink.gmane.org/gmane.comp.web.planet.devel/2301 <pre>Hello! I'm once again using Planet for my feed-reading needs: https://github.com/mgedmin/planet-mg This is all jury-rigged with duct tape and string: cron, apache, some Javascript that remembers which posts I've read (and stores that info in a cookie). Please don't laugh too much at the CGI script for "adding" new subscriptions: https://github.com/mgedmin/planet-mg/commit/d688e0 My custom Javascript needs reasonably short unique IDs for posts, and they must also be valid HTML IDs. I patched venus to give me MD5 hashes of post IDs: https://github.com/mgedmin/venus/commit/9f6d987 Question: can I achieve that without patching the core? I tried to figure out filters, but gave up. Marius Gedminas </pre> Marius Gedminas 2013-03-22T13:02:39 http://permalink.gmane.org/gmane.comp.web.planet.devel/2300 <pre> Working here... $ git clone https://github.com/rubys/venus.git Cloning into 'venus'... remote: Counting objects: 3245, done. remote: Compressing objects: 100% (1039/1039), done. remote: Total 3245 (delta 2238), reused 3153 (delta 2170) Receiving objects: 100% (3245/3245), 3.00 MiB | 1.65 MiB/s, done. Resolving deltas: 100% (2238/2238), done. - Sam Ruby </pre> Sam Ruby 2013-03-15T12:56:19 http://permalink.gmane.org/gmane.comp.web.planet.devel/2299 <pre>Hi all When I try this: *git clone https://github.com/rubys/venus.git* I get this: *Initialized empty Git repository in /home/alex/src/venus/.git/ Cannot get remote repository information. Perhaps git-update-server-info needs to be run there? * Any ideas? Cheers Alex </pre> Alex Schröder 2013-03-15T09:45:51 http://permalink.gmane.org/gmane.comp.web.planet.devel/2298 <pre>Twitter is retiring that API https://dev.twitter.com/blog/planning-for-api-v1-retirement On Mar 12, 2013, at 6:57 PM, "Dave Levy" &lt;david.levy&lt; at &gt;tiscali.co.uk&gt; wrote: </pre> Kevin Gmail 2013-03-13T00:59:02 http://permalink.gmane.org/gmane.comp.web.planet.devel/2297 <pre>I have since March 4th got a 410 on my twitter feed. http://api.twitter.com/1/statuses/user_timeline.rss?screen_name=davelevy seems to work with wget and in browsers [http://api.twitter.com/1/statuses/user_timeline.rss?screen_name=davelevy] name = twitter message = http://twitter.com/davelevy face = http://twitter.com/favicon.ico :~/venus/venus &gt; planet.py mingle/mingle.ini INFO:planet.runner:Socket timeout set to 20 seconds INFO:planet.runner:Building work queue INFO:planet.runner:Feed https://api.twitter.com/1/statuses/user_timeline.rss?screen_name=davelevy gone My friendfeed also coughed, but when I refreshed the feed friendfeed pulled it down. Any ideas please? -- Dave david.levy&lt; at &gt;tiscali.co.uk </pre> Dave Levy 2013-03-12T23:57:25 http://permalink.gmane.org/gmane.comp.web.planet.devel/2296 <pre>Hello planet people, i am currently working on switching "Planet Wikimedia" (http://meta.wikimedia.org/wiki/Planet_Wikimedia) to use planet-venus. running planet-venus 0~bzr116-1 (Ubuntu distro package in precise), i notice i am getting some "ERROR:planet.runner:Error 500 while updating feed" for some feeds that work fine for me when opening the feed URLs in a browser. I see one thing they have in common, there are UTF-8 characters in the URLs, they are: http://hyperboree-apollon.blogspot.com/feeds/posts/default/-/wikipédia http://pymouss.blogspot.com/feeds/posts/default/-/Wikipédia http://wikiźródła.pl/blog/?feed=rss2 Could that cause the 500 errors in any way? I did not see this issue with any English planets. Either they were really 500 also when manually looking at them in a browser, or they just worked. Thanks for any hints, </pre> Daniel Zahn 2012-08-29T23:27:34 http://permalink.gmane.org/gmane.comp.web.planet.devel/2295 <pre>Hi, all, I've been a bit frustrated because http://planet.fedoraproject.org/ has enough non-English entries to be frustrating. I've hacked together support for calling Google Translate, which seems to work pretty well! Code is below. The biggest bug is that it is retranslating existing entries, which is not only wasteful but since GT is a paid API, costs real money! I was hoping someone could help me properly insert the translate hook to work properly with the caching so as to not do this. Once this is cleaned up and the hacks are removed, might this be something upstream would merge? http://fedoraplanet.groveronline.com/ (current dev instance, with planet.f.o content translated.. it's not perfect, but it's better) Thanks -- Regards -- Andy --- __init__.py2012-06-11 12:34:11.225999994 -0700 +++ __init__.py.new2012-06-10 23:02:16.424000005 -0700 &lt; at &gt;&lt; at &gt; -889,6 +888,11 &lt; at &gt;&lt; at &gt; item.language != self._channel.language) : self.set_as_string(key + "_language", item.language) value += cache.utf8(item.value) + import translate + try: + value = translate.translate(value) + except Exception: + pass self.set_as_string(key, value) elif isinstance(entry[key], (str, unicode)): # String fields ---start translate.py---- import urllib import urllib2 import json baseUrl = "https://www.googleapis.com/language/translate/v2" def getSplits(text,splitLength=900): ''' Translate Api has a limit on length of text(2000 characters with GET) that can be translated at once, ''' return (text[index:index+splitLength] for index in xrange(0,len(text),splitLength)) def translate(text, src='', to='en'): ''' A Python Wrapper for Google AJAX Language API: * Uses Google Language Detection, in cases source language is not provided with the source text * Splits up text if it's longer then 2000 characters, as a limit put up by the API ''' params = dict(target=to, key='&lt;omitted&gt;') retText='' for text in getSplits(text): params['q'] = text url = "%s?%s" % (baseUrl, urllib.urlencode(params)) resp = json.loads(urllib2.urlopen(url).read()) try: retText += resp['data']['translations'][0]['translatedText'] except: raise return retText --end translate.py-- </pre> Andy Grover 2012-06-11T19:55:11 http://permalink.gmane.org/gmane.comp.web.planet.devel/2294 <pre>Dear all, I had the same problem as below, with the "Unable to locate filter addsearch.xslt" message and the whole error I installed Planet-Venus on another computer with nearly the same OS, and tests worked. After an inquiry, I found that tests where not run in the same order on both computer. If I run test in the "right" order it works on both computer. If I only run the test "test_filter_xslt.py" (with the "./runtests.py test_filter_xslt.py" command) I have the same error on both computer, the one I had first. Can someone tell me if there is something wrong with my install or if there is a small bug in the tests ? Samuel Kay Not working test order : modules = ['tests.test_filter_xslt', 'tests.test_docs', 'tests.test_subconfig', 'tests.test_idindex', 'tests.test_reconstitute', 'tests.test_filter_genshi', 'tests.test_apply', 'tests.test_rlists', 'tests.test_filter_tmpl', 'tests.test_config_csv', 'tests.test_spider', 'tests.test_splice', 'tests.test_scrub', 'tests.test_foaf', 'tests.test_filters', 'tests.test_filter_django', 'tests.test_sam', 'tests.test_expunge', 'tests.test_opml', 'tests.test_config', 'tests.test_themes'] Working test order : modules = ['tests.test_subconfig', 'tests.test_docs', 'tests.test_foaf', 'tests.test_spider', 'tests.test_filter_genshi', 'tests.test_rlists', 'tests.test_idindex', 'tests.test_expunge', 'tests.test_config', 'tests.test_filter_xslt', 'tests.test_reconstitute', 'tests.test_splice', 'tests.test_filter_django', 'tests.test_themes', 'tests.test_opml', 'tests.test_config_csv', 'tests.test_filters', 'tests.test_filter_tmpl', 'tests.test_apply', 'tests.test_scrub'] First message with this problem : ----- Following installation instructions at http://intertwingly.net/code/venus/docs/installation.html when executing runtests.py I get this error: user at jonnybarnes.net &lt;http://lists.planetplanet.org/mailman/listinfo/devel&gt; [~/public_html/planet]# python runtests.py libxml2 is not available =&gt; can't test xpath_sifter Django is not available =&gt; can't test django filters Redland RDF is not available =&gt; can't test FOAF reading lists ....Unable to locate filter addsearch.xslt E............................................................................................................................................................................................................ ====================================================================== ERROR: test_addsearch_filter (tests.test_filter_xslt.XsltFilterTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/user/public_html/planet/tests/test_filter_xslt.py", line 22, in test_addsearch_filter self.assertTrue(output.find('&lt;h2&gt;Search&lt;/h2&gt;')&gt;=0) AttributeError: 'NoneType' object has no attribute 'find' ---------------------------------------------------------------------- Ran 209 tests in 5.450s FAILED (errors=1) It then says to ask here. Any help much appreciated, Jonny. </pre> Samuel Kay 2012-06-09T19:00:32 http://permalink.gmane.org/gmane.comp.web.planet.devel/2293 <pre>Is there a way to prevent specific HTML attributes from being stripped from the RSS feeds that Planet Venus pulls from external sources? For example, this feed &lt;http://marcoceppi.com/feed/&gt; contains a &lt;div&gt; with some HTML5 data-*attributes that are parsed by some JavaScript code on the page. Unfortunately it seems like Planet Venus is pulling them out - is there some configuration setting that could be changed to prevent this? Thanks, Nathan </pre> Nathan Osman 2012-05-08T23:05:33 http://permalink.gmane.org/gmane.comp.web.planet.devel/2292 <pre>Venus includes examples to generate Atom &amp; RSS feeds: http://intertwingly.net/code/venus/themes/common/atom.xml.xslt http://intertwingly.net/code/venus/themes/common/rss10.xml.tmpl http://intertwingly.net/code/venus/themes/common/rss20.xml.tmpl The asf theme generates the atom.xml feed e.g. http://intertwingly.net/code/venus/themes/asf/config.ini --Amit On Mon, Apr 16, 2012 at 5:04 AM, Thimuth Amarakoon &lt;thimuth&lt; at &gt;gmail.com&gt;wrote: </pre> Amit Chakradeo (अमित चक्रदेव 2012-04-17T01:22:13 http://permalink.gmane.org/gmane.comp.web.planet.devel/2291 <pre>Terribly sorry, my mistake, then. On Mon, Apr 16, 2012 at 7:08 PM, Dave Levy &lt;david.levy&lt; at &gt;tiscali.co.uk&gt; wrote: </pre> Kádár Tamás (KTamas 2012-04-16T17:11:07 http://permalink.gmane.org/gmane.comp.web.planet.devel/2290 <pre>Venus invokes conversion templates and ships with, at least, RSS 1, RSS 2 and Atom for feeds and OPML &amp; FOAF for the lists. The templates and conversion technology is specified in the config file. I can't login to my servers at the moment so can't quote config file. The fancy and basic template sets both, I think, have rss .tmpl files and there may be some .xslt files around, I know I use them and haven't written them. Enjoy -- Dave david.levy&lt; at &gt;tiscali.co.uk -----Original Message----- From: devel-bounces&lt; at &gt;lists.planetplanet.org [mailto:devel-bounces&lt; at &gt;lists.planetplanet.org] On Behalf Of Kádár Tamás (KTamas) Sent: 16 April 2012 13:19 To: Thimuth Amarakoon Cc: devel&lt; at &gt;lists.planetplanet.org Subject: Re: RSS feed from venus aggregator Not as far as I know, no, but I guess you could build a template for it by hand with one of the supported template engines. On Mon, Apr 16, 2012 at 2:04 PM, Thimuth Amarakoon &lt;thimuth&lt; at &gt;gmail.com&gt; wrote: -- devel mailing list devel&lt; at &gt;lists.planetplanet.org http://lists.planetplanet.org/mailman/listinfo/devel </pre> Dave Levy 2012-04-16T17:08:54 http://permalink.gmane.org/gmane.comp.web.planet.devel/2289 <pre>Not as far as I know, no, but I guess you could build a template for it by hand with one of the supported template engines. On Mon, Apr 16, 2012 at 2:04 PM, Thimuth Amarakoon &lt;thimuth&lt; at &gt;gmail.com&gt; wrote: </pre> Kádár Tamás (KTamas 2012-04-16T12:19:04 http://permalink.gmane.org/gmane.comp.web.planet.devel/2288 <pre>Hi All, How can I get a RSS feed from venus aggregator? Does it support for a feed by default? If so what is the feed URL. Thanks, Thimuth </pre> Thimuth Amarakoon 2012-04-16T12:04:01 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.web.planet.devel