http://blog.gmane.org/gmane.comp.web.planet.devel hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.web.planet.devel/2293 <pre>Is there a way to prevent specific HTML attributes from being stripped from the RSS feeds that Planet Venus pulls from external sources? For example, this feed &lt;http://marcoceppi.com/feed/&gt; contains a &lt;div&gt; with some HTML5 data-*attributes that are parsed by some JavaScript code on the page. Unfortunately it seems like Planet Venus is pulling them out - is there some configuration setting that could be changed to prevent this? Thanks, Nathan </pre> Nathan Osman 2012-05-08T23:05:33 http://comments.gmane.org/gmane.comp.web.planet.devel/2288 <pre>Hi All, How can I get a RSS feed from venus aggregator? Does it support for a feed by default? If so what is the feed URL. Thanks, Thimuth </pre> Thimuth Amarakoon 2012-04-16T12:04:01 http://comments.gmane.org/gmane.comp.web.planet.devel/2285 <pre>Could someone tell me what these failures mean and how to correct them? Thanks, Robert robert&lt; at &gt;ubuntu:~/venus$ python runtests.py Genshi is not available =&gt; can't test genshi filters Django is not available =&gt; can't test django filters Redland RDF is not available =&gt; can't test FOAF reading lists libxslt is not available =&gt; can't test xslt filters ....................................................................................................................................sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found Fsh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found .sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found Esh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found Fsh: xsltproc: not found sh: xsltproc: not found sh: xsltproc: not found .............................................................................. ====================================================================== ERROR: test_apply_filter (tests.test_apply.ApplyTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/robert/venus/tests/test_apply.py", line 103, in test_apply_filter html = open(os.path.join(workdir, 'index.html')).read() IOError: [Errno 2] No such file or directory: 'tests/work/apply/index.html' ====================================================================== FAIL: test_apply_asf (tests.test_apply.ApplyTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/robert/venus/tests/test_apply.py", line 50, in test_apply_asf self.apply_asf() File "/home/robert/venus/tests/test_apply.py", line 33, in apply_asf self.assertTrue(os.stat(path).st_size &gt; 0, file + ' has size 0') AssertionError: index.html has size 0 ====================================================================== FAIL: test_apply_filter_html (tests.test_apply.ApplyTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/robert/venus/tests/test_apply.py", line 62, in test_apply_filter_html self.apply_asf() File "/home/robert/venus/tests/test_apply.py", line 33, in apply_asf self.assertTrue(os.stat(path).st_size &gt; 0, file + ' has size 0') AssertionError: index.html has size 0 ---------------------------------------------------------------------- Ran 214 tests in 4.572s </pre> Robert Stackhouse 2012-04-14T16:20:19 http://comments.gmane.org/gmane.comp.web.planet.devel/2283 <pre>Hi I've noticed that venus strips the iframe embeds out somehow. How can I disable that? Thanks and best regards, Tamas </pre> Kádár Tamás (KTamas 2012-01-24T22:05:16 http://comments.gmane.org/gmane.comp.web.planet.devel/2279 <pre>Hello, i have my little planet running meanwhile: http://www.dartosphere.org Now I figured out that the posts are bumped to a newer date every time somebody writes a comment. For example, lets say I write my blog post on 02.01.2012. Venus does publish it at the date 02.01.2012. But later, if somebody comments on the post on 06.01.2012, Venus shows it in the 06.01.2012 section. Can I avoid this somehow? I would like to posts show up with the date they are posted, not when they are updated. Thanks in advance, Christian </pre> Christian Grobmeier 2012-01-06T11:49:19 http://comments.gmane.org/gmane.comp.web.planet.devel/2279 <pre>Hello, i have my little planet running meanwhile: http://www.dartosphere.org Now I figured out that the posts are bumped to a newer date every time somebody writes a comment. For example, lets say I write my blog post on 02.01.2012. Venus does publish it at the date 02.01.2012. But later, if somebody comments on the post on 06.01.2012, Venus shows it in the 06.01.2012 section. Can I avoid this somehow? I would like to posts show up with the date they are posted, not when they are updated. Thanks in advance, Christian </pre> Christian Grobmeier 2012-01-06T11:49:19 http://comments.gmane.org/gmane.comp.web.planet.devel/2279 <pre>Hello, i have my little planet running meanwhile: http://www.dartosphere.org Now I figured out that the posts are bumped to a newer date every time somebody writes a comment. For example, lets say I write my blog post on 02.01.2012. Venus does publish it at the date 02.01.2012. But later, if somebody comments on the post on 06.01.2012, Venus shows it in the 06.01.2012 section. Can I avoid this somehow? I would like to posts show up with the date they are posted, not when they are updated. Thanks in advance, Christian </pre> Christian Grobmeier 2012-01-06T11:49:19 http://comments.gmane.org/gmane.comp.web.planet.devel/2278 <pre>Hi, I wanted to use the same template to create three different pages. One with the news of the 5 last days, the second with the news of the 21 last days and the last one with the news of the 90 last days. I did it by copying the template and adding a section : [examples/fancy/index_5j.html.tmpl] days_per_page = 5 [examples/fancy/index_21j.html.tmpl] days_per_page = 21 But, I also wanted a link to the RSS file and to the ATOM file. So, I had to edit each html template to link it to the right file. I would rather had use some variable to do that and keep template untouched. In the config.ini file, you can add variables for channel. You can also configure options for the templates. So I thought there should be a way to add variable for templates. Channel variables are prefixed by "channel_", so in my code, those for template are prefixed by "file_". If there was already a way to do that, please tell me ! Otherwise, I give you the diff. I have to warn you, it is my first code in python. Sincerely yours, Samuel Kay </pre> Samuel Kay 2012-01-02T15:47:05 http://comments.gmane.org/gmane.comp.web.planet.devel/2274 <pre>Hello, I have git-pulled Venus: http://www.intertwingly.net/code/venus/docs/installation.html which is a fork of the planetplanet software, as far as I understood. I runned the tests as mentioned on the website and got this: (uiserver):user:~/test/venus &gt; python runtests.py Genshi is not available =&gt; can't test genshi filters xsltproc is not available =&gt; can't test XSLT templates Django is not available =&gt; can't test django filters libxslt is not available =&gt; can't test xslt filters libxml2 is not available =&gt; can't test xpath_sifter Redland RDF is not available =&gt; can't test FOAF reading lists Ran 207 tests in 4.000s Even when it does not look good for me, are there any chances I get that software running on 1and1? Python is v2.6.6 Cheers Christian </pre> Christian Grobmeier 2011-12-20T13:15:07 http://comments.gmane.org/gmane.comp.web.planet.devel/2272 <pre>Hi, I want to create two alternate views of a planet feed, which display a different number of items per page, so users can view the most recent items quickly (say, items_per_page = 20) or browse back through the last fews weeks' traffic (say, items_per_page = 200). Is there an easy way to do this? It seems like items_per_page is set to apply to all outputs created with that config file, regardless of the incoming template. Is that true? Do I need to create multiple config files? If so, how do I do this without breaking anything else? Also, more generally - directions to documentation would be helpful. Having a hard time just figuring out how the different scripts and files interact with each other. best Shauna </pre> Shauna Gordon-McKeon 2011-12-02T20:37:46 http://comments.gmane.org/gmane.comp.web.planet.devel/2271 <pre>Found the solution: On my linux machine, I ran into the same error running runtests.py TemplateError: Htmltmpl error: IO error while reading template '/web/script/rubys/intertwingly.net/code/venus/themes/classic_fancy/index.html.tmpl': (2) No such file or directory find . | xargs grep '/web/script/rubys/intertwingly.net/code/' -sl pointed me to a file named /themes/classic_fancy/index.html.tmplc It looks like it is some compiled template that shouldn't be in git but accidently got there. Removing the file and rerunning "runtests.py" now gave me "OK" </pre> Milo van der Linden 2011-11-30T20:24:43 http://comments.gmane.org/gmane.comp.web.planet.devel/2269 <pre>Before attempting the install of Planet Venus on OS X - a legacy PPC machine with OS X 10.5, I ran the recommended test: python runtests.py Which failed, with messages such as these - in excerpt: sed is not available =&gt; can't test stripAd_yahoo libxml2 is not available =&gt; can't test xpath_sifter Strange, since sed + libxml2 *are* on my computer. Further I got: ERROR: test_apply_classic_fancy (tests.test_apply.ApplyTest) And: Traceback (most recent call last): ... snip ... TemplateError: Htmltmpl error: IO error while reading template &lt;'/web/script/rubys/intertwingly.net/code/venus/themes/classic_fancy/index.html.tmpl'&gt; : (2) No such file or directory Finally: FAILED (errors=1) Has anyone had better Macintosh luck? E.g on Intel machines and/or later versions of OSX? BTW: I use Mac Ports to install 'unix stuff', which means that e.g. libxml2 goes in to /opt/local - perhaps the test isn't taking that in to account? Leif Halvard Silli </pre> Leif Halvard Silli 2011-11-15T02:30:39 http://comments.gmane.org/gmane.comp.web.planet.devel/2268 <pre>Hi All, I found an error where spider.py was choking when there are non-ascii characters in the entry. I have a commit on github. Please see if this works. I have added a test case for a change this time :-) https://github.com/amit/venus/commit/ac480d4b1abfc831800321f62b2851945a362e2c Here is a pull request if Sam wants to merge this in: https://github.com/rubys/venus/pull/12 Thanks! --Amit </pre> Amit Chakradeo (अमित चक्रदेव 2011-10-04T14:50:13 http://comments.gmane.org/gmane.comp.web.planet.devel/2267 <pre>Hi All, Genentech uses a lot of google apps internally, including gsites. I'd like to aggregate content from several of our gsites' news pages, with URL's as follows: https://sites.google.com/a/gene.com/foo/home/news/posts.xml but planet.py gives an Error 500. My first thought was that it was an http vs https issue. I'm not a python programmer and don't know if whatever http library planet.py uses deals with https. That might be my problem. For now I'm assuming that its not the issue. When I hit the same url with curl it responds 'Not authorized to access this feed'. A bit of googling makes it sounds like the auth that I need to use is google specific. Does anyone have any experience and/or suggestions about working with gsites? Thanks, g. </pre> George Hartzell 2011-09-28T17:32:06 http://comments.gmane.org/gmane.comp.web.planet.devel/2266 <pre>Hi We at KDE have been using rawdog as the planet software to run planetkde.org for a long time now. Recently, we decided that we want to change the way planetkde.org shows the feeds. I plan to implement infinite scrolling in the website, so that older feeds are loaded through AJAX when user scrolls down to the bottom of the page. For this, we need a php or python server script to serve the feed items. I took a good look at all existing planet software to find out which would be best suited to our needs, to modify for the above use case. I think Venus would be well-suited for this. There are two ways i could think of doing this with Venus - 1. Just like the django template, write a custom template that takes all the items and puts them into a database. 2. Use the cache which is already created by venus, instead of storing things into a database. In both cases, I plan to serve the items to the client through a microframework like Flask or Bottle or web.py. Opinions / suggestions? </pre> Tirtha Chatterjee 2011-09-17T20:17:06 http://comments.gmane.org/gmane.comp.web.planet.devel/2265 <pre>*Planet is not discovering index.html.tmpl* ** *INFO:planet.runner:Processing template etc/planet-2.0/eatstowest/index.html.tmpl *Traceback (most recent call last): File "./planet.py", line 167, in &lt;module&gt; main() File "./planet.py", line 163, in main planet_link, planet_feed, owner_name, owner_email) File "/etc/planet-2.0/planet/__init__.py", line 263, in generate_all_files template = manager.prepare(os.path.basename(template_file)) File "/etc/planet-2.0/planet/htmltmpl.py", line 222, in prepare compiled = self.compile(file) File "/etc/planet-2.0/planet/htmltmpl.py", line 296, in compile self._debug).compile(file) File "/etc/planet-2.0/planet/htmltmpl.py", line 987, in compile tokens = self.parse(self.read(file)) File "/etc/planet-2.0/planet/htmltmpl.py", line 1038, in read "(%d) %s" % (filename, errno, errstr) *planet.htmltmpl.TemplateError: Htmltmpl error: IO error while reading template 'index.html.tmpl': (2) No such file or directory* ** ** Why is planet not reading the index template? I stored the file and had the configuration file look for the index template in both the 'basic' subdirectory and in the eatstowest directory for the site with the rest of the configuration files: # template_files: Space-separated list of output template files template_files = etc/planet-2.0/eatstowest/index.html.tmpl etc/planet-2.0/eatstowest/atom.xml.tmpl etc/planet-2.0/eatstowest/rss20.xml.tmpl etc/planet-2.0/eatstowest/rss10.xml.tmpl etc/planet-2.0/eatstowest/opml.xml.tmpl etc/planet-2.0/eatstowest/basic/index.html.tmpl # The following provide defaults for each template: # output_dir: Directory to place output files # items_per_page: How many items to put on each page # days_per_page: How many complete days of posts to put on each page # This is the absolute, hard limit (over the item limit) # date_format: strftime format for the default 'date' template variable # new_date_format: strftime format for the 'new_date' template variable # encoding: output encoding for the file, Python 2.3+ users can use the # special "xml" value to output ASCII with XML character references # locale: locale to use for (e.g.) strings in dates, default is taken from your # system. You can specify more locales separated by ':', planet will # use the first available one output_dir = /var/www/index.html items_per_page = 60 days_per_page = 0 date_format = %B %d, %Y %I:%M %p new_date_format = %B %d, %Y encoding = utf-8 # locale = C A question similar to this was asked and not replied in November 2010. Thanks for any help. </pre> Chris Kepley 2011-08-04T19:47:42 http://comments.gmane.org/gmane.comp.web.planet.devel/2264 <pre> One of my planets needs to aggregate a feed, which has an address containing the &amp; character. Planet seems to be truncating the URL at the &amp; character. Can someone look and see if this is expected behaviour? Is there a work round? I have tried using %26 and \&amp; which cause more dramatic failures. Do toy want to see the run time logs? -- Dave </pre> Dave Levy 2011-07-14T16:52:44 http://comments.gmane.org/gmane.comp.web.planet.devel/2260 <pre>Hi all. Where can I find any documentation about expunging the cache? Thanks, Duarte </pre> Duarte Carreira 2011-07-06T22:12:48 http://comments.gmane.org/gmane.comp.web.planet.devel/2258 <pre>Hello all. Is there any way I can limit the size of the atom.xml file? To a maximum kb size? Thanks, Duarte </pre> Duarte Carreira 2011-07-04T17:47:59 http://comments.gmane.org/gmane.comp.web.planet.devel/2257 <pre>Hi all, I am using planetplanet, thank you for your effort. I am sending you two small patches if you would like to apply them to your code: 1) the first one avoid the following "DeprecationWarning" if you are using python &gt;=2.4 . It uses hashlib module preserving retrocompatibility with older python versions. /usr/local/planet/planet/__init__.py:33: DeprecationWarning: the md5 module is deprecated; use hashlib instead import md5 2) the second one is a workaround (sure not the best way to do it) for avoid errors in parsing feeds like http://gasmatelica.wordpress.com/feed/ in wich we have xml content like: &lt;media:content url="http://0.gravatar.com/avatar/8ca62fecfaf1a5538aa3ee70083cdf11?s=96&amp;#38;d=identicon&amp;#38;r=G" medium="image"&gt; &lt;media:title type="html"&gt;Marco Cingolani&lt;/media:title&gt; &lt;/media:content&gt; &lt;media:content url="http://gasmatelica.files.wordpress.com/2011/05/a4.jpg?w=212" medium="image"&gt; &lt;media:title type="html"&gt;A4&lt;/media:title&gt; &lt;/media:content&gt; that are consideret by parser like &lt;content:encoded&gt; field I hope they would be useful to produce better patches, or to improve your code. Thanks, bye Luca `fero` Ferroni --- planet/__init__.py.orig2011-05-31 16:44:24.859488576 +0200 +++ planet/__init__.py2011-06-03 11:16:07.655810892 +0200 &lt; at &gt;&lt; at &gt; -30,7 +30,16 &lt; at &gt;&lt; at &gt; import os -import md5 +try: + import hashlib +except ImportError: + import md5 + class hashlib(object): + + &lt; at &gt;classmethod + def md5(cls, *args, **kw): + return md5.new(*args, **kw) + import time import dbhash import re &lt; at &gt;&lt; at &gt; -742,10 +751,10 &lt; at &gt;&lt; at &gt; entry_id = cache.utf8(entry.link) elif entry.has_key("title"): entry_id = (self.url + "/" - + md5.new(cache.utf8(entry.title)).hexdigest()) + + hashlib.md5(cache.utf8(entry.title)).hexdigest()) elif entry.has_key("summary"): entry_id = (self.url + "/" - + md5.new(cache.utf8(entry.summary)).hexdigest()) + + hashlib.md5(cache.utf8(entry.summary)).hexdigest()) else: log.error("Unable to find or generate id, entry ignored") continue &lt; at &gt;&lt; at &gt; -838,7 +847,7 &lt; at &gt;&lt; at &gt; self._channel = channel self.id = id_ - self.id_hash = md5.new(id_).hexdigest() + self.id_hash = hashlib.md5(id_).hexdigest() self.date = None self.order = None self.content = None --- planet/__init__.py.orig2011-05-31 16:44:24.859488576 +0200 +++ planet/__init__.py.before_hashlib2011-06-03 11:08:34.852902219 +0200 &lt; at &gt;&lt; at &gt; -880,15 +880,16 &lt; at &gt;&lt; at &gt; # Content field: concatenate the values value = "" for item in entry[key]: - if item.type == 'text/html': - item.value = sanitize.HTML(item.value) - elif item.type == 'text/plain': - item.value = escape(item.value) - if item.has_key('language') and item.language and \ - (not self._channel.has_key('language') or - item.language != self._channel.language) : - self.set_as_string(key + "_language", item.language) - value += cache.utf8(item.value) + if getattr(item, 'type', None): + if item.type == 'text/html': + item.value = sanitize.HTML(item.value) + elif item.type == 'text/plain': + item.value = escape(item.value) + if item.has_key('language') and item.language and \ + (not self._channel.has_key('language') or + item.language != self._channel.language) : + self.set_as_string(key + "_language", item.language) + value += cache.utf8(item.value) self.set_as_string(key, value) elif isinstance(entry[key], (str, unicode)): # String fields </pre> Luca Ferroni 2011-06-03T10:05:37 http://comments.gmane.org/gmane.comp.web.planet.devel/2256 <pre>Good evening, Does any one this list provide Planet Venus installation services or know where I can get someone to install Planet Venus? If so, please get in touch and let me know how much you would charge. Thanks </pre> Daudi Were 2011-05-24T16:26:41 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.web.planet.devel