http://blog.gmane.org/gmane.comp.python.imdbpy hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.python.imdbpy/840 <pre>Hi, Would it be possible to improve imdbpy2sql script so that episodes production_year field contains correct episode year, which is calculated by episode movie_info release date? I am not sure how episode production year is calculated, but it is wrong and incomplete for almost every TV show. Here you can run this select (example House M.D.) and see that production_date differs a lot from real episode production date: SELECT title.id, production_year, (select max(SUBSTRING(info, '([0-9]{4})')::int) from movie_info where movie_id=title.id and info_type_id=16) as real_year FROM title WHERE episode_of_id=(select id from title where title='House M.D.') ORDER BY real_year DESC Right now to fix this after every update i run following SQL script, however it takes few hours to update, so i was wondering maybe this could be fixed in imdbpy2sql. Thanks. PS. Thanks for the gender field. Just tested and it works perfectly! Here is the update function i run after update, if interested: CREATE OR REPLACE FUNCTION episodes_year_update() RETURNS void AS $BODY$ DECLARE m record; r record; year int; year_tmp int; BEGIN FOR m IN select * from title where kind_id=7 -- and episode_of_id=498593 LOOP year := null; FOR r IN SELECT * FROM movie_info WHERE movie_id=m.id and info_type_id=16 LOOP year_tmp := SUBSTRING(r.info, \'([0-9]{4})\')::int; IF (year_tmp NOTNULL AND (year ISNULL OR year_tmp &lt; year)) THEN year := year_tmp; --RAISE NOTICE \'info: %\', r.info; END IF; END LOOP; IF (year NOTNULL and year != m.production_year) THEN UPDATE title SET production_year=year where id=m.id; END IF; END LOOP; return; END; $BODY$ LANGUAGE plpgsql VOLATILE COST 100; darklow. ------------------------------------------------------------------------------ For Developers, A Lot Can Happen In A Second. Boundary is the first to Know...and Tell You. Monitor Your Applications in Ultra-Fine Resolution. Try it FREE! http://p.sf.net/sfu/Boundary-d2dvs2_______________________________________________ Imdbpy-devel mailing list Imdbpy-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f&lt; at &gt;public.gmane.org https://lists.sourceforge.net/lists/listinfo/imdbpy-devel </pre> darklow 2012-04-12T10:03:22 http://comments.gmane.org/gmane.comp.python.imdbpy/833 <pre>Hi, Sometimes there is need to know is actor male or a female. And only way to detect is by looking at cast_info role_id which is very un-handful. I added column sex for name table, however following SQL update runs for a very long time while at import level it would cost almost anything. update name set sex=2 where id in (select person_id from cast_info where role_id=2 group by 1 order by 1) </pre> darklow 2012-03-28T09:52:03 http://comments.gmane.org/gmane.comp.python.imdbpy/828 <pre>one more very small possible improvement I have a generic wrapper to convert all person, movie, company classes into json. Where Movie.data() and the likes would have outputted class data it simply takes the name and id and turns it into a string. How can we best implement JSON output within all of the IMDbPy package (perhaps it is already)?. simple wrapper with tests https://gist.github.com/2187476 ------------------------------------------------------------------------------ This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure_______________________________________________ Imdbpy-devel mailing list Imdbpy-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f&lt; at &gt;public.gmane.org https://lists.sourceforge.net/lists/listinfo/imdbpy-devel </pre> James Rubino 2012-03-24T20:57:56 http://comments.gmane.org/gmane.comp.python.imdbpy/827 <pre>Two new small features in the mercurial/git repository: - "reraiseExceptions" option (can be used programmatically - instancing IMDb - or in the imdbpy.cfg configuration file) to re-raise any caught exceptions. Default to False, could be useful in some circumstances. - "timeout" option (can be used like "reraiseExceptions") to set a timeout in seconds for the http connections. By default I've set it at 30 seconds. Can be disabled entirely setting it to False or None. And an improvement: - better SQL statements for the creation of temporary tables (re)storing imdbIDs... it should work gracefully with postgresql and possibly other databases. As usual, please report any problem and strange behavior: I'm not too sure about the consequences of these changes. :-) </pre> Davide Alberani 2012-03-24T15:34:41 http://comments.gmane.org/gmane.comp.python.imdbpy/825 <pre>Hi there, I'm trying to get IMDbPy 4.8.2 going under a Windows 7 environment. I begun with a completely new Python 2.7.2 environment, with manual installation of lxml from http://www.lfd.uci.edu/~gohlke/pythonlibs/ However, I cannot seem to compile the cutils bit of the sql parser. I have VS2010. I tried setting the VS90COMNTOOLS variable to point to the tools directory but mt.exe bombs with an error that it cannot locate the manifest file. Anyone manage to get this going? Regards, Damien. ------------------------------------------------------------------------------ This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure </pre> Damien 2012-03-23T02:27:34 http://comments.gmane.org/gmane.comp.python.imdbpy/799 <pre>hi, First of all, thank you for imdbpy. This is really plug'n play, well done !!! Context : - Import all imdb database (from text dumps) - first time it's fast and ok - I have the imdb ids for 90% of titles and names (no need for companies and characters) - I'll pay imdb for using those datas (I need to control the datas instead of using their own api) My problem comes when imdbpy updates my database. It takes hours to save the imdb ids and it consumes a *lot* of memory. Almost all of my RAM (24go) ... Is there a way to optimize that step ? Why does it takes so much memory ? I can help you with this if you don't have much time, I'm python dev but I need input :) Cheers, - Emmanuel PS : Sorry about my first non-member thread, wrong email ... ------------------------------------------------------------------------------ Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d </pre> Emmanuel Tabard 2012-01-26T14:32:27 http://comments.gmane.org/gmane.comp.python.imdbpy/797 <pre>Hi all, I've just released the long-awaited IMDbPY 4.8, with too many bug fixes to mention. Pardon for the slowdown in the development; I'm sure there are still many bugs and I'd like to see some fixes to some core pieces of code (after more than 7 years and almost 50 releases, it's probably a good idea to rewrite a function or two ;-) So, if anyone wants to help, let us know! With this release, we also have a shiny new web site, courtesy of Alberto Malagoli who kindly joined the development team (thanks and welcome aboard, Alberto!) As usual, you can download IMDbPY from: http://imdbpy.sf.net/ Enjoy! </pre> Davide Alberani 2011-11-01T13:54:58 http://comments.gmane.org/gmane.comp.python.imdbpy/796 <pre>Hi Is it possible to get the awards list for all movies into a local database? ------------------------------------------------------------------------------ EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev_______________________________________________ Imdbpy-devel mailing list Imdbpy-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f&lt; at &gt;public.gmane.org https://lists.sourceforge.net/lists/listinfo/imdbpy-devel </pre> satyam mukherjee 2011-08-25T22:12:10 http://comments.gmane.org/gmane.comp.python.imdbpy/794 <pre>Are there somewhere Production Status in the imdbpy database, like "In Production", "Planning", "In Development" and so on for the upcoming movies? Maybe i missed some .csv datafiles, but i can't find any in my DB. Thank you. ------------------------------------------------------------------------------ Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 </pre> darklow 2011-08-23T11:49:43 http://comments.gmane.org/gmane.comp.python.imdbpy/791 <pre>Hello, I am trying to write some Ubuntu Unity lens using IMDBPy. For this purpose, I need only genre information. I took a look at the code and did not find any get_movie_genre kinda function. So currently, I am using ia.update(x,"main") . Is there anyway to just the genre information? Thanks for developing this wonderful program ! Regards, Saravanan ------------------------------------------------------------------------------ Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey </pre> Saravanan 2011-07-31T07:58:45 http://comments.gmane.org/gmane.comp.python.imdbpy/784 <pre>Is there a way to only get some data with ia.update to speed up things? I just need votes and rating. ------------------------------------------------------------------------------ vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 </pre> LinuxUser 2011-05-26T21:05:30 http://comments.gmane.org/gmane.comp.python.imdbpy/779 <pre>http://pastebin.com/XLmiYbFW --------------------------- Traceback (most recent call last): File "/usr/lib/pymodules/python2.6/supybot/callbacks.py", line 1180, in _callCommand self.callCommand(command, irc, msg, *args, **kwargs) File "/usr/lib/pymodules/python2.6/supybot/utils/python.py", line 86, in g f(self, *args, **kwargs) File "/usr/lib/pymodules/python2.6/supybot/callbacks.py", line 1166, in callCommand method(irc, msg, *args, **kwargs) File "/usr/lib/pymodules/python2.6/supybot/commands.py", line 913, in newf f(self, irc, msg, args, *state.args, **state.kwargs) File "/home/bash/Download/Supybot-0.83.4.1/plugins/Supybot-imdb/ plugin.py", line 81, in imdb ia = imdb.IMDb() AttributeError: 'module' object has no attribute 'IMDb' ---------------- I googled it and a bunch of people said to raname the py file but that obviously isn't the prob. IDK where else to turn so I'm posting it here. ------------------------------------------------------------------------------ WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd </pre> LinuxUser 2011-05-09T10:00:58 http://comments.gmane.org/gmane.comp.python.imdbpy/775 <pre>Hi, I'm having some trouble with importing the text files with imdbpy2sql. I'm running Debian with python 2.6.6-8+b1, postgresql 9.0.3-1 and imdbpy 4.7.0-1. I created a database called imdb in the usual way. Debian puts imdbpy2sql in /usr/share/doc/python-imdbpy/examples/imdbpy2sql.py.gz. I usually extract it and put it in /tmp/imdbpy2sql. I ran this: $ /tmp/imdbpy2sql.py -d ~/imdb/lists -u postgres:///var/run/postgresql/imdb It starts processing as normal. However at some point in the middle of the actors, psycopg2 thows a DataError. * FLUSHING SQLData... SCANNING actor: Hartley, Jalaal SCANNING actor: Harwood, Anthony (II) * FLUSHING PersonsCache... * FLUSHING SQLData... SCANNING actor: Hatcher, Steve SCANNING actor: Havers, Nigel * FLUSHING SQLData... SCANNING actor: Hayden, Luke * FLUSHING CharactersCache... Traceback (most recent call last): File "/tmp/imdbpy2sql.py", line 2950, in &lt;module&gt; run() File "/tmp/imdbpy2sql.py", line 2811, in run castLists(_charIDsList=characters_imdbIDs) File "/tmp/imdbpy2sql.py", line 1575, in castLists doCast(f, roleid, rolename) File "/tmp/imdbpy2sql.py", line 1534, in doCast cid = CACHE_CID.addUnique(role) File "/tmp/imdbpy2sql.py", line 957, in addUnique else: return self.add(key, miscData) File "/tmp/imdbpy2sql.py", line 950, in add self[key] = c File "/tmp/imdbpy2sql.py", line 860, in __setitem__ self.flush() File "/tmp/imdbpy2sql.py", line 883, in flush self._toDB(quiet) File "/tmp/imdbpy2sql.py", line 1185, in _toDB CURS.executemany(self.sqlstr, self.converter(l)) psycopg2.DataError: invalid byte sequence for encoding "UTF8": 0xc320 When I run /usr/share/doc/python-imdbpy/goodies/reduce.sh to get the data size down a little the whole import works fine. So I'm guessing there are some stray characters in the text somewhere that are not being decoded properly to unicode, but I have no idea where to try to fix it. Regards -- Tom ------------------------------------------------------------------------------ Xperia(TM) PLAY It's a major breakthrough. An authentic gaming smartphone on the nation's most reliable network. And it wants your games. http://p.sf.net/sfu/verizon-sfdev </pre> Thomas Stewart 2011-04-10T21:25:19 http://comments.gmane.org/gmane.comp.python.imdbpy/772 <pre>Released after a long delay, and despite that in a hurry, IMDbPY 4.7 can be found here: http://imdbpy.sf.net/ This is a transitional release, after the recent redesign of the IMDb pages. A new account is used and the new pages are parsed; for sure there are still many bugs; please read the README.redesign file for other details. Please contribute to the development with fixes and bug reports. Enjoy! </pre> Davide Alberani 2011-01-23T15:12:33 http://comments.gmane.org/gmane.comp.python.imdbpy/767 <pre>Hello, What is the position of the imdbpy developers on the new trend in iMDB Data Access: the iOS JSON Service at http://app.imdb.com As you probably know, the service provides nice, easily parseable JSON replies when queried. For example: http://app.imdb.com/find?api=v1&amp;appid=iphone1&amp;locale=en_US&amp;q=shrek This is all explained in the XBMC thread http://forum.xbmc.org/showthread.php?t=64004 Are you guys considering migrating the parsers to use this service? It surely seems like a very easy approach with much less development effort than the current scraping efforts. ------------------------------------------------------------------------------ Increase Visibility of Your 3D Game App &amp; Earn a Chance To Win $500! Tap into the largest installed PC base &amp; get more eyes on your game by optimizing for Intel(R) Graphics Technology. Get started today with the Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs. http://p.sf.net/sfu/intelisp-dev2dev </pre> Albert Claret 2010-11-22T19:28:28 http://comments.gmane.org/gmane.comp.python.imdbpy/766 <pre>Hi all, I've just pulled into the 'imdbpy' Mercurial repository some changes made in the 'imdbpy_parsers2010' repository. Some things will work now, other are still to be done. Persons' biographies work, and so most of the other information. The 'httpThin' parsers broken, and I have no plan to fix it (it was never really useful: let's consider it gone). I'm not too sure about the parsers for Characters and Companies, but they seem to be ok. The development will continue in the 'imdbpy_parsers2010': I plan to work on the 'mobile' parsers. As usual, any help is welcome. </pre> Davide Alberani 2010-11-13T16:11:29 http://comments.gmane.org/gmane.comp.python.imdbpy/764 <pre>Hello All, I hope the rewrites are going well, if there is any menial work that could be done let me know. I don;t know if I have a good concept of the internals to start rewriting anything for the current tasks at hand. I keep on experiencing an error when setting up the text files on a MySQL db. It seems to want to load 100000 movies in at a time. Any ideas? * FLUSHING MoviesCache... SCANNING movies: Celebration (1981) (TV) (movieID: 100001) SCANNING movies: City of Wax (1934) (movieID: 110001) SCANNING movies: Covjek ispod stola (2009) (movieID: 120001) SCANNING movies: Dark Spirits (2008) (movieID: 130001) SCANNING movies: Depth Solitude (1997) (movieID: 140001) SCANNING movies: Die Huronen (1921) (movieID: 150001) SCANNING movies: Dorothy Stratten: The Untold Story (1985) (V) (movieID: 160001) SCANNING movies: Eichmann Trial (1961) (TV) (movieID: 170001) SCANNING movies: Employee Dang (2003) (movieID: 180001) SCANNING movies: Ezra's Epitaph (2006) (V) (movieID: 190001) * FLUSHING MoviesCache... * TOO MANY DATA (100000 items in MoviesCache), recursion: 1 * SPLITTING (run 1 of 2), recursion: 1 * FLUSHING MoviesCache... Traceback (most recent call last): File "C:\python26\scripts\imdbpy2sql.py", line 5, in &lt;module&gt; pkg_resources.run_script('imdbpy==4.5.1', 'imdbpy2sql.py') File "C:\Python26\lib\site-packages\pkg_resources.py", line 489, in run_script self.require(requires)[0].run_script(script_name, ns) File "C:\Python26\lib\site-packages\pkg_resources.py", line 1207, in run_scrip t execfile(script_filename, namespace, namespace) File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 2911, in &lt;module&gt; run() File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 2747, in run readMovieList() File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 1460, in readMovieList mid = CACHE_MID.addUnique(title, yearData) File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 1068, in addUnique else: return self.add(key, miscData) File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 947, in add self[key] = c File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 857, in __setitem__ self.flush() File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 909, in flush self.flush(quiet=quiet, _recursionLevel=_recursionLevel) File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 880, in flush self._toDB(quiet) File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 1052, in _toDB self._runCommand(l) File "c:\python26\lib\site-packages\imdbpy-4.5.1-py2.6-win32.egg\EGG-INFO\scri pts\imdbpy2sql.py", line 1056, in _runCommand CURS.executemany(self.sqlstr, self.converter(dataList)) File "C:\Python26\lib\site-packages\MySQLdb\cursors.py", line 205, in executem any r = r + self.execute(query, a) File "C:\Python26\lib\site-packages\MySQLdb\cursors.py", line 173, in execute self.errorhandler(self, exc, value) File "C:\Python26\lib\site-packages\MySQLdb\connections.py", line 36, in defau lterrorhandler raise errorclass, errorvalue _mysql_exceptions.IntegrityError: (1062, "Duplicate entry '143880' for key 'PRIM ARY'") JRubino ------------------------------------------------------------------------------ Achieve Improved Network Security with IP and DNS Reputation. Defend against bad network traffic, including botnets, malware, phishing sites, and compromised hosts - saving your company time, money, and embarrassment. Learn More! http://p.sf.net/sfu/hpdev2dev-nov_______________________________________________ Imdbpy-devel mailing list Imdbpy-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f&lt; at &gt;public.gmane.org https://lists.sourceforge.net/lists/listinfo/imdbpy-devel </pre> James Rubino 2010-11-03T09:18:40 http://comments.gmane.org/gmane.comp.python.imdbpy/757 <pre>hello with the http access module and the 4.6 release i've observed the problem that IMDbPY doesn't return a plot for *some* movies. e.g. get_movie.py 1160368 =&gt; no plot but get_movie.py 0133093 =&gt; plot anyone else noticed this? thanks, julian ------------------------------------------------------------------------------ This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd </pre> Julian Mayer 2010-09-06T16:57:39 http://comments.gmane.org/gmane.comp.python.imdbpy/754 <pre>Hi, i am wondering whether there are plans to integrate with twisted (http://twistedmatrix.com). Could not find anything on the website or in the source. Regards, Johannes Scholz ------------------------------------------------------------------------------ The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm </pre> Johannes Scholz 2010-07-30T13:53:30 http://comments.gmane.org/gmane.comp.python.imdbpy/752 <pre>------------------------------------------------------------------------------ The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://ad.doubleclick.net/clk;226879339;13503038;l? http://clk.atdmt.com/CRS/go/247765532/direct/01/_______________________________________________ Imdbpy-devel mailing list Imdbpy-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f&lt; at &gt;public.gmane.org https://lists.sourceforge.net/lists/listinfo/imdbpy-devel </pre> belgabortm 2010-07-25T21:58:30 http://comments.gmane.org/gmane.comp.python.imdbpy/748 <pre>------------------------------------------------------------------------------ ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo_______________________________________________ Imdbpy-devel mailing list Imdbpy-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f&lt; at &gt;public.gmane.org https://lists.sourceforge.net/lists/listinfo/imdbpy-devel </pre> Robert Bischoff 2010-06-08T21:42:52 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.python.imdbpy