gmane.comp.python.imdbpy.user

help running imdbpy2sql

Brian Abelson — 2012-05-24T21:14:45

Hi,

I am an unexperienced programmer trying to run imdppy2sql.py in order to
create a local sql database of imdb's data. Thus far, here is what I have
done:

1. Downloaded all the plain text files from imdb into a single directory:
"/Users/TPF/Desktop/imdb/"
2. Downloaded Mamp and created a mysql database called "imdb"
3. Downloaded the latest version of sql object by typing "svn co
http://svn.colorstudy.com/sqlobject/trunk SQLobject into the command line
4. Downloaded the stable version of IMDbPY - 4.8.2
5. Navigated to the IMDbPY folder by typing
"cd /Users/TPF/Desktop/IMDbPY-4.8.2" into the command line.
6. Entered this into the command line to execute the script:
"python bin/imdbpy2sql.py -d /Users/TPF/Desktop/imdb/ -u
mysql://root:root< at >localhost:8889/imdb"

However, this seems to continually return this error:

"Traceback (most recent call last):
File "bin/imdbpy2sql.py", line 34, in <module>
from imdb.parser.sql.dbschema import *
ImportError: No module named imdb.parser.sql.dbschema"

Yet, when I navigate to this folder, I see the script "dbschema.py" in the
correct location. I have searched on the internet and suspect that the
problem may have to do with my version of SQLobject, Python (2.6.1), or my
OS (Mac OSX 10.6.8). However, due to my lack of experience, I am not sure
how best to redress these issues or where to start first. Can somebody
please help walk me through this? I'd be more than willing to compensate
you for your time.

All the best,

Brian Abelson
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

imdbpy2sql.py problem on Ubuntu 12.04

Eric Lange — 2012-05-21T02:06:18

Hello,

Has anyone tried running imdbpy2sql.py on Ubuntu 12.04?  It was working
fine under 11.10, but now when I run it, it hangs on FLUSHING MoviesCache:

eric< at >eric-ubuntu:~/imdb$ ./imdbpy2sql.py -d ./compressed -u
mysql://root:xxxxxx< at >localhost/imdb

NOTICE: IF you're using InnoDB tables, data insertion can
be very slow; you can switch to MyISAM tables - forcing it
with the --mysql-force-myisam option - OR use the
--mysql-innodb command line option, but DON'T USE these if
you're already working on MyISAM tables, because it will
force MySQL to use InnoDB, and performances will be poor.

IMPORTING psyco... FAILED (not a big deal, everything is alright...)

RUNNING imdbpy2sql.py using the sqlobject ORM
SAVING imdbID values for movies... DONE! (0 entries)
SAVING imdbID values for people... DONE! (0 entries)
SAVING imdbID values for characters... DONE! (0 entries)
SAVING imdbID values for companies... DONE! (0 entries)
DROPPING current database... DONE!
CREATING new tables... DONE!
# TIME dropping and recreating the database : 0min, 14sec (wall) 0min, 0sec
(user) 0min, 0sec (system)
SCANNING movies: !Women Art Revolution (2010) (movieID: 1)
SCANNING movies: "31 minutos" (2003) {Benjamín Listillo (#1.4)} (movieID:
10001)
SCANNING movies: "A Favorita" (2008) {(#1.81)} (movieID: 20001)
SCANNING movies: "Access Hollywood Live" (2010) {(2011-05-10)} (movieID:
30001)
SCANNING movies: "Ajuste de Contas" (2000) {(#1.122)} (movieID: 40001)
SCANNING movies: "All Saints" (1998) {What Lies Beneath (#10.8)} (movieID:
50001)
SCANNING movies: "America's Next Top Model" (2003) {The Girl Who Forgot Her
Shoes (#3.7)} (movieID: 60001)
SCANNING movies: "Animal Crackers" (1988) (movieID: 70001)
SCANNING movies: "Aquí hay tomate" (2003) {(2006-08-09)} (movieID: 80001)
SCANNING movies: "Ask That Guy with the Glasses" (2008) {(#3.9)} (movieID:
90001)
 * FLUSHING MoviesCache...

And then just stays there indefinitely.  I have tried it with both mysql
5.5 and postgresql 9.1 and have the same problem with both.  I tried using
the -c option (-c /var/tmp) but it will generate the CSVs fine, but then
fail to write them to the db (for different reasons in both mysql and
postgresql -- some issue with not being supported or needing to be
superuser).  I also tried downgrading to python 2.6, but ran into problems
doing that.

Anyone done this successfully?

Thanks,
Eric
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

imdbpy2slq

gg4u — 2012-05-07T10:25:42

Hi,
trying to run script imdbpy2sql, I got these issues (see below).
Mysqldb has been installed from site MySQL-python-1.2.3
and built like written in its readme file:


Issues I have (running python 2.7 preinstalled on Macbook pro)
thank you for helping me! I am total new in python, scripting and unix 


Traceback (most recent call last):



------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Want to create xml files for every type of supported imdbpy object from mysql database

Benjamin — 2012-04-27T22:48:45

Hello,

First of all, thanks to the devs for putting together a really nice api.
I'm new to imdbpy and python so I thought I'd throw my question at the list
and see what happens ;)

I've followed the instructions and populated a mysql db w/ the info from the
imdb flat files.
I want to output from this db an xml file for every single imdbpy object
type(Movie, Person, etc.).
Is there a way to do this?

Thanks!

-Ben


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

SQL Server Express 2008 R2 - Connection Error

Damien — 2012-03-26T07:25:06

Hi there,

After running into some issues compiling from source - bumping up against the --
mno-cygwin issue using the latest MinGW release! :( - I reverted back to using 
Python 32 bit 2.7.2 environment, with the precompiled IMDbPy binary.

Using Pip, here's what I have:

c:\Python27\Scripts>pip freeze
Cython==0.15.1
FormEncode==1.2.4
IMDbPY==4.8.2
MySQL-python==1.2.3
SQLAlchemy==0.7.6
SQLObject==1.2.2
distribute==0.6.24
lxml==2.3.3
pymssql==2.0.0b1

This is under Windows 7. Each of the above was installed from a binary package. 
Now with this setup, I can dump the entire IMDb to MySQL using:

python27 imdbpy2sql.py -d d:/install/imdb/subset/ -u 
"mysql://root:mysql< at >localhost/imdb" --mysql-force-myisam

Which works great. However, now I'd like to get the same info into SQL Server 
Express 2008 R2. I have created an imdb user/login for SQL Server.

Yet when I execute:

c:\Python27\Scripts>python27 imdbpy2sql.py -d d:/install/imdb/subset/ -u "mssql:
//imdb:imdb< at >localhost/imdb" --ms-sqlserver

I get:

Traceback (most recent call last):
  File "imdbpy2sql.py", line 519, in <module>
    connectObject = conn.getConnection()
  File "C:\Python27\lib\site-packages\sqlobject\dbconnection.py", line 336, in g
etConnection
    conn = self.makeConnection()
  File "C:\Python27\lib\site-packages\sqlobject\mssql\mssqlconnection.py", line
94, in makeConnection
    con = self.dbconnection( *self.make_conn_str(self) )
  File "pymssql.pyx", line 552, in pymssql.connect (pymssql.c:7162)
pymssql.InterfaceError: Connection to the database failed for an unknown reason.

Any ideas?

Regards,

Damien.


------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure

Episode information of not available

David Kaufman — 2012-03-24T13:44:13

Hi there,

I was looking if I could retreive episode information through imdbpy,
but was unable to do so:

I executed following code which can be found here:
http://imdbpy.sourceforge.net/docs/README.series.txt

  from imdb import IMDb
  i = IMDb()
  m = i.get_movie('0389564')  # The 4400.
  m['kind']    # kind is 'tv series'.
  i.update(m, 'episodes')   # retrieves episodes information.

 Whenever I call:
 m['episodes']

I get following error message:

...\imdb\utils.pyc in __getitem__(self, key)
   1431         # Handle key aliases.

   1432         key = self.keys_alias.get(key, key)
-> 1433         rawData = self.data[key]
   1434         if key in self.keys_tomodify and \
   1435                 self.modFunct not in (None, modNull):

KeyError: 'episodes'


I'm I doing something wrong? I currently using IMDbPY 4.8.2 2011-11-01
with Python 2.7.2 32 Bit.

It would be very nice if someone could help me here or at least see if
you also get the error.

Greetings,
David

------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure

timing out

Tomáš Hnyk — 2012-03-21T21:31:02

Hello all,
so let's say I am trying to get movie's info:
movie = imdb.IMDb().get_movie('FilmID')
but it times out - i.e. something goes wrong and the movie's info is not
retrieved. Ideally, I would like to do something like:
try:
      movie = imdb.IMDb().get_movie('FilmID')
except imdb.IMDbDataAccessError:
      # tell me it times out and do something about it
But it seems imdb.IMDb().get_movie() does not give exceptions when it
times out. (It sometimes is not succesful in retrieving movies info but is
suspiciously silent about it).

Am I doing something wrong?
Regards,
Tomas

------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure

install fails

Jan Behrendt — 2012-03-18T17:50:24

Hi all! I've a problem with the installation. Could you help me please?

<imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org>root< at >ubuntu:/home/ubuntu/imdbpy/IMDbPY-4.8.2#
python ./setup.py
/usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution
option: 'zip_safe'
  warnings.warn(msg)

Ubuntu 12.04 LTS


Thank you

Jan Behrendt
------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

lm (list movies): please update description and link

2012-03-16T08:13:40

Almost 2 years ago, Goffi went here to present the first version of
this script (http://groups.google.com/group/imdbpy-users/browse_thread/
thread/4392e5058241e59d). I am now continuing the development.

lm is displayed on your page of programs using imdbpy. Is it possible
to update links and description with new information provided below?

***************************
*lm* is a command-line tool which lists movies, loosely inspired from
ls. Extra features allow you to download subtitles, and interact with
the opensubtitles hash database. *lm* is not english oriented, and is
able to provide information for all movie files.

For a more detailed description with examples please visit my blog
(english version)
http://redrises.blogspot.com/2012/02/lm-list-movies-command-line-tool-lm_01.html

Sources:
https://github.com/RedRise/lm
***************************

Best regards,
Red Rise


------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure

Problem with

J. K. — 2012-02-28T23:34:58

Hello,

I have a problem with an installation on gentoo system.

I Installed with 4 different methods and have the same problem.

Let me describe the methods:

1. Gentoo packages
2. easy_install
3. pip
4. Source compile from sourceforge

I am using this for python and i get these errors

from imdb import IMDb
   import imdb.helpers

Nothing of the above imports work. It seems like the IMDb module is
missing.

Eg if i do import imdb or from imdb  import * i cant use the ia = IMDb()
with an error of module not found
------------------------------------------------------------------------------
Virtualization & Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing 
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

helpers functions to handle AKA titles

Davide Alberani — 2012-02-25T14:55:01

Hi all,
we're introducing some functions, in the imdb.helpers module, to play a
little with titles AKAs (most of the code is a work of Alberto Malagoli;
refactoring, bugs and misuses of the original idea are mine).

The functions:
# akasLanguages(movie)
Returns  a list of tuples in (lang, AKA) format; lang can be None, if
unable to guess.


# sortAKAsBySimilarity(movie, title, _titlesOnly=True, _preferredLang=None)
Return a list of AKAs for the movie (a Movie instance), sorted on
similarity with
the given title (a string).  This is useful to get most similar title
to the one you
searched, for example.
If _preferredLang is given, titles in that languages are preferred.
If _titlesOnly is False, the returned values is no longer a list of
titles (unicode strings),
but a list of (score, title, language) tuples.


# getAKAsInLanguage(movie, lang, _searchedTitle=None)
Return all AKAs of the movie object, for the given language.
If _searchedTitle is given, the results are sorted based on their
similarity to it.


Notice that "language" is the English, capitalized, representation of
the language.
So "English", "Italian", "Turkish" and so on, as defined in the LANG_COUNTRIES
of the 'imdb.linguistics' modules (I've renamed the 'imdb.articles' module).


If you have ideas for improvements, bug reports and so on, let us know!

IMDB database creation

Márton Szabó — 2012-02-15T14:39:16

Hello Guys,

First of all thanks for IMDbPY it works great.
I have a question though and it may not be related as close to IMDbPY as it should be to use this mailing list, but I just can get over it.

I wanted to play with the IMDB UNIX search programs, that can be found here: http://www.imdb.com/interfaces
I was able to compile the programs, but I couldn't create the databases.
Lots of .list files failed to convert to .data/.names/.titles files with error codes like these:

/usr/local/moviedb-3.24/etc/mkdb -movie
Adding Movies List...
make[3]: *** [movies.data] Bus error

/usr/local/moviedb-3.24/etc/mkdb -acr
Adding Actors...
mkdb: too many titles -- increase MAXTITLES
make[3]: *** [actors.data] Error 255

/usr/local/moviedb-3.24/etc/mkdb -acs
Adding Actresses...
make[3]: *** [actresses.data] Segmentation fault
make[3]: *** Deleting file `actresses.data'

I thought this can be traced back to the stack size limit on mac os x, which is limited by default and can be maxed to only 64MB.
So, I tried on Ubuntu setting the stack size to unlimited, but I ran into the same problem. Tried other forums for advice, but didn't succeed.

Do you guys have any idea how to create these databases?

Thanks!

Regards,
Márton------------------------------------------------------------------------------
Virtualization & Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Adding foreign keys fail with postgresql database

2011-12-14T16:20:55

Hi,

  At the end of imdbpy2sql.py script, i get this error:

# TIME TOTAL TIME TO INSERT/WRITE DATA : 253min, 55sec (wall) 93min, 
7sec (user) 15min, 0sec (system)
building database indexes (this may take a while)
# TIME createIndexes() : 26min, 33sec (wall) 0min, 0sec (user) 0min, 
0sec (system)
adding foreign keys (this may take a while)
Traceback (most recent call last):
   File "/usr/bin/imdbpy2sql.py", line 5, in <module>
     pkg_resources.run_script('IMDbPY==4.8.2', 'imdbpy2sql.py')
   File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 500, 
in run_script
     self.require(requires)[0].run_script(script_name, ns)
   File "/usr/lib64/python2.6/site-packages/pkg_resources.py", line 
1236, in run_script
     execfile(script_filename, namespace, namespace)
   File 
"/usr/lib64/python2.6/site-packages/IMDbPY-4.8.2-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py", 
line 2958, in <module>
     run()
   File 
"/usr/lib64/python2.6/site-packages/IMDbPY-4.8.2-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py", 
line 2910, in run
     buildIndexesAndFK()
   File 
"/usr/lib64/python2.6/site-packages/IMDbPY-4.8.2-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py", 
line 2722, in buildIndexesAndFK
     createForeignKeys(DB_TABLES)
   File 
"/usr/lib64/python2.6/site-packages/IMDbPY-4.8.2-py2.6-linux-x86_64.egg/imdb/parser/sql/dbschema.py", 
line 460, in createForeignKeys
     table.addForeignKeys(mapTables, ifNotExists)
   File 
"/usr/lib64/python2.6/site-packages/IMDbPY-4.8.2-py2.6-linux-x86_64.egg/imdb/parser/sql/objectadapter.py", 
line 133, in addForeignKeys
     newcls._connection.query(fkQuery)
   File "/usr/lib64/python2.6/site-packages/sqlobject/dbconnection.py", 
line 414, in query
     return self._runWithConnection(self._query, s)
   File "/usr/lib64/python2.6/site-packages/sqlobject/dbconnection.py", 
line 327, in _runWithConnection
     val = meth(conn, *args)
   File "/usr/lib64/python2.6/site-packages/sqlobject/dbconnection.py", 
line 411, in _query
     self._executeRetry(conn, conn.cursor(), s)
   File "/usr/lib64/python2.6/site-packages/sqlobject/dbconnection.py", 
line 406, in _executeRetry
     return cursor.execute(query)
psycopg2.IntegrityError: insert or update on table "movie_info" violates 
foreign key constraint "movie_id_exists"
DETAIL:  Key (movie_id)=(2077921) is not present in table "title".


When i look in movie_info table for id 2077921, i have this:
id;    movie_id;    info_type;    info;    note
"2077921";1559911;96;"Hallo - Sie haben Ihre Frau vergessen. In: 
Illustrierte Film-Bühne, Film-Bühne G.m.b.H., No. 310, 1949, Pgs. 4";""

In table title, i have no line with id=2077921 but i have a line with id 
=1559911 (the number from movie_info's movie_id. The line seems to match :)
"1559911";"Hallo - Sie haben Ihre Frau 
vergessen";"";1;1949;;"H4215";;;;"";"8500761c703695245a02335ec6e4e139"

The data files were downloaded on december 13th and i use imdbpy 4.8.2.
If you need any more informations, i can provide them



------------------------------------------------------------------------------
Cloud Computing - Latest Buzzword or a Glimpse of the Future?
This paper surveys cloud computing today: What are the benefits? 
Why are businesses embracing it? What are its payoffs and pitfalls?
http://www.accelacomm.com/jaw/sdnl/114/51425149/

imdbpy2sql - some movies are missing nr_order for thecast

darklow — 2011-12-13T08:26:51

Hi,

Just noticed that some movies are missing nr_order for the cast.

For example: Titles: *Snow White and the Huntsman* (2012) and *Ceremony*(2010)

select * from cast_info where movie_id=(select id from title where
title='Snow White and the Huntsman');
NR_ORDER column is <NULL> for every cast_info entry beside one, which has
value *19*
http://www.imdb.com/title/tt1735898/

select * from cast_info where movie_id=(select id from title where
title='Ceremony' and kind_id=1 and production_year=2010);
NR_ORDER column is <NULL> for every cast_info entry beside one, which has
value *0
*http://www.imdb.com/title/tt1341341/

It looks like there is something wrong, becaouse i have never seen so much *
nr_order* missing before


I am using latest dev version of imdbpy2sql (IMDbPY==4.9dev-20111124)
(PostgreSQL)
Data files date: 24.Nov.2011

I just ran update with newest datafiles (09.Dec.2011)
I'll notice as soon as it ends if there will be any changes.

Maybe you already have some ideas what could went wrong?
Thanks.
------------------------------------------------------------------------------
Systems Optimization Self Assessment
Improve efficiency and utilization of IT resources. Drive out cost and 
improve service delivery. Take 5 minutes to use this Systems Optimization 
Self Assessment. http://www.accelacomm.com/jaw/sdnl/114/51450054/_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Error returned when running imdbpy2sql.py with MySQLdatabase

Cody Bohn — 2011-11-19T19:17:26

I am getting this issue when I run imdbpy2sql.py with the proper arguments
with a mysql scheme and I can't seem to figure out the issue. I posted on Stack
Overflow<http://stackoverflow.com/questions/8177402/error-returned-when-running-imdbpy2sql-py-with-mysql-database>but
I only managed to resolve part of the problem and this is what
remains.

The following is the output:

Traceback (most recent call last):
  File "/usr/local/bin/imdbpy2sql.py", line 4, in <module>
    import pkg_resources
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2672, in
<module>
    working_set.require(__requires__)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 654, in
require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 552, in
resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: decorator

Does anyone happen to know what is happening and/or have a solution to the
issue?
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Retrieving actor info set from Person

Nicholas Cafarchio — 2011-11-17T06:10:31

Let me first preface this question by stating that I really don't know a whole lot of Python: in fact, all I know of the language I learned from playing around with IMDbPY. Therefore, you'll have to dumb your responses down a bit *sheepish smile*

Ok, into the meat of the question:

I'm attempting to create a script that lets you find the "connections" between two actors (i.e. through movies and actors they have worked with, how are they connected, 6 Degrees of Kevin Bacon?). Retrieving the information is easy enough, but the logic that looks for the connections is slightly more complicated than I can handle in Python, so, being a Java programmer, I decided to use Jython. Here's where I run in to some issues, and I'm fairly confused to say the least.

1. I can correctly import the imdb package into my program (I'm using the Python Interpreter method of Jython if you're at all familiar with it. It goes something like this, fairly simple to understand.)

PythonInterpreter pi = new PythonInterpreter();
pi.exec("import imdb");
pi.exec("i = imdb.IMDb(accessSystem=\'mobile\')");

Basically, you just feed the Python commands to the PythonInterpreter object as strings.

2. I'm using the mobile access system. Part of this is for speed, part of it is lxml issues, more on this in a bit.
3. Using search_person, I can successfully retrieve a Person (i.e. pi.exec("bacon = i.search_person(\"Kevin Bacon\")[0]");
4. calling .keys() on this Person gives you what you would expect by default

Here's where things get interesting:

5a. When I call i.update(bacon) in the interactive python shell, the 'actor' info set is now listed as an info set of bacon
5b. When I call pi.exec("i.update(bacon)"); inside my Jython script, about 1/4 of the info sets that should be returned do not show up when you call .keys(), 'actor' being one of them.
6b. Using http instead of mobile in my Jython script gets me some of the info sets, but still not 'actor'. 
7b. Even though I import sys and append the path to lxml to path, the script always falls back to beautifulsoup, and it takes forever. This doesn't happen in the interactive shell.

So, now that the background is out of the way, does anyone know why I'm getting different results in the shell and the script? Better yet, does anyone know how to fix it? If someone can help me fix the lxml thing, that would be helpful, but it's not a primary concern.

Thanks in advance,

Nick Cafarchio 
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d

imdbpy2sql: KeyError: md5sum

Frederik Vaassen — 2011-11-15T15:33:52

Hi,

I'm attempting to transform the IMDb text files (acquired from one of
the mirrors today) into a mySQL database using imdbpy2sql (the latest
version from Mercurial). Something goes wrong, though, and my knowledge
of Python/MySQL isn't sufficient to find out what the cause of the error
is. Any pointers? Here's the error message, which I get right after
trying to execute the Python script.

---
NOTICE: IF you're using InnoDB tables, data insertion can
be very slow; you can switch to MyISAM tables - forcing it
with the --mysql-force-myisam option - OR use the
--mysql-innodb command line option, but DON'T USE these if
you're already working on MyISAM tables, because it will
force MySQL to use InnoDB, and performances will be poor.

Traceback (most recent call last):
  File "imdbpy2sql.py", line 1675, in <module>
    CACHE_MID_AKAS = AkasMoviesCache()
  File "imdbpy2sql.py", line 1636, in __init__
    MoviesCache.__init__(self, *args, **kdws)
  File "imdbpy2sql.py", line 990, in __init__
    'md5sum'))
  File "imdbpy2sql.py", line 598, in createSQLstr
    colNames.append(colName(table, col))
  File "imdbpy2sql.py", line 543, in colName
    return table.sqlmeta.columns[column].dbName
KeyError: 'md5sum'
---

Any help would be greatly appreciated!

Frederik

------------------------------------------------------------------------------
RSA(R) Conference 2012
Save $700 by Nov 18
Register now
http://p.sf.net/sfu/rsa-sfdev2dev1

getting "grossing" data

Zsolt Ero — 2011-11-12T19:44:15

Hi,

I have just started using IMDbPY. I would like to get the "grossing"
field of a given movie, but I don't know how.

Neither "business" or "grossing" works for me.

Is grossing available in IMDbPY in some way?

Zsolt

------------------------------------------------------------------------------
RSA(R) Conference 2012
Save $700 by Nov 18
Register now
http://p.sf.net/sfu/rsa-sfdev2dev1

cant retrieve movie list from person

Gustaf Nilsson — 2011-10-28T17:57:28

Hi
Im trying to retrieve a list of movies a person has worked on, but it only
seems to work on famous people (?)
Below is some copy paste from python:

2011-10-28 18:51:47,618 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:459: unable to use "lxml": No module named
lxml.html
2011-10-28 18:51:47,642 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:450: falling back to "beautifulsoup"
2011-10-28 18:51:48,621 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:459: unable to use "lxml": No module named
lxml.html
2011-10-28 18:51:48,622 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:450: falling back to "beautifulsoup"
2011-10-28 18:51:48,723 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:459: unable to use "lxml": No module named
lxml.html
2011-10-28 18:51:48,723 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:450: falling back to "beautifulsoup"
{u'The Story of Vernon and Irene Castle (1939)': <Movie id:0031983[http]
title:_The Story of Vernon and Irene Castle (1939)_>, u'Dancing Lady
(1933)': <Movie id:0023926[http] title:_Dancing Lady (1933
)_>, u'The Gay Divorcee (1934)': <Movie id:0025164[http] title:_The Gay
Divorcee (1934)_>, u'Shall We Dance (1937)': <Movie id:0029546[http]
title:_Shall We Dance (1937)_>, u'Funny Face (1957)': <Movi
e id:0050419[http] title:_Funny Face (1957)_>, u'Imagine (1972)': <Movie
id:0172586[http] title:_Imagine (1972)_>, u'Roberta (1935)': <Movie
id:0026942[http] title:_Roberta (1935)_>, u'Follow the Flee
t (1936)': <Movie id:0027630[http] title:_Follow the Fleet (1936)_>, u'Daddy
Long Legs (1955)': <Movie id:0047969[http] title:_Daddy Long Legs (1955)_>,
u'Easter Parade (1948)': <Movie id:0040308[http
] title:_Easter Parade (1948)_>, u'Carefree (1938)': <Movie id:0029971[http]
title:_Carefree (1938)_>, u"That's Entertainment, Part II (1976)": <Movie
id:0075323[http] title:_That's Entertainment, Par
t II (1976)_>, u'Ziegfeld Follies (1945)': <Movie id:0039116[http]
title:_Ziegfeld Follies (1945)_>, u'Flying Down to Rio (1933)': <Movie
id:0024025[http] title:_Flying Down to Rio (1933)_>, u'Saturda
y Night Fever (1977)': <Movie id:0076666[http] title:_Saturday Night Fever
(1977)_>, u'The Barkleys of Broadway (1949)': <Movie id:0041158[http]
title:_The Barkleys of Broadway (1949)_>, u'Top Hat (19
35)': <Movie id:0027125[http] title:_Top Hat (1935)_>, u'Swing Time (1936)':
<Movie id:0028333[http] title:_Swing Time (1936)_>, u'Blue Skies (1946)':
<Movie id:0038370[http] title:_Blue Skies (1946)_
2011-10-28 18:52:38,118 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:459: unable to use "lxml": No module named
lxml.html
2011-10-28 18:52:38,118 WARNING [imdbpy.parser.http.domparser]
imdb\parser\http\utils.py:450: falling back to "beautifulsoup"
{}


What can i do to get it to work?

Thanks
Gustaf

imdbpy2sql.py

Tiago Serra — 2011-10-07T23:04:45

Hi,

I just installed imdbpy and i want to use the imdbpy2sql.py to copy to mysql. I'm using ubuntu.


I need to run this script from some folder right? WHere can i find the script?


Best Regards,

Tiago

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Problem with importing to MySQL database

K Hein — 2011-09-20T10:50:23

Hi everyone,

I am having a problem while trying to import imdb data from text files to
MySQL database using imdbpy2sql.py script. It throws the following error. It
seems like the exception handler code tries to insert a duplicated record
into cast_info table with existing primary key. Can anyone help me fix this
problem or suggest any work around solution? Thanks in advance.

Regards,

K.Hein

------

SCANNING actor: Hall, Stephan
SCANNING actor: Halsey, William F.
 * FLUSHING CharactersCache...
 * TOO MANY DATA (100000 items in CharactersCache), recursion: 1
   * SPLITTING (run 1 of 2), recursion: 1
 * FLUSHING CharactersCache...
Traceback (most recent call last):
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 2951, in
<module>
    run()
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 2812, in run
    castLists(_charIDsList=characters_imdbIDs)
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 1576, in
castLists
    doCast(f, roleid, rolename)
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 1535, in doCast
    cid = CACHE_CID.addUnique(role)
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 957, in
addUnique
    else: return self.add(key, miscData)
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 950, in add
    self[key] = c
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 860, in
__setitem__
    self.flush()
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 912, in flush
    self.flush(quiet=quiet, _recursionLevel=_recursionLevel)
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 883, in flush
    self._toDB(quiet)
  File "D:\project\IMDB\IMDbPY-4.7\bin\imdbpy2sql.py", line 1186, in _toDB
    CURS.executemany(self.sqlstr, self.converter(l))
  File "C:\Python27\lib\site-packages\MySQLdb\cursors.py", line 206, in
executemany
    r = r + self.execute(query, a)
  File "C:\Python27\lib\site-packages\MySQLdb\cursors.py", line 174, in
execute
    self.errorhandler(self, exc, value)
  File "C:\Python27\lib\site-packages\MySQLdb\connections.py", line 36, in
defaulterrorhandler
    raise errorclass, errorvalue
_mysql_exceptions.IntegrityError: (1062, "Duplicate entry '745684' for key
'PRIMARY'")
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1_______________________________________________
Imdbpy-help mailing list
Imdbpy-help-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/imdbpy-help