gmane.comp.python.ipython.user

iPython Notebook profile under Windows

federico vaggi — 2012-05-25T20:21:42

Hi,

I usually use iPython and the notebook under Linux, but I ran into some
rather trivial problems under Windows.  After installing EPD (thank you
very much to Enthought) I noticed that the default save directory for
iPython notebooks is windows/system - which of course, the default user
does not have write access to.  This means that I can open existing iPython
notebooks, but I can't create new ones, because I am not able to change the
starting directory, and pressing new crashes Python with an error about
'lacking write access''

For reference, here is the log:

[NotebookApp] Using existing profile dir:
u'C:\\Users\\Fede\\.ipython\\profile_d
efault'
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:8888
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
ERROR:root:Uncaught exception GET /new (127.0.0.1)
HTTPRequest(protocol='http', host='127.0.0.1:8888', method='GET',
uri='/new', ve
rsion='HTTP/1.1', remote_ip='127.0.0.1', body='', headers={'Connection':
'keep-a
l

memory problem with passing numpy arrays in IPythonparallel

Charles Cadieu — 2012-05-25T15:32:09

Hi,

I'm writing a distributed stochastic gradient descent algo and need to pass
numpy arrays between a master node and the workers. These arrays are around
1000x1000 and I expect this algorithm to run for 100k iterations. I observe
that the communication is fast for the first few 1k iterations and then
begins to slow dramatically.

I've reduced the problem down to the following code. I'm experiencing what
looks like a memory leak with this code below. Am I using the correct
interface/paradigm for passing numpy arrays around? Or is there a deeper
problem with clearing references to these numpy arrays?

Thanks for any help!
Charles


from __future__ import print_function

import time
import numpy as np
from collections import defaultdict

from IPython import parallel

# create client & view
rc = parallel.Client()
dv = rc[:]
ids = rc.ids
# scatter 'id', so id=0,1,2 on engines 0,1,2
dv.scatter('id', rc.ids, flatten=True)
print("Engine IDs: ", dv['id'])

sz = (1000,500)

dv.execute('import numpy as np')
task = d

0.12.1 install problem

Ryan Krauss — 2012-05-25T14:21:50

I am trying to do a fresh install of Python 2.7, numpy 1.6.2 (and
friends), and ipython 0.12.1 in windows.  When I run the ipython
0.12.1 exe (ipython-0.12.1.win32.exe), everything seems to go OK, but
I don't have an ipython folder in my All Programs menu.  Am I doing
something wrong or is this a bug?

Thanks,

Ryan

IPython notebook module dependencies

reckoner — 2012-05-23T22:07:35

hi

I am trying to distribute an IPython notebook and I want to make sure 
that people can actually run the computations, but I'm not sure how to 
communicate the long list of the dependent modules that a particular 
notebook requires. Is there some way I can automatically generate this? 
I would like to give them a list that they can simply do

% easy_install list_of_dependencies.txt

The tricky part here is that I have many more installed modules than are 
used in a specific IPython notebook so given anyone the list of items 
installed in my site-packages directory would be of no help. 
Furthermore, different notebooks would have different dependency lists.

Any help appreciated.

parallel data capture and write

Vasco Tenner — 2012-05-23T11:55:00

Hi,
I'm doing imaging experiments using a allied vision camera. Currently 
I'm using the 32bit pvapi driver and a python wrapper. I want to capture 
large datasets (around 10gb) as fast as possible. This does not fit into 
the memory I can access using a 32bit python installation. I was 
thinking about writing down the data while capturing. I do write 5mb files.

I'm trying to use IPython.parallel to achieve the simultanious data 
capture and write. I create 1 engine and send the data to this engine 
using apply_async. For some reason the engine does store all the data, 
also when it is already written on the disk. How do I clear the engine 
memmory?

Is there a better approach?

Kind regards,
Vasco Tenner
Vrije Universiteit in Amsterdam

Out problem

Adrian Klaver — 2012-05-21T20:34:43

I seem to be having a problem with Out not showing up in newer versions 
of ipython under certain conditions. It happens with  0.11+. Easiest to 
just show is as an example:

Python 2.7.3 (default, May  9 2012, 20:18:57)
IPython 0.12.1 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object', use 'object??' for extra details.

In [1]: l=[1,2,3]

In [2]: l[0]
Out[2]: 1

In [3]: for i in l:
     i
    ...:

In [4]: Out
Out[4]: {2: 1}


In previous versions iterating through a list would yield an Out:

Python 2.6.5 (r265:79063, Apr 16 2010, 13:09:56)
Type "copyright", "credits" or "license" for more information.

IPython 0.10 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object'. ?object also works, ?? prints more.

In [1]:

ipython and python3

Alan — 2012-05-21T17:18:08

Hi there,

I am a Fink user on Mac OSX Lion and I have ipython 0.12, python 2.7 and
python 3.2 installed on my system.

I am wondering how can I use ipython with python3. Besides, what is
"ipython --profile=python3" since I still see:

Python 2.7.3 (default, Apr 19 2012, 10:52:47)
Type "copyright", "credits" or "license" for more information.

IPython 0.12.1 -- An enhanced Interactive Python.

?

Thanks,

Alan

fail to update edited script when using %run withinipython?

Chao YUE — 2012-05-20T20:59:41

Dear all,

I have a problem is that, I use %run script.py to run the script within
ipython (with %pdb on),
then I add one line of print something before the line where exception is
raised.
Then I use ctrl+d to exit debugger and use %run to run the script again, I
found the script in
traceback is updated but the print part is not executed. Then I have to log
out of current ipython session
and start ipython again and use %run command, the print part has been
executed.

Does anyone else see this problem and I guess there is some flag to update
the script?

thanks,

Chao

call function with set break point?

Chao YUE — 2012-05-20T18:38:17

Dear all,

Just a one line question:
I have %run -d b20 script.py to set the break point at line20 when run the
script. Is there a way I can do the similar when I call a function?

thanks,

Chao

MacOSX import error pyside and pyqt

Rajeev Jain — 2012-05-19T18:37:42

This is on Mac OSX, I'm trying to do ipython qtconsole:-

/Users/rajeevjain
==> brew install PySide
Error: pyside-1.1.0 already installed

/Users/rajeevjain
==> brew install PyQt
Error: pyqt-4.9.1 already installed

/Users/rajeevjain
==> ipython
Python 2.7.1 (r271:86832, Jul 31 2011, 19:30:53)
Type "copyright", "credits" or "license" for more information.

IPython 0.12.1 -- An enhanced Interactive Python.
? -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help -> Python's own help system.
object? -> Details about 'object', use 'object??' for extra details.

In [1]: from IPython.external.qt import QtCore, QtGui
ImportError Traceback (most recent call last)
/Users/rajeevjain/ in ()
----> 1 from IPython.external.qt import QtCore, QtGui

/Library/Python/2.7/site-packages/IPython/external/qt.py in ()
40 QT_API = QT_API_PYQT
41 except ImportError:
---> 42 raise ImportError('Cannot import PySide >= 1.0.3 or PyQt4 >= 4.7')
43
44 elif QT_API == QT_API_PYQT:

ImportError: Cannot import

create all variables that are inside function inipython

Chao YUE — 2012-05-19T15:12:02

Dear all,

I am frustrated by debugging code now... Is there a way that when I call a
function, all the variables within the function will be created in current
ipython interactive session namespace
and then I can run the script in a way of %run -i myjob.py, if there is any
bug, I can print the most recent variable in the loop and check what's
going one, rather than modifying the code again
and again with try-except blocks or adding pdb.set_trace() here and there.
This might no be good practice but I think for not large amount of data,
it's a good way to debug.

thanks et cheers,

Chao

Using the IPython notebook architecture

K Krish — 2012-05-18T20:08:17

Hello IPython group,

I have some Python-based algorithms which I want to share with other
researchers via a webpage.
The users will able to run the algorithms on their uploaded data files, and
they can view the results in plots (displayed on the webpage) etc.
Since the IPython notebook interface already provides something that can do
this (and much more!), I was thinking of basically copying and modifying
the implementation for my webpage. I won't need an interactive shell as
most of the users won't be programmers and won't know Python -- the UI in
the webpage will using their settings and parameters to run the Python
scripts in the background.

Here's my question/request to the group ---
Note: My experience in web development is very very basic.

1) This seems like straightforward task, since most of the things I need
are already implemented in the notebook interface: the web server, calling
the IPython kernel from the webpage, plotting graphs in the webpage etc. Do
you recommend starting with the existing

ipython notebook doesn't launch browser "could not open file(notebook) for safe execution

robertking — 2012-05-18T09:28:58

Launching notepad gives the error below, and opens ipython as usual, but not
the browser.

Microsoft Windows [Version 6.0.6002]
Copyright (c) 2006 Microsoft Corporation.  All rights reserved.

*C:\Windows\system32>ipython notebook
Could not open file <notebook> for safe execution.*
Python 2.7.2 (default, Jun 12 2011, 15:08:59) [MSC v.1500 32 bit (Intel)]
Type "copyright", "credits" or "license" for more information.

IPython 0.10.2 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object'. ?object also works, ?? prints more.

In [1]: import tornado, zmq

In [2]: tornado.version
Out[2]: '2.2.1'

In [3]: zmq.__version__
Out[3]: '2.2.0'

In [4]: import simplejson


--
View this message in context: http://python.6.n6.nabble.com/ipython-notebook-doesn-t-launch-browser-could-not-open-file-notebook-for-safe-execution-tp4975037.html
Sent from the IPython - User mailing list

Print colours

2012-05-17T14:46:26

Hi.

I am playing around with the client-server stuff via  the blocking kernel manager (based on MinRK's reply at http://stackoverflow.com/questions/9977446/connecting-to-a-remote-ipython-instance).
If I get an error back the traceback contains ascii colour information like so:

[u'\x1b[1;31m---------------------------------------------------------------------------\x1b[0m\n\x1b[1;31mNameError\x1b[0m   etc.

Is there a quick way of rendering this correctly with colours via an IPython shell?

Thanks,

Matt

simple math error noted under weird circumstance

Kevin — 2012-05-17T03:08:23

Hello all.

Not sure if this is the appropriate spot to discuss this.
The following takes place when using Notebook.

I noticed an error dependent upon the presence of an extra linefeed on
the last line.
The following gives two different answers dependent upon the presence
of a linefeed:

pV = V*iV
p1 = v1*i1
p2 = v2*i2
p_sum = pV + p1 + p2
print "The sum of the powers (in Watts) entering all of the elements
is: %f" % p_sum

Without linefeed:

The sum of the powers (in Watts) entering all of the elements is: -5.306667

With linefeed:

The sum of the powers (in Watts) entering all of the elements is: 0.000000

The last output is the correct output.
I've seen simple math errors before using Notebook and now I'll have
to go back and check if it is linefeed related.

Any idea why this might be occurring?

Kevin

How to get the "??" to show the code of a decoratedfunction on IPython

Filipe Pires Alvarenga Fernandes — 2012-05-15T15:47:00

Hi, I have a decorator that goes more or less like this:

class match_args_return(object):
    def __init__(self, func):
        self.func = func
        self.__doc__ = func.__doc__
        self.__name__ = func.__name__

So far I can use IPython "?" to see the docstring, bit the "??" only
shows the decorator code instead of the decorated function.  Does
anyone know a work-around to this issue?

Thanks, Filipe.

Error Using IPython Notebook on Windows 7

Trevor Sweetnam — 2012-05-15T13:45:48

Hi All, 
I have recently discovered the IPython notebook feature. It's revolutionised my data analysis work.
Anyway I have encountered the following error when using notebooks in Chrome on Windows 7. Everything loads and appears to function ok until I try to execute a cell.- In the notebook itself nothing happens and in the command prompt I get the output below.- I don't know where this flag '-f' is coming from...I think if I could find and remove it that should fix my error. 
Any thoughts?
Cheers,
Trevor

[NotebookApp] Using existing profile dir: u'C:\\Users\**USERNAME**\\.ipython\\profile_default'[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:8888[NotebookApp] Use Control-C to stop this server and shut down all kernels.[NotebookApp] Using local MathJax[NotebookApp] Kernel started: 5945074f-2d83-4ed5-9f24-c104b0729f07IPython: an enhanced interactive Python shell.
Options-------
IPython command-line arguments are passed as '--<flag>', or '--<name>=<value>'.
Arguments that take values are

ipython 0.12.1 crashing when embedded in Django onwindows 7

Leo Shklovskii — 2012-05-13T22:28:40

I've been using ipython 0.10 forever and wanted to upgrade to the latest version 
ipython.

When I install ipython 0.12, the Django manage.py shell command intermittently 
crashes in various ways that indicate memory corruption.

Looking at the code, this is all that Django is doing:

 > from IPython import embed
 > embed()

I'm running a 64bit version of Windows 7 (latest SP) but I'm running a 32bit 
python build since a number of the binaries of certain packages out there don't 
exist in 64bit versions.

The crash happens intermittently (~50% of the time) and there are several 
different actual crashes that happen:

------------------

c:\test>manage.py shell
Traceback (most recent call last):
   File "C:\test\manage.py", line 25, in <module>
     execute_manager(settings)
   File "C:\Python27\lib\site-packages\django\core\management\__init__.py", line 
459, in execute_manager
     utility.execute()
   File "C:\Python27\lib\site-packages\django\core\management\__init__.py", line 
382, in execute
     self.

execfile doesn't work from command line

Joe Miller — 2012-05-11T15:18:20

Hi,

I've starting using ipython 0.12 and I'm having a problem running execfile from the command line

% cat tmp.py
print ("HERE")

% ipython -c "execfile (tmp.py)"
<ipython usage information...>
[TerminalIPythonApp] Bad config encountered during initialization:
[TerminalIPythonApp] The 'code_to_run' trait of a TerminalIPythonApp instance must be a unicode string, but a value of None <type 'NoneType'> was specified.
% ipython -V
0.12


This used to work in ipython 0.10
% ipython -c "execfile ('tmp.py')"
HERE
% ipython -V
0.10

I understand that I can just run the file on the command line with ipython (e.g. ipython tmp.py). But if I want to run other commands along with executing the file it no longer works 

% ipython -c "print ('THERE')" tmp.py
THERE

Any suggestion would be greatly appreciated. Thanks

-joe
_______________________________________________
IPython-User mailing list
IPython-User< at >scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user

Closed pandas.HDFStore causes ipython/whos error...

Marc Shivers — 2012-05-11T22:53:47

Hi,

I'm not sure whether this is more appropriately an issue for pandas or
ipython, so I'm sending to both.  I get the error below whenever I open a
pandas.HDFStore object, then close() it, and call the ipython whos command,
which seems to croak when it tries to populate the "Data/Info" field for a
closed HDFStore...

Any idea whether there's an easy fix?

THanks,
Marc

In [27]: whos
Variable      Type          Data/Info
-------------------------------------
data_dir      str           /disk/local/pycache/
features      HDFStore      <class 'pandas.io.pytable<...>me\nXOPp60
DataFrame
lr_coeffs     DataFrame     <class 'pandas.core.frame<...>XOP\ndtypes:
float64(133)
lr_model      HDFStore
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
/genauto/global/dept_syseqms_stc_x/python_files/eea/<ipython-input-27-3e8664a026ba>
in <module>()
----> 1 get_ipython().magic(u'whos ')

/usr/local/python/2.7.2/lib/python2

History DB repeatedly crashes

Douglas Applegate — 2012-05-11T17:49:45

Hi-

I'm running IPython 0.12 on a RHEL Client release 5.8 (Tikanga)
2.6.18-308.1.1.el5 (4x2613MHz X2200 M2) machine.

Every 2-3 days, IPython will refuse to launch, or will crash randomly in
the middle of a session, reporting that the SQLite history database has
become corrupted. IPython refuses to re-launch until I manually delete the
database file at ~/.ipython/profile_default/history.sqlite.

Here is the detailed crash backtrace:

ERROR: An unexpected error occurred while tokenizing input
The following traceback may be corrupted or invalid
The error message is: ('EOF in multi-line statement', (293, 0))
Error in sys.excepthook:
Traceback (most recent call last):
  File
"/u/ki/dapple/lib/python2.7/site-packages/IPython/core/application.py",
line 175, in excepthook
    return self.crash_handler(etype, evalue, tb)
  File
"/u/ki/dapple/lib/python2.7/site-packages/IPython/core/crashhandler.py",
line 158, in __call__
    traceback = TBhandler.text(etype,evalue,etb,context=31)
  File "/u/ki/dapple/lib/python2.7/