gmane.comp.db.firebird.python

RFC: Metadata extensions for FDB

Pavel Cisar — 2013-05-14T15:54:13

Hi all,

I have "metadata" extension for FDB in development for some time now, 
and I'm getting close to release it (intended for 1.2 release). The 
basic idea is to provide database metadata (and other selected useful 
information like common queries/operations on top of monitoring tables) 
as collections of Python objects for easy access and manipulation. 
However, this is huge addition to "basic" functionality mandated by 
Python DB API 2.0, and it's not necessary for work with databases. So I 
tend to keep it separated from core functionality. On the other hand, 
this all naturally fits to Connection class, so I would appreciate some 
feedback from end FDB users here.

Right now these extensions are separated into independent submodule 
fdb.utils. The main "access" point is Database class, but this module 
also contains other metadata classes (tables, domains, indices etc.). 
The submodule was introduced to keep indirectly used classes/code from 
main FDB namespace, and import only Database class into it

FDB release 1.1.1

Pavel Cisar — 2013-05-14T11:41:08

FDB release 1.1.1 is out:
http://pypi.python.org/pypi/fdb

Bugs Fixed:

- http://tracker.firebirdsql.org/browse/PYFB-34
- http://tracker.firebirdsql.org/browse/PYFB-35

best regards
Pavel Cisar
IBPhoenix


------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/

FDB Blocking Cursor

josef_gschwendtner — 2013-05-06T14:55:58

We depend on a third party framework which uses one Cursor Instance for
the execution of many queries. There are some select queries and also
ddl statements which get executed with one Cursor instance.

After each execution of a statement the fetch method gets called. Also
for the ddl statements which produces no result.  But in fdb this leads
to an exception "WindowsError: exception: access violation reading
0x0000000000000000". After this exception the cursor is no longer
usable. The next call of cur.execute() with a select statement blocks
and never returns.

This situation can be simulated with the following script. Instead of a
ddl statement it is also possible to use an update statement.



import fdb

import traceback





def execute(cur, stmt, parameters = None):

     print "-----------------------------------"

     print "Execute ", stmt

     cur.execute(stmt, parameters)

    try:

         for row in cur.fetchall():

             print row

     except Exception, e:

         print traceback.

Huge Firebird memory usage using FDB

josef_gschwendtner — 2013-04-30T10:20:14

Hi,

We got a problem when we use the Firebird driver for Python (fdb) inside
a connection pool. If a single connection is used for the execution of

many queries and each query uses a separate cursor instance we observed
an increasing memory usage on the server side (the fbserver process).

Only when the connection gets closed the memory usage of the fbserver
process gets back to a "normal" value.

 An equal situation can be simulated with this short python script.

 

import fdb





con = fdb.connect(dsn='localhost/3050:C:\\Development\\DB\\mydb.fdb',
user='sysdba',
                  password='masterkey')



for i in range(10000):

    cur = con.cursor()

    cur.execute( "select * from RDB$Relations")

    for row in cur.fetchall():

        print i, row[0]

    con.commit()

t = raw_input('Press Key')

con.close()



print "Finished"



When the loop has finished and before closing the connection the
fbserver process uses almost one GB of memory. This is independe

WG: FDB Bug Report

Josef Gschwendtner — 2013-04-30T09:28:04

Von: Markus Holzner 
Gesendet: Dienstag, 30. April 2013 10:30
An: Josef Gschwendtner
Betreff: FDB Bug Report



We got a problem when we use the Firebird driver for Python (fdb) inside a connection pool. If a single connection is used for the execution of 

many queries and each query uses a separate cursor instance we observed an increasing memory usage on the server side (the fbserver process). 

Only when the connection gets closed the memory usage of the fbserver process gets back to a "normal" value. 

 

An equal situation can be simulated with this short python script.

 

import fdb

 

 

con = fdb.connect(dsn='localhost/3050:C:\\Development\\DB\\mydb.fdb', user='sysdba', 
                  password='masterkey')

 

for i in range(10000):

    cur = con.cursor()

    cur.execute( "select * from RDB$Relations")

    for row in cur.fetchall():

        print i, row[0]

    con.commit()

         

 

t = raw_input('Press Key')

con.close()

 

print "Finished"

 

When the loop has finished and before

FDB release 1.1

Pavel Cisar — 2013-04-09T10:55:58

FDB release 1.1 is out:
http://pypi.python.org/pypi/fdb

New Features:

- Context Manager for transactions.

Bugs Fixed:

- http://tracker.firebirdsql.org/browse/PYFB-30

best regards
Pavel Cisar
IBPhoenix


------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/

reading blob from table

Hamish Moffatt — 2013-04-06T13:18:59

Hi,

I am using fdb 0.9.9 and Firebird 2.1 and I trying to fetch some data 
out of tables containing blobs. However the blobs I get back are always 
truncated at the first null.


One such table is defined as

SQL> show table g_mididrum;
DRUM_NUMBER                     INTEGER Not Null
DRUM_NAME                       (DOM_MIDI_NAME) VARCHAR(30) Nullable
DRUM_WAVE                       BLOB segment 80, subtype BINARY 
CHARACTER SET NONE Nullable
DRUM_WAVE_6                     BLOB segment 80, subtype BINARY 
CHARACTER SET NONE Nullable
DRUM_WAVE_12                    BLOB segment 80, subtype BINARY 
CHARACTER SET NONE Nullable
CONSTRAINT PK_G_MIDIDRUM:
   Primary key (DRUM_NUMBER)

I'm making the query "SELECT * FROM G_MIDIDRUM". The cursor's 
description field after the query says

(('DRUM_NUMBER', <type 'int'>, 11, 4, 0, 0, False), ('DRUM_NAME', <type 
'str'>, 120, 120, 0, 0, True), ('DRUM_WAVE', <type 'str'>, 0, 8, 0, 0, 
True), ('DRUM_WAVE_6', <type 'str'>, 0, 8, 0, 0, True), ('DRUM_WAVE_12', 
<type 'str

fdb current repository

Maximiliano Robaina — 2013-04-04T20:32:13

Hi,

Which is the current public repo of fdb?

I'm pointing to https://firebird.svn.sourceforge.net/svnroot/firebird/python/fdb/trunk/
but the version here is 

__version__ = '0.9.9'

https://firebird.svn.sourceforge.net/svnroot/firebird/python/fdb/trunk/fdb/fbcore.py

The current fdb version is 1.0, right?



 
--
Maxi


------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.y

FDB release 1.0

Pavel Cisar — 2013-03-07T16:24:58

FDB release 1.0 is out:
http://pypi.python.org/pypi/fdb

Improvements:

- Removed dependency on presence of fbclient library at import time. 
This caused some confusion to new users when fdb install failed when 
Firebird was not (yet) installed.

Bugs Fixed:

- http://tracker.firebirdsql.org/browse/PYFB-25

best regards
Pavel Cisar
IBPhoenix


------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject

segfault in fdb driver

mariuz — 2013-02-26T10:36:45

Long story short when i do a migration with south in django 1.5 i get a segfault 

python2.7[16781]: segfault at 0 ip 00007fc33e049d95 sp 00007fff02447070 error 4 in libfbclient.so.2.5.2[7fc33dff5000+c0000]

Any tips on howto debug it ?

Here is the full disscussion and i can show howto reproduce it 

https://groups.google.com/d/msg/django-firebird-dev/AP14csAqCtI/ok7kTeWb-u4J



------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*>

Django Firebird driver now available for install from pypi

mariuz — 2013-02-21T18:03:18

Here is the url 
https://pypi.python.org/pypi/django-firebird

This was announced on twitter by Maximiliano Robaina

https://twitter.com/maxirobaina/status/304636118069018624



------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/

Again: can't install fdb

skoczian — 2013-01-06T11:26:17

Hello,

trying to install fdb 0.9.9 using Python 3.3 I get the same error message as in July with 0.8.5 and Python 3.2:

D:\home\Sibylle\Downloads\setup\fdb-0.9.9>python setup.py install
Traceback (most recent call last):
  File "setup.py", line 7, in 
    from fdb import __version__
  File "D:\home\Sibylle\Downloads\setup\fdb-0.9.9\fdb\__init__.py", line 23, in
 
    from fdb.fbcore import *
  File "D:\home\Sibylle\Downloads\setup\fdb-0.9.9\fdb\fbcore.py", line 26, in
 
    from . import ibase
  File "D:\home\Sibylle\Downloads\setup\fdb-0.9.9\fdb\ibase.py", line 39, in
 
    fb_library = WinDLL(fb_library_name)
  File "c:\Python33\lib\ctypes\__init__.py", line 353, in __init__
    self._handle = _dlopen(self._name, mode)
TypeError: bad argument type for built-in operation

Only this time it doesn't help that fbclient.dll (64bit version)is in the Windows\system32 directory _and_ the firebird bin directory is in the path. Everything is 64bit:
Windows 7 Home Premium
Firebird 2.5.2
Python 3.3

Testing with ctyp

Firebird and Djangos WordPress alternative : Mezzanine

mariuz — 2012-12-17T16:20:11

http://www.firebirdnews.org/?p=8103



------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/

PyFirebirdSQL 0.7.1 pure Python driver is released with many fixes

mariuz — 2012-12-13T15:50:31

http://www.firebirdnews.org/?p=8077



------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/

Making SQLAlchemy 0.8.0b1 to work with FDB 0.9.x

mariuz — 2012-12-01T16:32:52

If you use SQLAlchemy 0.8.0b1 with fdb there is one issue loading the driver solved in the 
next release of SQLAlchemy

http://www.reddit.com/r/Python/comments/1400nh/firebird_python_driver_fdb_099_is_released/c78p7fy



------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/

FDB release 0.9.9

Pavel Cisar — 2012-11-29T13:41:10

FDB release 0.9.9 (a.k.a. almost final) is out:
http://pypi.python.org/pypi/fdb

New Features:

- Firebird ARRAY support.

Other changes:

- Cursor.execute() returns Self, so it could be used as iterator.
- Reading output from Services now uses more efficient method to get 
data from server.

Bugs Fixed:

- Fix: precision_cache in Connection works as intended.

This was supposed to be 1.0 final release, but I've decided to make 1.0 
mode optimized. So 0.9.9 is feature complete driver, and 1.0 release 
planed for January 2013 would contain only optimizations (and bug fixes 
if needed).

best regards
Pavel Cisar
IBPhoenix


------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest

SQLAlchemy 0.8.0b1 released with fdb support

mariuz — 2012-10-31T06:54:54

News via \r\python

http://www.reddit.com/r/Python/comments/12dkj8/sqlalchemy_080b1_released/

An experimental dialect for the Firebird : fdb driver is added with this version please test it with Firebird 2.5.2 http://docs.sqlalchemy.org/en/latest/changelog/changelog_08.html#change-274d52dddd6cd76f57ce87648cc1473c





------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/firebird-python/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/firebird-python/join
    (Yahoo! ID required)

<*> To change settings via email:
    firebird-python-digest-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org 
    firebird-python-fullfeatured-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> To unsubscribe from this group, send an email to:
    firebird-python-unsubscribe-hHKSG33TihhbjbujkaE4pw< at >public.gmane.org

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo

[fdb] Fail on insert BIGINT limits values

Maximiliano Robaina — 2012-10-29T13:56:28

Hi,

In fdb, the BIGINT fail on insert with lower limit value.


Traceback (most recent call last):
  File "<console>", line 1, in <module>
  File "/usr/local/lib/python2.7/dist-packages/fdb/fbcore.py", line 2697, in execute
    self._ps._execute(parameters)
  File "/usr/local/lib/python2.7/dist-packages/fdb/fbcore.py", line 2375, in _execute
    self.__Tuple2XSQLDA(self.in_sqlda, parameters)
  File "/usr/local/lib/python2.7/dist-packages/fdb/fbcore.py", line 2217, in __Tuple2XSQLDA
    int_to_bytes(value, sqlvar.sqllen))), buf_pointer)
  File "/usr/local/lib/python2.7/dist-packages/fdb/fbcore.py", line 443, in int_to_bytes
    return struct.pack(fmt, val)
error: integer out of range for 'Q' format code



The table structure is:

CREATE TABLE MODEL_FIELDS_BIGINT
(
  ID Integer NOT NULL,
  "VALUE" Bigint NOT NULL,
  NULL_VALUE Bigint,
  PRIMARY KEY (ID)
);



 
--
Maxi


b: http://maxirobaina.tumblr.com
t: http://twitter.com/maxirobaina


------------------------------------

Yahoo! Gro

fdb 0.9.1: possible issue with varchar fields

Maximiliano Robaina — 2012-10-25T22:48:12

I'm testing django-firebird using fdb 0.9.1 

I fall into strange problem testing models with CharFields which are defined as varchar field at database level.

Then, I tried to isolate the problem testing directly with fdb. 


Environment:
Ubuntu 11.04 32 bits
Python 2.7.1
Firebird2.5-super 

fdb 0.9.1


Table structure:

DATABASE CHARSET ISO8859_1, PAGE SIZE 4096


CREATE TABLE TEST_BASE_BIGS
(
  ID Integer NOT NULL,
  S Varchar(255) NOT NULL,
  PRIMARY KEY (ID)
);


First, I insert by hand (using FlameRobin) a record in TEST_BASE_BIGS

INSERT INTO TEST_BASE_BIGS (ID, S) VALUES ('1', 'slugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslugslug');



Now:


('',)


As we can see, It return a empty string instead of the correct value from "s" field


But, adding ID field into query:


(1, '')


Am I doing something wrong?
Is it just a fdb bug ?


--
Maxi


-----------

fdb 0.9.1 broken

nxciro — 2012-10-21T13:12:01

Updated from 0.8 to 0.9.1 via easy_install for python 2.7

AttributeError: 'Connection' object has no attribute 'getServerVersion'


all this and more missing in services.py  ??

    def getServiceManagerVersion(self):
        return self._QI(ibase.isc_info_svc_version)

    def getServerVersion(self):
        return self._QS(ibase.isc_info_svc_server_version)

    def getArchitecture(self):
        return self._QS(ibase.isc_info_svc_implementation)

    def getHomeDir(self):
        return self._QS(ibase.isc_info_svc_get_env)

    def getSecurityDatabasePath(self):
        return self._QS(ibase.isc_info_svc_user_dbpath)

    def getLockFileDir(self):
        return self._QS(ibase.isc_info_svc_get_env_lock)

    def getCapabilityMask(self):
        return self._QI(ibase.isc_info_svc_capabilities)

    def getMessageFileDir(self):
        return self._QS(ibase.isc_info_svc_get_env_msg)

    def getConnectionCount(self):
        return self._get_isc_info_svc_svr_db_info()[0]

    def getAttachedDatabaseNames(s

cannot connect to an embedded firebird database using Python (.NET client works)

btapkan — 2012-10-11T18:52:16

Hello,
Hope everyone is doing well.  Having this problem of not being able to
connect to an existing embedded Firebird database using Python.
I work regularly on a Windows 7 x64-bit, Python 2.7 (switched to 2.6 for
kinterbasdb w/o success, then switch back). I also have a licensed copy
of Firebird Maestro.  Tried three different library packages:

    * firebirdsql (relatively new, but does not seem to have support for
embedded) (http://pypi.python.org/pypi/firebirdsql
<http://pypi.python.org/pypi/firebirdsql> )


    * kinterbasdb (last update was in 2010, seemed to install) (


    * fdb (could not install either on Windows or
MacOS).(http://pypi.python.org/pypi/fdb
<http://pypi.python.org/pypi/fdb> )

have the bellow code (basically trying to invoke the sample code on the
documentation:
# import firebirdsqlimport kinterbasdb
# the server is named test.fsdb# con =
firebirdsql.connect(dsn='TEST.FDB', user='SYSDBA',
password='masterkey')con = kinterbasdb.connect(host='',
database=r'C:\src\python\pyfirebirdsq