gmane.comp.djb.cdb

Re: cdb does not compile on Fedora 14 linux

Alan Thew — 2011-07-18T09:11:24

On Mon, 18 Jul 2011 09:57 , keith.briggs< at >bt.com <keith.briggs< at >bt.com> said:

<snip>

Have you tried


0.70-errno.patch

--- error.h.orig        2003-03-05 15:42:51.000000000 -0500
+++ error.h     2003-03-05 15:43:00.000000000 -0500
< at >< at > -1,7 +1,7 < at >< at >
  #ifndef ERROR_H
  #define ERROR_H

-extern int errno;
+#include <errno.h>

  extern int error_intr;
  extern int error_nomem;


Alan Thew

cdb does not compile on Fedora 14 linux

2011-07-18T08:57:24

kbriggs< at >gold:~/Download/cdb-0.75> make
( cat warn-auto.sh; \
echo 'main="$1"; shift'; \
echo exec "`head -1 conf-ld`" \
'-o "$main" "$main".o ${1+"$< at >"}' \
) > load
chmod 755 load
( cat warn-auto.sh; \
echo exec "`head -1 conf-cc`" '-c ${1+"$< at >"}' \
) > compile
chmod 755 compile
( ( ./compile tryulong32.c && ./load tryulong32 && \
./tryulong32 ) >/dev/null 2>&1 \
&& cat uint32.h2 || cat uint32.h1 ) > uint32.h
rm -f tryulong32.o tryulong32
./compile cdbget.c
( cat warn-auto.sh; \
echo CC=\'`head -1 conf-cc`\'; \
echo LD=\'`head -1 conf-ld`\'; \
cat find-systype.sh; \
) | sh > systype
( cat warn-auto.sh; \
echo 'main="$1"; shift'; \
echo 'rm -f "$main"'; \
echo 'ar cr "$main" ${1+"$< at >"}'; \
case "`cat systype`" in \
sunos-5.*) ;; \
unix_sv*) ;; \
irix64-*) ;; \
irix-*) ;; \
dgux-*) ;; \
hp-ux-*) ;; \
sco*) ;; \
*) echo 'ranlib "$main"' ;; \
esac \
) > makelib
chmod 755 makelib
./compile cdb.c
./compile cdb_hash.c
./compile cdb_make.c
./makelib cdb.a cdb.o cdb_hash.o cdb_make.o
./compile

Re: cdb self-tests, was Re: GCC 3.2 errors

Chris Pugh — 2010-06-01T06:42:13


On 1 June 2010 02:18, Jeff King <peff< at >peff.net> wrote:



So, Wouter, perhaps you kindly elnlighten Jeff ( and the list ) as to
what exactly it is that you are doing?


Chris.

Re: cdb self-tests, was Re: GCC 3.2 errors

Jeff King — 2010-06-01T00:18:52


I think you mean this thread:

  http://thread.gmane.org/gmane.comp.djb.cdb/123

but the situation has come up multiple times before:

  http://thread.gmane.org/gmane.comp.djb.cdb/77
  http://thread.gmane.org/gmane.comp.djb.cdb/88

The original poster in this thread doesn't say if he is trying to run
the self-tests, or encountering this error during regular use.

The softlimit issue affects only the tests. Basically a certain test
should cause cdbmake to abort due to a softlimit, but it doesn't. The
result is that cdbmake continues to run and finds a bogus point in the
input (which is not a bug; the input really is bogus, it was just never
supposed to get there in the test). If it's simply the test issue, then
it can be ignored (unless you really want to use softlimit, in which
case you might try "softlimit -m" as Dan suggests in the third thread
above).

If he is seeing this problem in actual use, then his input probably is
bad in some way. But I can't say how without seeing the input.

-Peff

Re: cdb self-tests, was Re: GCC 3.2 errors

Chris Pugh — 2010-05-31T13:15:48

I recall seeing this as possibly being related to,

 - a machine where softlimit -d doesn't work properly, if at all.

-  a malloc()  issue wih Linux/glibc systems.

The original poster being 'Peff'?

Have you checked the list archives?

    http://dir.gmane.org/gmane.comp.djb.cdb.

Worth a look.

Regards,


Chris.

Re: cdb self-tests, was Re: GCC 3.2 errors

WS — 2010-05-30T22:17:02

Hello guys,

Anyone has an update on how to fix the following error?
cdbmake: fatal: unable to read input: bad format

Was working without any problems on older system, on new recent system (CentOS
5.4) we are having issues.

Thanks.

Re: 64-bit CDB

Andy Bradford — 2010-03-22T04:33:06

Thus said Matt Chaput on Fri, 19 Mar 2010 13:27:50 EDT:


Care to share for the archives?

Andy

Re: 64-bit CDB

Matt Chaput — 2010-03-19T17:27:50

Sorry, y'know what, I think I grok it now. Thanks anyway :)

Matt

re: 64-bit CDB

Matt Chaput — 2010-03-19T15:51:49

Let me try to be clearer: does anyone understand the hashtable lookup 
part of the CDB algorithm (i.e. start at (hash >> 8) % tablesize, half 
the table kept empty, etc.) sufficiently to explain if it could/how it 
would change if I use 12-byte records (4-byte hash + 8-byte pointer)?

Thanks,

Matt

Re: 64-bit CDB

Thomas Mangin — 2010-03-19T10:05:41

So did we two years ago, and put it in the public domain at the time (I believe I published it here at the time)
http://thomas.mangin.com/data/source/cdb.py

Writing CDB files is slow (compared to cdbmake) and eats much memory but it is correct - and unlike the Python C binding does not cause us segfaults on some machines.


Thanks, never saw it before.

Thomas

Re: 64-bit CDB

Chris Dean — 2010-03-19T00:37:31

Have you seen the diagram at 

  http://www.unixuser.org/~euske/doc/cdbinternals/index.html

To use language on that page, you need to change the pointer part of the
data structure to take 64bits instead of 32.  This will also make your
implementation incompatible with existing cdb file formats.

Cheers,
Chris Dean

64-bit CDB

Matt Chaput — 2010-03-19T00:00:24

Hi, I've written a Python implementation of the CDB algorithm as part of 
a project. I'd like to convert it to use 64-bit disk offsets to get 
around the 4-GB limit, but I don't understand how the 
hash-to-disk-offset lookup process works and what depends on 32-bit-ness 
well enough to do it with confidence.

Has anyone done this already or can anyone point out what I'd need to 
change in the algorithm to get it to work?

Thanks very much!

Matt

latest version for cdb ?

nikhil sharma — 2009-10-20T11:37:42

hello,
i would like to know what is the latest version of cdb software. I got cdb
0.75 from the web page http://cr.yp.to/cdb.html
Is it the latest or there are enhancements done over it?

regards,
nik