gmane.comp.search.xappy.general

is EXACT_MATCH working?

J5 — 2011-09-29T22:44:10

Hello,

We are using Xappy to create indexes for package searching in Fedora.
Right now the results are a bit skewed due to freetext searches simply
matching the number of times a term shows up.  I want to fix this
using exact matching on the package name so that if an exact match is
found we return that as the top result.  This does not seem to work.
If I do this and remove all of the other matching fields we always get
an empty result

iconn.add_field_action('exact_name', xappy.FieldActions.INDEX_EXACT)
iconn.add_field_action('exact_name', xappy.FieldActions.STORE_CONTENT)
doc.fields.append(xappy.Field('exact_name', 'dbus',  weight=100.0))
.
.
.

then searching for 'dbus' using xapian should return that match but we
get an empty set:

query = qp.parse_query('dbus')
enquire.set_query(query)
matches = enquire.get_mset(0, 10)
count = matches.get_matches_estimated()
print count


How do we get count working?  BTW we are using xappy for indexing
because it presents a nice interface but xapian is simple enough o

Fix for fieldmapping

Bruno Rezende — 2011-05-06T18:02:17

Hi,

I've created a patch for a problem in fieldmapping:

http://code.google.com/p/xappy/issues/detail?id=37 (FieldMappings is
generating wrong prefixes )

can someone review it? what is the right procedure for asking for
patch reviews?

Applying Multiple Caches support

Bruno Rezende — 2011-03-11T15:05:00

Hi,

I've added support to applying multiple caches to a xappy index here:

http://code.google.com/p/xappy/issues/detail?id=36

it still misses some tests related to document removal and update, but
I think it is in shape for a review. If someone can take a look, i'd
be grateful.

regards,
Bruno

Multiple Caches and replace document

Bruno Rezende — 2011-02-17T13:16:44

Hi,

suppose I have a index and have multiple caches that can be applied to
it. The cache that will be used will be chosen at search time. In this
scenario, how would incremental indexing be affected? I'm looking
IndexerConnection.replace method and have seen this:


       if self._index.get_metadata('_xappy_hascache'):
           if store_only:
               # Remove any cached items from the cache - the document
is no
               # longer wanted in search results.
               self._remove_cached_items(id, xapid)
           else:
               # Copy any cached query items over to the new document.
               olddoc, olddocid = self._get_xapdoc(id, xapid)
               if olddoc is not None:
                   for value in olddoc.values():
                       if value.num < self._cache_manager_slot_start:
                           continue
                       xapdoc.add_value(value.num, value.value)


we can remove documents from our multiple caches, but I don't know
what should I do wh

replace document slow?

Bruno Rezende — 2011-02-03T12:40:07

(it seems I'm having problems emailing xappy-discuss, so sorry if this
message is sent twice)

Hi,

I'm doing some incremental updates in a xapian database using xappy
api. The changes to the documents are minimal, just adding/removing
some terms. The way I'm doing is something like:

1. get the documents from a search connection
2. change the terms with ProcessedDocument.add_term /
ProcessedDocument.remove_term
3. call IndexerConnection.replace(changed_doc)

I'm getting an average of ~200 items/sec. If instead of using the
document returned by search connection I get the document from the
indexer connection and continue using replace(doc), I see no real
gain.

I tried this too:

1. get the documents from a search connection
2. get each document from indexer connection
3. change the terms with ProcessedDocument.add_term /
ProcessedDocument.remove_term
4. see if the changes would be applied to the index, without calling
IndexerConnection.replace(changed_doc)

with this approach the number of items per second

How can I get "Xapian::MSetIterator::get_collapse_count()" C++ function in xappy ?

Stéphane Klein — 2010-11-03T09:40:09

Hi,

when I use :

result = conn.search(q, 0, 10, collapse='category')

I can do :

result.matches_estimated

now, how can I get "Xapian::MSetIterator::get_collapse_count()" C++
function in xappy ?
(more information about this function :
http://xapian.org/docs/apidoc/html/classXapian_1_1MSetIterator.html#5a0c5216cb505912318e6a552725e3af
)

Thanks for your help,
Stéphane

Is it possible to create a xappy field with actions : INDEX_FREETEXT and COLLAPSE ?

Stéphane Klein — 2010-11-03T09:03:06

Hi,

this is my short question, is it possible to create a xappy field with
actions : INDEX_FREETEXT and COLLAPSE

something like this :

    conn.add_field_action(
        'laboratory_name',
        xappy.FieldActions.INDEX_FREETEXT ||
xappy.FieldActions.COLLAPSE,
        weight=10,
        language=lang,
        spell=True
    )

I've looking in xappy documentation and source code, I found nothing
about this subject.

Thanks for your help,
Stephane

Patch for Highlighter.makeSample

Yannick Gingras — 2010-08-04T02:49:57

Updating Xapian

charliejuggler — 2010-03-31T10:29:42

Hi,

Could we get a new version of the merged Xapian packages generated?
I've submitted a patch to the Xapian bugtracker with improved Windows
build files, as the current Xapian packages don't build on Windows.
I'm trying to release a new version of Flax Basic.

Cheers

Charlie

Massive memory leak

Dominic LoBue — 2010-03-09T17:48:58

Hello,

I am seeing a massive memory leak in xappy, but I'm having trouble
pinning it down exactly.

Some background: I'm using xappy to index my email and store useful
headers for quick access.

In the program I'm developing I will open a new search connection,
perform a query, copy all the header information into a custom
container class, and then close the search connection. I have found
that as I keep performing these operations my program continues to use
more and more ram, and never releases anything.

Here's a really simple example that makes the problem obvious:
import pdb
import xappy
from overwatch import xapidx
from databasics import msg_factory
sconn = xappy.SearchConnection(xapidx)
r = sconn.search(sconn.query_all(), 0, 99999999, checkatleast= -1,
sortby= '-sent')
r = map(msg_factory, r)
del r
del sconn
pdb.set_trace()




msg_factory is just a factory function that returns a named tuple that
contains all the header information contained in the ProcessedDocument
it gets.

Running that script on

Lets flirt, seeking for a partner

Inga Fox — 2009-09-24T08:47:50

Today, I am so bored and lonely.
Friends, let's get started?
Lets flirt or maybe something more?
http://vedakathalee.150m.com

Where can I find an online anti-virus that doesn't install on your PC?

hartskellum52073 — 2009-09-24T02:58:37


I usually use this one http://pmcware.com/freedowns

Where can I find an online anti-virus that doesn't install on your PC?

ritzmckey24254 — 2009-09-23T16:01:28

I've got 5 PCs that I'm trying to use to train disadvantaged young
people. The problem is they are riddled with viruses and a firewall
blocks me from updating them. The people in charge of maintaining the
PCs won't fix them or give me the admin password (Win XP) to let me
install a new or updated antivirus the centre is being shut down in a
few months.

If they were working, I could still do a lot with them, so I've been
looking for a good online virus scan - but they all try to download a
little .exe onto your PC first, and the settings on the PCs won't
allow that.

Suggestions? Solutions? Links?

Come with me

Anna Lucas — 2009-09-23T01:53:46

Today, I am so bored and lonely.
Friends, let's get started? Come with me for flirting or ...
http://erinlucas.150m.com

Brad Pitt in adult movies???

theodosiasiddiqui36565 — 2009-09-21T22:58:22

Here is Brad Pitt with couple cuties... OMG!!!)) http://urlcover.com/brad-pitt

BDSM? Whats with this bondage/sadomasochism stuff, anyway?

BDSM Lovers — 2009-09-21T17:16:48

"BDSM" is an acronym of "B&D" (Bondage & Discipline), "D&S" (Dominance
& Submission), and "S&M" (sadomasochism). "BDSM" refers to any or all
of these things, and a lot of stuff besides.

Tying up your lover is BDSM; so is flogging that person, or bossing
that person around, or any of a thousand other things. BDSM is highly
erotic, usually (though not always) involves sex or sexual tension;
and is highly psychologically charged. One person (the "submissive")
agrees to submit to another person (the "dominant"); or, alternately,
one person agrees to receive some sort of sensation, such as spanking,
from another.

MANY PEOPLE PRACTICE SOME ELEMENT OF BDSM IN THEIR SEXUAL LIVES
WITHOUT EVEN BEING AWARE OF IT.

Role-playing? Fantasy? You make it sound like it's all some kind of
game.
IT IS. YOU'RE EXERCISING YOUR IMAGINATION, AND YOU'RE PLAYING A GAME
WITH THE OTHER PERSON. JUST TRY AT
http://lavernfoxy.150m.com

I feel inclined to have sex

Anna Marley — 2009-09-21T11:30:36

My name is Anna Marley, I am a girl 21 years old.
Today I feel inclined to have sex.
Im here, someone wants to see me?
http://lupelieselot.150m.com

Be nice with me

margawidger61231 — 2009-09-21T11:04:02

Free movies.Not for kids ;)
Forget about your problems and relax watching this!
http://urlcover.com/s1a

REAL girls video chat

Pedro Girlsfinder — 2009-09-19T19:34:48

Seeking a girl for chatting, flirting or something more? Maybe a
boy? :) Millions participants waiting for you in the sex chat. Find a
friend in Your city!

http://bandijame.150m.com

Seeking a partner for flirting ( and maybe more :) )

Maria Mersi — 2009-09-18T20:40:47

Hello to this group, Im new here.
Life is boring and uninteresting, entertain me :)

Lets flirt or maybe something more?
Im here: http://go2-url.com/aernas

Start living a worry-free, prosperous lifestyle, regardless of the economy.

nicol nissen — 2009-08-31T04:26:15

You Won't Get Rich But You Can Make A Realistic $500 to $5000 A Month
using only your home computer.Sign up(use only your name and
email,US,CA,UK Only) to learn my step-by-step tips and start living a
worry-free, prosperous lifestyle, regardless of the economy..
http://go2-url.com/aeaauu