gmane.comp.jakarta.lucene.clucene.devel

Bug found in FieldsReader::addFieldsForMerge

Kostka Bořivoj — 2013-05-13T14:04:47

Hi

I found a bug in addFieldsForMerge method. For bingy/compressed fields internal pointer from ValueArray is passed to FieldForMerge constructor instead of (correct) pointer to ValueArray object.

I uploaded propřed patch to GIT (branch addFieldsForMerge_BugFix)

Best regards

Borek

------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and 
their applications. This 200-page book is written by three acclaimed 
leaders in the field. The early access version is available now. 
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
_______________________________________________
CLucene-developers mailing list
CLucene-developers< at >lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clucene-developers

StandardAnalyzer Memory Leak Patch

Anthony Novatsis — 2013-05-10T00:43:25

Dear All,

I've detected some memory leaks using CLucene (version 2.3.3.4) and
tracked this down to the reusableTokenStream interface of the
StandardAnalyzer.

The StandardAnalyzer::SavedStreams object which is allocated on the
first call to reusableTokenStream is eventually deleted (using an
Object AbstractDeletor) but it does not have a destructor.  The
solution was to add a destructor as follows:

index 3275c1b..6836629 100644
--- a/clucene-core-2.3.3.4/src/core/CLucene/analysis/standard/StandardAnalyzer.cpp
+++ b/clucene-core-2.3.3.4/src/core/CLucene/analysis/standard/StandardAnalyzer.cpp
< at >< at > -54,6 +54,11 < at >< at > CL_NS_DEF2(analysis,standard)
             {
             }

+            ~SavedStreams()
+            {
+                _CLDELETE(filteredTokenStream);
+            }
+
             void close(){}
             Token* next(Token* token) {return NULL;}
         };

Could this patch be reviewed and incorporated into the master?

Thanks,
Anthony

---------------------------------------------------------

Request for explanation of some code

Arnab — 2013-04-08T20:42:31

Dear All,

I am a postgraduate student and I am not an expert in programming. I am
doing a project on search and want to implement some new ideas and test on
clucene.


It is a huge code and looks complicated too. If any one please explain me
the indexing process and the classes like FSDirectory, Field, Document,
IndexWriter  it will be really a great help at this moment.

Thanks
Arnab
------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

add

Arnab — 2013-04-08T20:35:29

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Multi-Threading on Kubuntu 12.04

Ahmed Saidi — 2013-03-29T10:16:01

------------------------------------------------------------------------------
Own the Future-Intel(R) Level Up Game Demo Contest 2013
Rise to greatness in Intel's independent game demo contest. Compete 
for recognition, cash, and the chance to get your game on Steam. 
$5K grand prize plus 10 genre and skill prizes. Submit your demo 
by 6/6/13. http://altfarm.mediaplex.com/ad/ck/12124-176961-30367-2_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

qmake clucene-core-2.3.3.4 errors

jomart mirza — 2013-02-23T13:48:12

 OK this new topics form me i tried to build the last core of clucene :

http://sourceforge.net/projects/clucene/files/latest/download?source=files

with cmake gui and i faced a lot of trouble then insted i used qmake to
build the core i used the last version open source qt5 with mingw support
and at firrst it worked then i after finishing i got two error :

folder to :

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Snowball Analyzer

Scott Baldwin — 2013-02-05T01:24:20

Hi all, for cross platform reasons we are re-writing parts of our main application using C++, including the indexing. Until recently it had been written in .Net, and we were using Lucene.Net and the SnowballAnalyzer.
Is there a snowball analyser for CLucene? The link on the FAQ site to the CLucene sandbox is broken, is this still a viable project?

Cheers.
------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013 
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Resolve compile problems with /ext include

Jan Engelhardt — 2013-01-25T01:58:14

The following changes since commit 4f62f2a90ecbea0d6d14e4bc0902056996144023:

  Merge branch 'ConstantScoreQuery_BugFix' (2012-12-14 11:50:42 +0100)

are available in the git repository at:


  git://git.inai.de/clucene master

for you to fetch changes up to 78439b9688927c4dcd89f10c2090d10a8dbbb074:

  clucene: avoid causing compile failures in downstream users (2013-01-25 02:56:22 +0100)

----------------------------------------------------------------
Jan Engelhardt (1):
      clucene: avoid causing compile failures in downstream users

 src/core/libclucene-core.pc.cmake |    3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d

Problems in SloppyPhraseScorer.cpp

cel tix44 — 2013-01-08T09:26:36

Team

Looks like there are two problems in SloppyPhraseScorer.cpp:

1) checkedRepeats doesn't get initialized in the constructor and has
varying values upon entry into initPhrasePositions() -- noticed in the
Debug vs Release mode.

This is inherited from the Java code, which doesn't have this
initialization either.

Easily fixed by adding checkedRepeats = false; to the SloppyPhraseScorer
constructor.

2) std::qsort(repeats, repeatsLen, sizeof(PhrasePositions*),
comparePhrasePositions);

For some reason, comparePhrasePosition is receiving (x,y) with unexpected
(apparently random) values in the offset field.

Unable to suggest a fix -- as a stopgap, just replaced std::qsort with
std::sort -- as follows:
std::sort(repeats, repeats + (repeatsLen-1), comparePhrasePositions);

No idea if / how these changes will affect tests.

Regards
Celto
------------------------------------------------------------------------------
Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS
and more. Get SQL Server s

Compiling issues CLucene Windows 7 64 bit x86

Jonas — 2013-01-03T20:53:26


During several days I am trying to compile CLucene on Windows 7 64 bit without
success.

I searched all over the internet but did not find a solution for my problem.

I will describe all steps which I took and hope somebody can help me further.

    I downloaded CLucene and extracted it to the folder
C:/Users/Gerda/Downloads/clucene-core-2.3.3.4/clucene-core-2.3.3.4

    I created the out of source build directory C:/CLucene

    I installed boost 1.40 using the binary installer from boostpro computing

    I installed Cmake 2.8.10

    I started a regular windows command line prompt and entered

    set BOOST_BUILD_PATH=C:\Program Files (x86)\boost\boost_1_40\tools\build\v2
set BOOST_PATH=C:\Program Files (x86)\boost set BOOST_ROOT=C:\Program Files
(x86)\boost\boost_1_40

    I start cmake Gui and set the folders to the ones I mentioned in 1 and 2. I
select Microsoft Visual Studio 9 compiler.

After clicking configure I get the following error message: CMake Error: CMake
was unable to find a build program

clucene-core-2.3.3.4 build issue in ubuntu

Saiful Khan — 2012-12-30T21:19:14

Dear All,

Sorry to overload your mailbox. I am unable to build and install CLucene
2.3.3.4 in ubuntu 12.04. Request your help. -Thanks.
The command and output as follows.

*$ clucene-core-2.3.3.4/build-linux$ cmake -G "Unix Makefiles" ../

clucene-core-2.3.3.4 build issue in ubuntu

Saiful Khan — 2012-12-30T20:06:13

Dear All,

I am new to CLucene and I want to build and install
clucene-core-2.3.3.4 in my Ubuntu-12.04LTS machine. I do need this IR
system for academic research purpose and over the next several years I
am looking forward to contribute to it.

However, at the very first step while trying to configure it I am
getting the following error. Please let me know if you need more
information. Humbly request your quick response.  -Thanks



Compiling as RelWithDebInfo
CMake Error at src/shared/cmake/MacroMustDefine.cmake:45 (MESSAGE):
  wcslen could not be found
Call Stack (most recent call first):
  src/shared/CMakeLists.txt:97 (CHECK_REQUIRED_FUNCTIONS)

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu

BitSet::nextSetBit very inefficient for sparse bitsets

Kostka Bořivoj — 2012-12-12T14:27:11

BitSet::nexSetBit is implemented very inefficient way for sparse bit sets. It searches for next bit set by per-bit iteration and bit shifting
See OPTIMIZED_BITSET branch for better solution. It is approximately 8 times faster. It could be still improved (probably 4 times faster) by 
using uint32_t instead of current uint8_8 array, but it needs deeper changes.
Borek

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d

Getting link error

Rajeev kumar Singh — 2012-12-06T17:35:37

Hello CLucene Developers,

I am requesting you to help me in resolving this issue with CLucene.

This is first time i am using CLucene.

I have created a solution out of CLucene and copied the "include" and "lib"
folder to my application (ASCII supported only)  and i am accessing
CLucene.h and the libraries to access the CLucene.

When i am building (make or rebuild) my application folder i am getting
this (pasted at end) error.
I also created an independent solution like demo project and was able to
access well but not sure why i am getting link error here.
the lib but after re-checking all i am not able find any issue.


Please help. i might not have provided entire context but some at least so
please let me know if you need some more info.
I am using VS2008


Error:
xxxxxx.obj : error LNK2001: unresolved external symbol "public: virtual
bool __thiscall lucene::store::RAMDirectory::list(class
stlpd_std::vector<class stlpd_std::basic_string<char,class
stlpd_std::char_traits<char>,class stlpd_std::allocator<

Contrib lib build

Vitaly Artemov — 2012-11-25T13:09:03

Hi all,
I unable to build contrib library on Windows 7 64 bit.
I created clucene-contribs-lib solution(Visual Studio 2010) using CMAKE UI.
I added clucene-core.lib and clucene-shared.lib as additional dependencies.
But then I try to build it I get multiple link errors:
LanguageBasedAnalyzer.obj : error LNK2001: unresolved external symbol
"public: virtual class lucene::analysis::TokenStream * __cdecl
lucene::analysis::Analyzer::reusableTokenStream(char const *,class
lucene::util::Reader *)" (?reusableTokenStream< at >Analyzer< at >analysis< at >lucene
< at >< at >UEAAPEAVTokenStream< at >23< at >PEBDPEAVReader< at >util< at >3< at >< at >Z) ...
...
...
C:\Tools\Clucene\clucene-core-2.3.3.4\windows_x64_contrib\Release\clucene-contribs-lib.dll
: fatal error LNK1120: 34 unresolved externals

It's seems that it for some reason clucene-contribs-lib can't find exports
from clucene-core.lib.

Thanks in advance, Vitaly
------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web c

Creating CLucene Index in a Database;Support for Asian languages

Vitaly Artemov — 2012-11-22T09:15:12

Hello all,
I starting to evaluate Clucene engine for using in our product.
I have 2 questions.

1. Is It planned to add support(or it already exists) for creating index in
the Database instead of memory or filesystem?
    I read that java Lucene has it by providing JdbcDirectory interface.

2. I read in the FAQ that:
 "CLucene is not limited to English, nor any other language. To index text
properly, you need to use an Analyzer appropriate for the language of the
text you are indexing. CLucene's default Analyzers work well for English.
There are a    number of other Analyzers in "CLucene Sandbox", including
those for Chinese, Japanese, and Korean."
   But "CLucene Sandbox" link is not works for some reason. Can you specify
link to Analyzers list?

Thanks in advance, Vitaly
------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infras

Bug in ConstantScorer

Kostka Bořivoj — 2012-11-15T15:10:00

Hi,

ConstantScorer destructor deletes bits returned by filter->bits() method (called in constructor)
without checking if filter->shouldDeleteBitSet() returns true.

This causes double deletion of bits in case the filter is derived from AbstractCachingFilter.

Proposed fix (in constantscorequery.cpp) attached


------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

problem building clucene-php

Paul Groeneweg | Pazion IT — 2012-10-25T07:40:00

LS,



We are trying to build/compile clucene for php (
http://pecl.php.net/package/clucene ) on a centos server ( 64bit ). For
this we had first installed the clucene-core and clucene-core-devel
packages. But no luck all errors. So we decided to build clucene ourselves.



This went ok, but the compiling of clucene for php again failed.  I think
it has to do that there is no /usr/local/include/CLucene/util/Misc.h, as
the error below states  “’Misc’ has not been declared”.



Can anybody help us out and see what is going wrong or how we can build the
clucene including this Misc.h?



The way we build clucene was



                Download tar.gz, unpacked

                Cd clucence

mkdir build && cd build

cmake ..

make

make install



Then we went to clucene-0.0.9 ( pecl package )



                Phpize

                ./configure

                Make    ( here it went wrong see errors below )



/var/tmp/clucene/clucene.cpp:56: warning: deprecated conversion from string
constant to âcha

bit out of range

Ahmed — 2012-10-05T08:53:56

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

TODO List?

Atul Kulkarni — 2012-08-14T23:49:54

Hi All,

I recently stumbled upon CLucene and am wondering if this is actively
developed anymore? Also, is there a TODO list that I can look at to pickup
a bug or something like a bug tracker to help me pickup something simple to
start with?

Ordering results

Mike Aubury — 2012-07-20T11:42:05

I am doing a query and want to sort all the matched data by one of the
fields (date).

Whats the best way of doing this ?


The search will potentially match a lot of rows - so for performance I've
subclassed HitCollector and am adding all the returned documentIDs to a
list of integers if that makes any difference :


 reader = IndexReader::open(...);
 q = QueryParser::parse(...);
 s = new IndexSearcher(reader);
 s->_search(q, NULL, &hc);





class myHitCollector : public HitCollector {

private :
       list<int32_t> hitList;

public:
        int hitListCount;

        myHitCollector() : HitCollector() {
                clear();
                hitListCount=0;
        }

        void clear() {
                hitList.clear();
        }

        void push(int32_t doc) {
                hitList.push_back(doc);
                hitListCount++;
        }

        int  pop() {
                int32_t doc=hitList.front();
                hitList.pop_front();
                hitListCount--;
                return