gmane.comp.jakarta.lucene.clucene.devel

Bug found in FieldsReader::addFieldsForMerge

Kostka Bořivoj — 2013-05-13T14:04:47

Hi

I found a bug in addFieldsForMerge method. For bingy/compressed fields internal pointer from ValueArray is passed to FieldForMerge constructor instead of (correct) pointer to ValueArray object.

I uploaded propřed patch to GIT (branch addFieldsForMerge_BugFix)

Best regards

Borek

------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and 
their applications. This 200-page book is written by three acclaimed 
leaders in the field. The early access version is available now. 
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
_______________________________________________
CLucene-developers mailing list
CLucene-developers< at >lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clucene-developers

StandardAnalyzer Memory Leak Patch

Anthony Novatsis — 2013-05-10T00:43:25

Dear All,

I've detected some memory leaks using CLucene (version 2.3.3.4) and
tracked this down to the reusableTokenStream interface of the
StandardAnalyzer.

The StandardAnalyzer::SavedStreams object which is allocated on the
first call to reusableTokenStream is eventually deleted (using an
Object AbstractDeletor) but it does not have a destructor.  The
solution was to add a destructor as follows:

index 3275c1b..6836629 100644
--- a/clucene-core-2.3.3.4/src/core/CLucene/analysis/standard/StandardAnalyzer.cpp
+++ b/clucene-core-2.3.3.4/src/core/CLucene/analysis/standard/StandardAnalyzer.cpp
< at >< at > -54,6 +54,11 < at >< at > CL_NS_DEF2(analysis,standard)
             {
             }

+            ~SavedStreams()
+            {
+                _CLDELETE(filteredTokenStream);
+            }
+
             void close(){}
             Token* next(Token* token) {return NULL;}
         };

Could this patch be reviewed and incorporated into the master?

Thanks,
Anthony

---------------------------------------------------------

Re: Request for explanation of some code

Arnab — 2013-04-09T00:50:55

Thanks very much. This book mainly focuses on the APIs and usage of these
APIs. I am looking forward understanding the internal of the search engine
code.


On Mon, Apr 8, 2013 at 9:58 PM, Ahmed Saidi <ci7nusha-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org> wrote:

------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Re: Request for explanation of some code

Ahmed Saidi — 2013-04-08T20:58:22

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Request for explanation of some code

Arnab — 2013-04-08T20:42:31

Dear All,

I am a postgraduate student and I am not an expert in programming. I am
doing a project on search and want to implement some new ideas and test on
clucene.


It is a huge code and looks complicated too. If any one please explain me
the indexing process and the classes like FSDirectory, Field, Document,
IndexWriter  it will be really a great help at this moment.

Thanks
Arnab
------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

add

Arnab — 2013-04-08T20:35:29

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire 
the most talented Cisco Certified professionals. Visit the 
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Re: Multi-Threading on Kubuntu 12.04

Dino Korah — 2013-03-31T21:06:58

1p worth from me; please could you grab a trace for all threads.
i.e "thread apply all bt full" from gdb after attaching to the locked 
process.

That should help the diagnosis!


On 29/03/13 10:16, Ahmed Saidi wrote:

------------------------------------------------------------------------------
Own the Future-Intel(R) Level Up Game Demo Contest 2013
Rise to greatness in Intel's independent game demo contest. Compete 
for recognition, cash, and the chance to get your game on Steam. 
$5K grand prize plus 10 genre and skill prizes. Submit your demo 
by 6/6/13. http://altfarm.mediaplex.com/ad/ck/12124-176961-30367-2_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Multi-Threading on Kubuntu 12.04

Ahmed Saidi — 2013-03-29T10:16:01

------------------------------------------------------------------------------
Own the Future-Intel(R) Level Up Game Demo Contest 2013
Rise to greatness in Intel's independent game demo contest. Compete 
for recognition, cash, and the chance to get your game on Steam. 
$5K grand prize plus 10 genre and skill prizes. Submit your demo 
by 6/6/13. http://altfarm.mediaplex.com/ad/ck/12124-176961-30367-2_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

qmake clucene-core-2.3.3.4 errors

jomart mirza — 2013-02-23T13:48:12

 OK this new topics form me i tried to build the last core of clucene :

http://sourceforge.net/projects/clucene/files/latest/download?source=files

with cmake gui and i faced a lot of trouble then insted i used qmake to
build the core i used the last version open source qt5 with mingw support
and at firrst it worked then i after finishing i got two error :

folder to :

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Re: Snowball Analyzer

Scott Baldwin — 2013-02-05T10:51:33

Hi all, thanks, I found it in the contribs-lib folder.

Cheers.

From: Scott Baldwin [mailto:S.Baldwin-XNrqS/vMVe5TQssBIsK3P1aTQe2KTcn/< at >public.gmane.org]
Sent: Tuesday, 5 February 2013 12:24 PM
To: clucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
Subject: [CLucene-dev] Snowball Analyzer

Hi all, for cross platform reasons we are re-writing parts of our main application using C++, including the indexing. Until recently it had been written in .Net, and we were using Lucene.Net and the SnowballAnalyzer.
Is there a snowball analyser for CLucene? The link on the FAQ site to the CLucene sandbox is broken, is this still a viable project?

Cheers.
------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013 
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb_______________________________________________
CLucene-developers mailing list
CLucene-developers-5

Snowball Analyzer

Scott Baldwin — 2013-02-05T01:24:20

Hi all, for cross platform reasons we are re-writing parts of our main application using C++, including the indexing. Until recently it had been written in .Net, and we were using Lucene.Net and the SnowballAnalyzer.
Is there a snowball analyser for CLucene? The link on the FAQ site to the CLucene sandbox is broken, is this still a viable project?

Cheers.
------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013 
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

[PATCH] clucene: avoid causing compile failures indownstream users

Jan Engelhardt — 2013-01-25T01:58:15

`pkg-config clucene --cflags` is giving me -I/usr/include/clucene/ext,
which causes projects using both clucence and boost to fail in
compilation because ext/boost and the regular boost headers do not
match up.

(Using a system boost-1.49.0):

$ echo -en '#include <boost/filesystem.hpp>' | \
  g++ -x c++ $(pkg-config libclucene-core --cflags) -c -

In file included from /usr/include/boost/filesystem/v3/path.hpp:27:0,
                 from /usr/include/boost/filesystem.hpp:35,
                 from test.cpp:1:
/usr/include/boost/system/system_error.hpp:22:45: error: expected initializer before ‘:’ token
In file included from /usr/include/CLucene/ext/boost/detail/sp_typeinfo.hpp:103:0,
                 from /usr/include/CLucene/ext/boost/smart_ptr/detail/sp_counted_base_nt.hpp:21,
                 from /usr/include/CLucene/ext/boost/smart_ptr/detail/sp_counted_base.hpp:33,
                 from /usr/include/CLucene/ext/boost/smart_ptr/detail/shared_count.hpp:29,
                 from /usr/inclu

Resolve compile problems with /ext include

Jan Engelhardt — 2013-01-25T01:58:14

The following changes since commit 4f62f2a90ecbea0d6d14e4bc0902056996144023:

  Merge branch 'ConstantScoreQuery_BugFix' (2012-12-14 11:50:42 +0100)

are available in the git repository at:


  git://git.inai.de/clucene master

for you to fetch changes up to 78439b9688927c4dcd89f10c2090d10a8dbbb074:

  clucene: avoid causing compile failures in downstream users (2013-01-25 02:56:22 +0100)

----------------------------------------------------------------
Jan Engelhardt (1):
      clucene: avoid causing compile failures in downstream users

 src/core/libclucene-core.pc.cmake |    3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d

Problems in SloppyPhraseScorer.cpp

cel tix44 — 2013-01-08T09:26:36

Team

Looks like there are two problems in SloppyPhraseScorer.cpp:

1) checkedRepeats doesn't get initialized in the constructor and has
varying values upon entry into initPhrasePositions() -- noticed in the
Debug vs Release mode.

This is inherited from the Java code, which doesn't have this
initialization either.

Easily fixed by adding checkedRepeats = false; to the SloppyPhraseScorer
constructor.

2) std::qsort(repeats, repeatsLen, sizeof(PhrasePositions*),
comparePhrasePositions);

For some reason, comparePhrasePosition is receiving (x,y) with unexpected
(apparently random) values in the offset field.

Unable to suggest a fix -- as a stopgap, just replaced std::qsort with
std::sort -- as follows:
std::sort(repeats, repeats + (repeatsLen-1), comparePhrasePositions);

No idea if / how these changes will affect tests.

Regards
Celto
------------------------------------------------------------------------------
Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS
and more. Get SQL Server s

Re: Getting link error

Rajeev kumar Singh — 2013-01-07T08:04:16

Hi,

Thank you all for you suggestions.

Form error it look like that some kind of error in exporting the lib. I
re-check all the references and found ok.

Finally i tried another approach and it worked. I created another
independent solution using visual studio and there i was able to access the
libs. Here i also created two method to index and search and exported them.
This worked for me.

Although i am not sure the root cause of the issue but it look like some
problem related to  ASCII/Unicode  for my application and CLucene lib.
If anybody have more info around this problem then please share.



Once again thanks to all,
Rajeev.


On Sun, Jan 6, 2013 at 7:50 PM, Veit Jahns <nuncupatio-gM/Ye1E23mwN+BqQ9rBEUg< at >public.gmane.org>wrote:

Re: search key_words in log

Veit Jahns — 2013-01-06T14:23:33

Hi!

2012/12/6 Ji Cai <ji.cai-+sCGM1tQGJefgoIRHdQPquyrfmlZI2zM< at >public.gmane.org>:

Maybe you can use the highlighter contrib. With this contrib you can
retrieve the context of a found term. But I don't know, if this fits
your requirements.

Best regards

Veit

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_123012

Re: Getting link error

Veit Jahns — 2013-01-06T14:20:34

Hi,

just a guess: if it is a issue with the directories, should it be then
not more than three "unresolved externals" errors? To me sounds like a
problem with the export of these function from the dll file.

Rajeev, how die you created the files? Did you compile them by yourself?

Best regards,

Veit

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_123012

Re: Compiling issues CLucene Windows 7 64 bit x86

Veit Jahns — 2013-01-06T14:12:30

Hi Jonas,

did you execute set the environment variables for VS? The error
message sounds like CMake could not find VS. The best to doe would be
to execute the <VS folder>\VC\vcvarsall.bat and then cmake. Both on
the console.

Best regards

Veit

2013/1/3 Jonas <jonas.poelmans-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org>:

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_123012

Compiling issues CLucene Windows 7 64 bit x86

Jonas — 2013-01-03T20:53:26


During several days I am trying to compile CLucene on Windows 7 64 bit without
success.

I searched all over the internet but did not find a solution for my problem.

I will describe all steps which I took and hope somebody can help me further.

    I downloaded CLucene and extracted it to the folder
C:/Users/Gerda/Downloads/clucene-core-2.3.3.4/clucene-core-2.3.3.4

    I created the out of source build directory C:/CLucene

    I installed boost 1.40 using the binary installer from boostpro computing

    I installed Cmake 2.8.10

    I started a regular windows command line prompt and entered

    set BOOST_BUILD_PATH=C:\Program Files (x86)\boost\boost_1_40\tools\build\v2
set BOOST_PATH=C:\Program Files (x86)\boost set BOOST_ROOT=C:\Program Files
(x86)\boost\boost_1_40

    I start cmake Gui and set the folders to the ones I mentioned in 1 and 2. I
select Microsoft Visual Studio 9 compiler.

After clicking configure I get the following error message: CMake Error: CMake
was unable to find a build program

Re: clucene-core-2.3.3.4 build issue in ubuntu

Saiful Khan — 2012-12-30T22:50:34

Thank you very much. There could be some issue with the initial
checkout/build. A fresh checkout/build works fine in Ubuntu 12.04.



On Sun, Dec 30, 2012 at 9:50 PM, Ben van Klinken <bvanklinken-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org>wrote:

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_123012_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/clucene-developers

Re: clucene-core-2.3.3.4 build issue in ubuntu

Ben van Klinken — 2012-12-30T21:50:10

You are on 12.04 and you are getting that? Have you made any changes to
your compilers/environment which would cause that.

My first thought currently is that your cmake version is different (I'm
also on 12.04). I've got 'cmake version 2.8.7' when i run cmake --version

Otherwise try a clean checkout/build - maybe something went wrong?

Failing all that, please add --debug-output to the cmake when you do a
clean build

ben


On 31 December 2012 07:19, Saiful Khan <saiful.etc-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org> wrote:

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_123012_______________________________________________
CLucene-developers mailing list
CLucene-developers-5NWGOfrQmneR