gmane.comp.apache.uima.general

Ruta - Token Order

2013-05-21T10:47:43

Hi,

In Ruta 2.0.2-SNAPSHOT a token with begin offset 0 and end offset 2 comes before a token with begin offset 0 and end offset 0. The token order is not as I expected. Thus in my case, SourceDocumentAnnotation was the second token in the token sequence and the rule didn't match. It took me some time to find that out. The end offset of SourceDocumentAnnotation should better be the length of the text. How is the token ordering defined?

Cheers,
Armin

AW: Ruta 2.0.2 - Grouping Problems

2013-05-21T07:31:23

Hi Peter,

It works. Thank you very much.

Armin 


-----Ursprüngliche Nachricht-----
Von: Peter Klügl [mailto:pkluegl-Gq2KvKmhYTk8VN8EhmRbyw< at >public.gmane.org] 
Gesendet: Freitag, 17. Mai 2013 17:19
An: user-HHKbSdsD6WQPKjDvHGQMeg< at >public.gmane.org
Betreff: Re: Ruta 2.0.2 - Grouping Problems

Hi,

the problem should be fixed now.

Best,

Peter


On 17.05.2013 12:53, Peter Klügl wrote:

Ruta 2.0.2-SNAPSHOT - Eclipse Plugin Installation

2013-05-21T07:18:15

Hi!

I've checkout Ruta 2.0.2-SNAPSHOT with

svn checkout https://svn.apache.org/repos/asf/uima/sandbox/ruta/trunk

and build it succesfully with

mvn clean install.

Now, how to install the Eclipse plugins? Is there a local reposity or update site for Eclipse? Or, which files need to be copied manually?

Thanks,

Armin

Concept Mapper in code

harshal patni — 2013-05-21T06:49:06

Hello Everyone,
                   I am currently writing ConceptMapper in code (not using
XML files). Basically I am definitely AnalysisEngineDescriptions and
TypeSystem Description in java code. I create the following 2 parameters
using "ConfigurationParameter" class.

   1. AttributeList
   2. FeatureList

The problem is both these should be arrays. But ConfigurationParameter only
provide the  following types (String, Boolean, Integer, Float). When I pass
these values as string it fails and throws a java.lang.ClassCastException
error. COz it expects an array vs a String.  How should I solve this issue?
Below is the AnalysisEngineDescription code.
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

primitiveDesc = new AnalysisEngineDescription_impl();

 primitiveDesc.setPrimitive(true);

 primitiveDesc.getMetaData().setName("Concept Mapper Offset Tokenizer");

 primitiveDesc.setAnnotatorImplementationName(
"org.apache.uima.conceptMapper.Co

Re: Aggregate Delegates and Remote Services

Eddie Epstein — 2013-05-20T22:54:42

The CDE does not support adding the JMS service descriptor as a "remote",
only by editing the source directly. An example JMS service descriptor is
at
http://uima.apache.org/d/uima-as-2.4.0/uima_async_scaleout.html#ugr.async.ov.concepts.jms_descriptor
.

The aggregate could then be deployed with async=false. This can be useful
if the aggregate is to be replicated in the service, i.e. multiple
instances each deployed in a separate thread.

A JMS descriptor is not needed if the aggregate is deployed with
async=true. Note that a remote delegate is itself always a primitive, so
async=false for it.

The ability of UIMA-AS to directly support pear file descriptors was only
just added in the last month. If the pear is unpacked and the normal
aggregate descriptor is being used then we need more data. Including the
aggregate and deployment descriptors here would help.

Eddie




On Mon, May 20, 2013 at 4:56 PM, GATE User <gateuser-DaQTI0RpDDMAvxtiuMwx3w< at >public.gmane.org> wrote:

Re: Changing the original text based on annotations

GATE User — 2013-05-20T21:01:02

Thanks Richard and Peter:

What I want to be able to do is, when the xml is returned, a program should then be able to find the "corrected" message and use that for future operations.  Will using views allow this?  Is it simply easier to just make a new CAS?  Thanks again.

________________________________
 From: Richard Eckart de Castilho <richard.eckart-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org>
To: user-HHKbSdsD6WQPKjDvHGQMeg< at >public.gmane.org; GATE User <gateuser-DaQTI0RpDDM< at >public.gmane.orgm> 
Sent: Monday, May 20, 2013 4:42 AM
Subject: Re: Changing the original text based on annotations

Hi,

UIMA doesn't allow text to be changed, but you can create a new view with new text. 

When I needed that, I implemented a set of annotations to mark text as "to be inserted/deleted/changed",
e.g. based on the results of a spell checker. Then I run an annotator which interpreted all
these annotations an created a new view with the updated text. Subsequent annotators would
work on the new view then.

What I hav

Aggregate Delegates and Remote Services

GATE User — 2013-05-20T20:56:00

I've created two primative AEs and tested them locally on my machine.  I then created a aggregate AE that calls each of the primitive AEs.  The aggregate AE was created using the Component Descriptor Editor plugin for eclipse and things went smoothly until I got to adding the Aggregate Delegates.  I clicked on remote, but I' then prompted to select either the SOAP or Vinci protocol.  The two primatives have been deployed and are running on a test AS system (2.4.1).  Which protocol should I be using, if either?

Since I wasn't sure which protocol to use, I made a copy of the AE descriptors for each of the primatives and added those using the "Add..." button.  Then, in the deployment descriptor for the aggregate AE, I set the delegates to run remotely and gave it the address of the broker and the queue name.  After creating the pear and deploying it, the aggregate AE deploys fine, but errors pop up when we try to run it.  The errors are:

      *** ERROR: line-number: 13 deployment descriptor for

Re: Changing the original text based on annotations

Peter Klügl — 2013-05-20T10:37:27

Hi,

UIMA Ruta (originally released as UIMA TextMarker) provides 
functionality for modifications in the document (in a new view) and for 
transforming the offsets of the annotations when the document is 
changed. However, both are not yet linked.

There is a short introduction in modification in the documentation (last 
paragraph):
http://uima.apache.org/d/textmarker-current/tools.textmarker.book.html#ugr.tools.tm.overview.examples

Just let me know, if you need more detailed information.

Best,

Peter


Am 20.05.2013 04:21, schrieb GATE User:

Re: Changing the original text based on annotations

Richard Eckart de Castilho — 2013-05-20T08:42:40

Hi,

UIMA doesn't allow text to be changed, but you can create a new view with new text. 

When I needed that, I implemented a set of annotations to mark text as "to be inserted/deleted/changed",
e.g. based on the results of a spell checker. Then I run an annotator which interpreted all
these annotations an created a new view with the updated text. Subsequent annotators would
work on the new view then.

What I have done on this in the past is published as

Eckart De Castilho, Richard, and Iryna Gurevych. 
"DKPro-UGD: A Flexible Data-Cleansing Approach to Processing User-Generated Discourse." [1]

The latest version of the components described there is available in DKPro Core [2].

Cheers,

Changing the original text based on annotations

GATE User — 2013-05-20T02:21:09

1)  How do I change the original message based on annotations in UIMA.  For example, lets say I have the string:
201301012345

That contains both the date and time.  I want to have an annotator that will find such things in the text and add a space between them so it becomes:
2030101 2345

What's the easiest way to modify the text in this instance?

Also, let's say I have the sentence:

See Spot run far down Main Street.

and I have an annotator that that finds and labels main street as a street name.  Now I want to make an annotator that, if it finds a street name annotation, to change that street name into something else, like River Blvd.  So the above sentence would be:

See Spot run far down River Blvd.

What's the easiest way to do this?  Will I, afterwards, have to resend the CAS through the pipeline again or is there an easy way to update all annotations that would be affected by the change since River Blvd is shorter than Main Street?

Thanks in advance.

Re: Ruta 2.0.2 - Grouping Problems

Peter Klügl — 2013-05-17T15:18:45

Hi,

the problem should be fixed now.

Best,

Peter


On 17.05.2013 12:53, Peter Klügl wrote:

Re: Ruta 2.0.2 - Grouping Problems

Peter Klügl — 2013-05-17T10:53:14

Hi,

sorry for that. I will fix it ASAP.

The last rule has only three rule elements, but that should not throw an
exception.

Best,

Peter

On 17.05.2013 12:34, Armin.Wegner-w0Tf80GBFXAb1SvskN2V4Q< at >public.gmane.org wrote:

Ruta 2.0.2 - Grouping Problems

2013-05-17T10:34:10

Hello!

Let A, B, C, D and F denote type names. Then, A B? C D{->MARK(F, 1, 4)} works.
A (B)? C D{->MARK(F, 1, 4)} causes a NullPointerException.
(A B)? C D{->MARK(F, 1, 4)} causes an ArrayIndexOutOfBoundException: -1.

Any ideas?

Cheers,
Armin

Re: Ruta - RETAINTYPE

Peter Klügl — 2013-05-16T12:32:19

Hi,

On 16.05.2013 14:21, Armin.Wegner-w0Tf80GBFXAb1SvskN2V4Q< at >public.gmane.org wrote:

yes, you can unfortunately not refer to parent types. I will open a bug
report for this. You need to add the actual type to the list.


The trunk contains the newest sources:
https://svn.apache.org/repos/asf/uima/sandbox/ruta/trunk

For maven-based projects, there is the jenkins build and the snapshot
repository. However, I do not actively use it myself:

<dependency>
      <groupId>org.apache.uima</groupId>
      <artifactId>ruta-core</artifactId>
      <version>2.0.2-SNAPSHOT</version>
      <scope>compile</scope>
</dependency>
...
<repository>
   <id>apache.snapshots</id>
      <name>Apache Snapshot Repository</name>
      <url>http://repository.apache.org/snapshots</url>
      <releases>
        <enabled>false</enabled>
      </releases>
</repository>


There is also the UIMA Ruta 2.0.1 RC2 right now:
https://repository.apache.org/content/repositories/orgapacheuima-015/
https://dist.apache.org/repos/dist/dev/uima/eclip

Ruta - RETAINTYPE

2013-05-16T12:21:35

Hello!

In Ruta SNAPSHOT-2.0.1 Document{->RETAINTYPE(ALL)}; does not retain SPACE. It is the same with ANY and WS.

By the way, where can I get the newest version of Ruta (jar, svn, etc)?

Cheers,
Armin

Re: About whether the UIMA supports Chinese

Richard Eckart de Castilho — 2013-05-15T09:24:44

Hi,


we have some support for Chinese in DKPro Core. 

DKPro Core ASL [1]:

- Tokenizer/segmenter using LanguageTool [2, 3]
- Part-of-speech tagger using TreeTagger [4, 5] (TreeTagger is research only)

DKPro Core GPL [6]:

- Part-of-speech tagger using Stanford NLP [7,8]
- Parser using Stanford NLP [7,9]
- Parser using Berkeley Parser [10, 11]

Some of these components may only be available in the SVN trunk version.

That said, we do not really work on Chinese data, so this is rather a proof-of-concept (checking character set works, models are loaded properly, etc). If you try it out and have feedback, please tell us :)

Re: Processing multiple CASes from different AAEs together

Richard Eckart de Castilho — 2013-05-15T08:07:44

Hi Mateusz,


I'd say there are approximately three general strategies:

1) Use reader which reads two sets of data and passes all combinations in views and an annotator which compares the view
2) Use reader which reads one set of data (initial view) and an annotator which reads the other set of data and compares
3) Do the comparison outside UIMA

With 1) you have the ability to run your pre-processing as part of the pipeline. Mind that you repeatedly pre-process all documents in your two sets, which is terribly inefficient.

With 2) at least one of the sets should already have been pre-processed, namely the one that is read by the annotator

With 3) you can use the same (or different) pre-processing pipelines for both sets, have a writer at the end which writes either XMI (or something alike) or which already writes an extract, e.g. feature vectors extracted from the documents. Then you load the XMIs or feature vectors in a separate little programm and compare them to each other.



I've seen people use 1)

Processing multiple CASes from different AAEs together

Mateusz Parzonka — 2013-05-09T20:57:30

Hello,

what is the best practice to process CASes resulting from multiple and 
different AAEs? Assume I have an AAE1 processing document collection 1 
and an AAE2 processing document collection 2. Now I would like to 
compare each tuple of the resulting CASes of AAE1 and AAE2 using a third 
AAE. My underlying intention is to "compare" each document in collection 
1 with each document in collection 2 using different preprocessing 
pipelines.

Is there some abstraction in UIMA to perform this? I saw an solution 
performing an n-cross-m comparison using two views where each view 
represented a different document. This works but seems a bit inflexible, 
assuming you need to configure different processing pipelines for each 
collection type.

Regards,
Mateusz

Re: collectionProcessComplete() in Multi Thread Process

Richard Eckart de Castilho — 2013-05-14T13:02:59

I assume you are using CPEs. Change your final annotator to inherit from uimaFIT's JCasConsumer_ImplBase or CasConsumer_ImplBase or add an < at >OperationalProperties annotation to your annotator:

< at >OperationalProperties(multipleDeploymentAllowed = false)

collectionProcessComplete() in Multi Thread Process

Andreas Niekler — 2013-05-14T12:50:38

Hello,

i have a Annotator that i want to run in a Multi Thread Task with
uimaFit. But i want to run the collectionProcessComplete() Method only
once when all instances are done with the collection. In the moment i
aggregate some data within the Annotator and the result is then written
to the disk n times (Thread Count). How can i run the process in
MultiThread Mode Method to Aggregate one member variable and than
process the aggregated member within the collectionProcessComplete() Method?

Thank you

Comparing each document from collection 1 with each document from collection 2

Mateusz Parzonka — 2013-05-10T12:59:36

Hello,

what is the best practice to process CASes resulting from multiple and 
different AAEs? Assume I have an AAE1 processing document collection 1 
and an AAE2 processing document collection 2. Now I would like to 
compare each tuple of the resulting CASes of AAE1 and AAE2 using a third 
AAE. Simply speaking, the intention is to "compare" each document in 
collection 1 with each document in collection 2 using different 
preprocessing pipelines.

Is there some abstraction in UIMA to perform this? I saw an solution 
performing an n-cross-m comparison using two views where each view was 
associated to a different document. This works but seems a bit 
inflexible, assuming you need to configure different processing 
pipelines for each collection type.

Regards,
Mateusz