gmane.comp.cms.fedora-commons.devel

[fcrepo-dev] Question regarding some statistics.

Asseg, Frank — 2012-05-25T11:23:42

Hola Guys!

We're currently gathering some numbers regarding the performance of 
akubra-hdfs compared to the default akubra-fs implementation.
  All the numbers we gathered show an expected rise in e.g. ingest times 
when using akubra-hdfs.
  But when measuring the retrieve times with a sample set of small files 
(0.15MB - 2.1 MB) of 18000 files the results show a unintuitivly better 
result for akubra-hdfs compared to the default akubra implementation.
  Do you guys have an explanation for this behaviour?
  The only thing we could think of was that the HDFS Cluster does some 
caching and has better network latency than the local Harddisks.

I'll try to attach the images although i dont know if the list policy 
allows it ;)

Thanks!

Frank

[fcrepo-dev] m2e, generated classes and lifecyclemapping

frank asseg — 2012-05-11T14:45:36

Hola guys,

To get rid of eclipse errors the following additions to poms worked for me:

for CXF's generated classes the following helped:

in fcrepo-common/pom.xml i added the following as stated in the SO 
question at 
http://stackoverflow.com/questions/7160006/m2e-and-having-maven-generated-source-folders-as-eclipse-source-folders

<plugin>
  <groupId>org.codehaus.mojo</groupId>
  <artifactId>build-helper-maven-plugin</artifactId>
  <executions>
   <execution>
    <id>add-source</id>
    <phase>generate-sources</phase>
    <goals>
     <goal>add-source</goal>
    </goals>
    <configuration>
     <sources>
      <source>${project.build.directory}/generated-sources/cxf/</source>
     </sources>
    </configuration>
   </execution>
  </executions>
</plugin>



for the lifecycle mapping errors changing fcrepo-server/pom.xml 
according to this: 
http://wiki.eclipse.org/M2E_plugin_execution_not_covered#ignore_plugin_goal
did the trick

<pluginManagement>
  <plugins>
   <plugin>
    <groupId>org.eclipse.m2e</gr

[fcrepo-dev] fcrepo-1023 && null nodes

frank asseg — 2012-05-11T10:39:52

Hola guys!

When implementing a SparqleW3CTupleWriter for 
https://jira.duraspace.org/browse/FCREPO-1023 in Trippi, which i 
basically copied from SparqlTupleWriter, i stumbled upon this null check in
https://github.com/fcrepo/trippi/blob/master/trippi-core/src/main/java/org/trippi/io/SparqlTupleWriter.java 
at line 55:

...
Node n = result.get(names[i]);
if ( n == null ) {
     m_out.println(" bound=\"false\"/>");
} else if ( n instanceof URIReference ) {
...

Im not quite sure how to handle this null checks in a Tuple Writer 
conforming to the docuemtnation at http://www.w3.org/TR/rdf-sparql-XMLres/


Can you give me a hint on how to handle these null nodes?

[fcrepo-dev] Search both diacritics and non-diacritics

Frank Feng — 2012-05-08T14:43:51

Hi all,

I'm developing a fedora search interface, and want to search both with and
without diacritics, for instance, if I search 'revesz', it will response
both 'revesz' and 'révész'. I've tried to configure solr to use
ASCIIFoldingFilterFactory <http://t.co/qEWsS9ko> but cannot get it working.
Any suggestions would be appreciated and a working solr config file will be
very helpful.

thanks,

Frank
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
Fedora-commons-developers mailing list
Fedora-commons-developers-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f< at >public.gmane.org
https://lists.sourceforge.net/lists/listinfo/fedora-commons-

[fcrepo-dev] ANN: Fedora Office Hours

Chris Wilper — 2012-05-01T18:01:36

Hi all,

I've been thinking a lot lately about how best to serve the Fedora
developer community and have been impressed with the Office Hours
concept that Matt Zumwalt has been spearheading[1] in the Hydra
community. So I've decided to do something similar, starting this
week.

Here's how it will work:

Starting this Thursday, after the Fedora committer call, I'll be
spending the remainder of the business day ('till 5pm US Eastern time)
in the #duraspace IRC channel on Freenode. The main purpose will be to
support the work of Fedora committers, contributors, and integrators.
Got a dev question or just an idea you want to bounce off someone?
Stop by and let's talk about it.  As with all irc traffic in
#duraspace, public logs will be automatically made available at
http://irclogs.duraspace.org/

More specifics (and info about my availability, which will change if
I'm traveling, etc.) can always be found here:

https://wiki.duraspace.org/display/~cwilper/Fedora+Office+Hours

Hope to see you there!

- Chris

[1]

[fcrepo-dev] My foxmlToSolr.xsl is breaking Tomcat

Remi Malessa — 2012-04-27T11:03:55

Hi

In my current project I keep datastreams (METS, RELS-EXT, ALTO) as 
'Managed' content.
I created a Servlet  that fetches a datastream when requested, so in my 
foxmlToSolr.xsl I call the servlet
something like this:

<xsl:variable name="QueryString" 
select="concat('http://server:8080/servlet_path/datastream_name', $PID)"/>
<xsl:variable name="articleText" 
select="document($QueryString))/servletResponse/content/text()"/>

or:

<xsl:variable name="articleText" 
select="document(concat('http://server:8080/servlet_path/datastream_name', 
$PID)))/servletResponse/content/text()"/>

tried both...and It works fine with METS, RELS-EXT, but when I add a 
request for ALTO to the XSLT, Tomcat fails to start-up.

The last lines in the log are always:

16:27:35.870 [main] DEBUG org.apache.axis.AxisEngine - Exit: 
AxisEngine::init
16:27:35.871 [main] DEBUG o.a.a.s.DefaultAxisServerFactory - Exit: 
DefaultAxisServerFactory::getServer
16:27:35.871 [main] DEBUG o.a.axis.transport.http.AxisServlet - Exit: 
getEngine()

.

[fcrepo-dev] Correction: Islandora Announces 12.1.0 Release

David Wilcox — 2012-04-26T18:32:39

*The previous announcement referred to Islandora 11.3.0 in the subject
line, but the new version is actually 12.1.0. Sorry for the
confusion!*

We are pleased to announce the release of Islandora 12.1.0!

You can check out the release notes and download all available modules
from http://islandora.ca/download, or test drive the release at
http://sandbox.islandora.ca.

Islandora 12.1.0 features a beta version of the new Video Solution
Pack, along with improvements to the Collection Manager, Harvester,
and Solr modules. A number of bugs have also been fixed in this new
version. You can read about all the changes in the release notes:
https://wiki.duraspace.org/display/ISLANDORA6121/Release+Notes+and+Downloads.

The documentation is undergoing updates to match this version of
Islandora. You can find it here:
https://wiki.duraspace.org/display/ISLANDORA6121.

Please report any issues to the google developer
(http://groups.google.com/group/islandora-dev) or users
(http://groups.google.com/group/islandora) lists, o

[fcrepo-dev] Islandora preconference at ALA June 22 - spaces still available - ALA registration not required

Kirsta Stapelfeldt — 2012-04-25T18:00:37

* Apologies for Cross Posting*

Interested in learning about the Islandora open-source digital asset
management system?  The Islandora team will be presenting a pre-conference
workshop at ALA suitable for new users and current implementers. Learn how
Islandora is simplifying the process of creating robust digital collections
and workspaces. Spots are limited, so sign up soon.

*Building Digital Collections Using Islandora*
Speaker: Mark Leggott, University of Prince Edward Island; Kirsta
Stapelfeldt, University of Prince Edward Island;

This session will introduce the key concepts underpinning the Islandora
Digital Asset Management system. Participants will learn the basics of
running this rich repository system and how to utilize common “solution
packs” to create and theme collections in Islandora. Participants will
learn how to begin modeling and curating custom data collections and how to
migrate from other repository systems, including ContentDM, DSpace and
more. Textbooks and system access will be p

[fcrepo-dev] FedoraGSearch locks and hogs file connections

Christian Rohrer — 2012-04-19T07:05:10

Hi list

I have recently upgraded our Fedora installation to 3.5 and GSearch (using Lucene) to 2.4.1.

Since this upgrade GSearch causes us problems. It keeps opening connections to the segmentation files, which remain open until the OS limit is reached, after which a restart of Tomcat is needed in order to close all open connection of GSearch. Has anybody else observed this behavior?

The other unusual thing (might be related?) are locks that throw error messages in the form:

dk.defxws.fedoragsearch.server.errors.GenericSearchException: Thu Apr 19 09:02:45 CEST 2012 IndexWriter new error indexName=ChorIndex :
; nested exception is: 
org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock< at >/opt/fedora35/indexer/ChorIndex/write.lock
at dk.defxws.fgslucene.OperationsImpl.getIndexWriter(OperationsImpl.java:695)
at dk.defxws.fgslucene.OperationsImpl.browseIndex(OperationsImpl.java:151)
at dk.defxws.fedoragsearch.server.RESTImpl.browseIndex(RESTImpl.java:267)
at dk.defxws.fedor

[fcrepo-dev] Job: Senior Developer, WGBH Media Library & Archives,Boston

Courtney Michael — 2012-04-18T15:07:56

*Please excuse cross-postings*

WGBH is looking for a creative and energetic Senior Developer to lead the development of a digital asset management (DAM) preservation system for the WGBH Media Library and Archives.

The Senior Developer will play a leading role in designing and implementing the architecture, workflows, and applications for WGBH MLA digital library services. The system will be based on the Hydra Project technology stack, which includes Ruby on Rails, Blacklight, Apache Solr, and the Fedora Commons repository. In addition, the Senior Developer will work on web based projects for the Media Library and Archives, including the implementation of a website to give scholars and researchers access to material in the WGBH Archive.

Working closely with the Media Library and Archive’s Director, Project Manager, and a WGBH Interactive Designer, the Senior Developer will specify, document and develop the technical architecture of a prototype digital asset management system for digital preservation. The

[fcrepo-dev] Fedora OAI-ORE exporter

alessia bardi — 2012-04-12T13:20:23

Dear all,

I am a PhD student and fellow researcher at CNR (Pisa, Italy).
My fields of interest include digital library and solution for data
interoperability.
I am currently investigating on solutions for OAI-ORE exports in Fedora
repositories.

I am aware of the oreprovider component (http://oreprovider.sourceforge.net/)
but it seems that the project is in beta version since 2008 and I could not
find any other tool on the offical Fedora web site.

Do you know any other software tool/plugin that extends Fedora with an
OAI-ORE exporter?
Links to softwares, documentation and articles or papers (even about on
going work) are welcome...

Thank you very much,

Alessia Bardi
------------------------------------------------------------------------------
For Developers, A Lot Can Happen In A Second.
Boundary is the first to Know...and Tell You.
Monitor Your Applications in Ultra-Fine Resolution. Try it FREE!
http://p.sf.net/sfu/Boundary-d2dvs2_______________________________________________
Fedora-commons-developers

[fcrepo-dev] Laboring at FESL/Spring integration

Benjamin Armintor — 2012-04-09T22:33:06

I'm still tilting away at this.  One of the stumbling blocks is Axis
1.x.  https://jira.duraspace.org/browse/FCREPO-452 has been out there
for a while.  I also thought there was a GSOC project on the switch to
CXF.  What's the state of that?  Should I just do an upgrade to Axis2
for 3.6, and leave CXF for 4.0?

- Ben

------------------------------------------------------------------------------
For Developers, A Lot Can Happen In A Second.
Boundary is the first to Know...and Tell You.
Monitor Your Applications in Ultra-Fine Resolution. Try it FREE!
http://p.sf.net/sfu/Boundary-d2dvs2

[fcrepo-dev] Update: OR2012 deadline for Posters, Pecha Kuchas, and Demos is April 11

Dunn, Jon William Butcher — 2012-03-29T21:46:40

Just an update: The deadline for poster, Pecha Kucha, and demo submissions to OR12 has been pushed back to Wednesday, April 11, but please go ahead and submit your proposal via the conference system as soon as it's ready.

As a reminder, if you are submitting a Pecha Kucha for the Fedora User Group track specifically, please follow the instructions below.

Jon

From: Dunn, Jon William Butcher
Sent: Tuesday, March 27, 2012 3:36 PM
To: 'hydra-tech-/JYPxA39Uh5TLH3MbocFFw< at >public.gmane.org'; 'hydra-users-/JYPxA39Uh5TLH3MbocFFw< at >public.gmane.org'
Subject: Reminder: OR2012 deadline for Posters, Pecha Kuchas, and Demos is this Saturday

Fedora community:

This is just a reminder that the deadline for submission of proposals for posters, Pecha Kuchas (short talks, similar to lightning or 24x7 talks), and demonstrations to Open Repositories 2012 is coming up this Saturday, March 31. For more information, and for access to the online submission system, please visit the OR2012 web site at http://or2012.ed.ac.uk/

IMPORTA

[fcrepo-dev] fcrepo-store-jcr and transactions

Chris Wilper — 2012-03-28T20:10:24

Hi all,

Just wanted to update you on most recent developments in the
fcrepo-store experiments:

1) I changed the API to be session-oriented so impls can delegate to
underlying sessions/connections more efficiently. For example, the
AkubraFedoraStoreSession impl delegates to injected instance-wide
BlobStoreSessions rather than allocating new sessions on a per-request
basis.
2) I added a JCR impl and tested with Jackrabbit:
 http://cwilper.github.com/fcrepo-store/apidocs/com/github/cwilper/fcrepo/store/jcr/JCRFedoraStore.html

As mentioned before, I think the main benefit of having a JCR-based
Fedora storage layer impl is that if the configured JCR impl is
transactional and we're using it to store all repository state (Fedora
objects and managed datastreams), it makes it much easier to expose
Fedora itself as a transactional resource.

With that goal in mind, I started some test code to see how
programmatic transaction management might be done with
fcrepo-store-jcr:

https://github.com/cwilper/fcrepo-store/bl

[fcrepo-dev] Reminder: OR2012 deadline for Posters, Pecha Kuchas, and Demos is this Saturday

Dunn, Jon William Butcher — 2012-03-27T19:33:28

Fedora community:

This is just a reminder that the deadline for submission of proposals for posters, Pecha Kuchas (short talks, similar to lightning or 24x7 talks), and demonstrations to Open Repositories 2012 is coming up this Saturday, March 31. For more information, and for access to the online submission system, please visit the OR2012 web site at http://or2012.ed.ac.uk/

IMPORTANT: In addition to the general conference Pecha Kucha track, there will be a specific track for Pecha Kucha presentations as part of the Fedora User Group sessions at the conference. If you would like to submit your Pecha Kucha proposal specifically for consideration as part of the Fedora User Group track, please list 'Fedora' as one of the keywords in your submission, and also add a note in the 'Remarks to programme committee' field that it is a submission for the Fedora User Group track.

For more information on what a Pecha Kucha presentation is, see the following blog post on the OR2012 web site: http://or2012.ed.ac.uk/2012/

[fcrepo-dev] daemon launch script for Fedora Commons on RHEL

Pottinger, Hardy J. — 2012-03-21T19:42:05

Hi, I've been doing a bit of googling, and am working off the one example
daemon launch script for RHEL I've found, which is here:

http://asingh.com.np/blog/fedora-commons-installation-and-configuration-gui
de/

Though I'm a bit concerned that this example script has the embedded
Tomcat server running as the root user. I'm also cribbing off the
Islandora Ubuntu daemon launch script, and that version does use an
unprivileged user, "fedora", for running the embedded Tomcat server. And,
before I get all creative, I know some people are having luck using jsvc
to run Tomcat as another user, so, anyway, I figure I better ask if anyone
is already running Fedora Commons on RHEL, and if so, would you mind
sharing your daemon launch script? Thanks!

--
HARDY POTTINGER <pottingerhj-Ejzj3ReGi3n2fBVCVOL8/A< at >public.gmane.org>
University of Missouri Library Systems
http://lso.umsystem.edu/~pottingerhj/
https://MOspace.umsystem.edu/
"A child who does not play is not a child,
but the man who doesn't play has lost forever
the

[fcrepo-dev] FCREPO-787 and External Datastream Resolution Security

Benjamin Armintor — 2012-03-20T15:00:39

Hello,
  I've written up some tests and arrived at several possible
approaches for https://jira.duraspace.org/browse/FCREPO-787, and
wanted to solicit some input about which is preferable.

The Problem: In short, Fedora often cannot checksum external
datastreams (type E) with file uris (dsLocation='file://...') because
of a XACML prohibition.  This is because the the action for retrieving
file content is checked as part of the API-M interface, but the
security context has no request attributes.  This runs afoul of the
policies many installations have restricting API-M actions to
localhost, or other addresses specified in a policy (and, in fact the
default policy).

Possible solutions:
1. Change the default XACML policy restricting API-M to allow the file
retrieval actions without a client IP.  This may be a difficult change
to communicate to installations that are overriding that policy.

2. Mimic a request context for the file retrieval action.  This
requires the least configuration change, but raises the q

[fcrepo-dev] Testers wanted for a new Fedora storage utility

Chris Wilper — 2012-03-19T21:25:32

Hi all,

As a follow-on to the utility I mentioned on last week's call, I got
some basic things working (migrating from legacy->akubra or
akubra->akubra, migrating inline xml to managed content, with proper
XML canonicalization and fixity setting) and did a little writeup on
the utility I mentioned here:

https://wiki.duraspace.org/display/~cwilper/A+New+Fedora+Storage+Utility

Short term, I'm thinking that we can point people who want to migrate
from legacy storage to akubra, or who were bitten by FCREPO-1062 to
this utility. After playing around a bit with defining and combining
filters, I think the approach also has quite a bit of potential for
some powerful batch editing, but before recommending it to anyone, I'd
like to get a few more Fedora-developer-type-eyeballs on it.

Please give it a spin and let me know any comments. Not much in the
way of docs now, but if you're familiar with spring and you look at
the examples on the page above, you should be able to figure out how
it hangs together and how it

[fcrepo-dev] fcrepo-store-util example using multiple filters

Chris Wilper — 2012-03-15T17:09:01

I mentioned that using multiple filters with fcrepo-store-util as a
sort of 'pipeline' was possible during the call today, but didn't have
an example on hand. I just committed one, fyi:

https://github.com/cwilper/fcrepo-store/commit/c62f603437f04a41fa389a615c4f93b8962286cc

NOTE: this utility is still under early testing; so if you want to try
it out (against a non-critical repo or backup of your repo, of
course), I've deployed a snapshot release here:

https://oss.sonatype.org/content/repositories/snapshots/com/github/cwilper/fcrepo-store/fcrepo-store-util/0.1.0-SNAPSHOT/fcrepo-store-util-0.1.0-20120315.163213-1-install.tar.gz

After unpacking it:
1) see config/config.properties and set the path of the default
'akubra' (or 'legacy' if pre-akubra) to the appropriate directories in
your repository.
2) to list everything in your repo, run the following:
  bin/fcrepo-store-util list akubra all unfiltered
3) to list everything but demo objects in your repo (employing the
multi-filter noted above), run the follo

[fcrepo-dev] DST in US - Committer Mtg Time Change

Chris Wilper — 2012-03-15T11:34:57

Just a reminder that Daylight Saving Time began in the US last
weekend. Accordingly, we are now meeting at 09:00 UTC-4 instead of
UTC-5 (one hour LATER). To be sure, see the timeanddate link on the
agenda page, which I think I actually got right this time.

https://wiki.duraspace.org/display/FCREPO/2012-03-15+-+Fedora+Committer+Meeting

- Chris

------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure

[fcrepo-dev] working around maven.glassfish.org downtime

Benjamin Armintor — 2012-03-14T15:38:43

Apparently Oracle is doing some kind of infrastructure work, and
maven.glassfish.org is down. This causes problems with fresh builds of
fcrepo, but you can workaround them following the instructions at:
 https://wikis.oracle.com/display/GlassFish/FullBuildInstructions#FullBuildInstructions-Unabletobuildbecausemaven.glassfish.orgisoffline

regards,
  Ben

------------------------------------------------------------------------------
Virtualization & Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing 
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/