gmane.text.xml.exist

HTTP 411 error using HTTP Client module (does it setContent-lenght header) ?

Stéphane S. — 2012-05-25T17:51:59

Hi,

I am trying to call a SOAP service (Paypal, using "post") with the send-request() method of the HTTP Client module in eXist, taking inspiration from this example [1]. However the result is that I get a "411 Length Required" error. Note that the request endpoint is an HTTPS endpoint ("https://api-3t.sandbox.paypal.com/2.0/").

Here is the beginning of the $req object that I send using http:send-request($req) :

<http:request href="https://api-3t.sandbox.paypal.com/2.0/" method="post">
   <http:header name="SOAPAction" value="SetExpressCheckout"/>
   <http:body media-type="text/xml">
   ...

Note that if I try to manually set a Content-length by adding a header to the request with an arbitrary value:

   <http:header name="Content-length" value="1000"/>

Then I get an exception from the HTTP Client module :

Error found
Error executing the HTTP method
Java Stack Trace:Class NameMethod NameFile NameLine
org.expath.exist.SendRequestFunctionsendRequestSendRequestFunction.java150

So I would like to know if the http:send-request method sets the Content-lenght header, and if not how to set it manually ?

Note that to import the HTTP Client module with eXist 1.4.1-rev15155, I had to comment the following lines in 'conf.xml' (taking ideas from this thread [2]), since otherwise XQuery throws an exception. I guess eXist 1.4.2. does not fix the problem either, since it still contains the old "http-client.xqm" module uncommented in conf.xml.

<!-- 
    EXPath Modules 
-->
<module uri="http://expath.org/ns/http-client" class="org.expath.exist.HttpClientModule" />        
<!-- <module uri="http://www.expath.org/mod/http-client" src="resource:org/expath/www/mod/http-client/http-client.xqm" />       -->

<!-- Native EXPath HTTPClient Module -->
<!-- <module uri="http://exist-db.org/xquery/httpclient" class="org.exist.xquery.modules.httpclient.HTTPClientModule" /> -->

When setting up conf.xml as above, you can then load the HTTP Client module without throwing an exception using:
import module namespace http = "http://expath.org/ns/http-client";

Thanks in advance for any help,

Stéphane S.
---

[1] http://www.expath.org/modules/http-client/samples#soap
[2] http://exist-open.markmail.org/thread/66naklwxfidvbht5


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: Installer fails to run in latest trunk

Wolfgang Meier — 2012-05-25T13:43:00

I found this information:

http://docs.codehaus.org/display/IZPACK/Unattended+Installations


Well, Java's support for the console is very limited. We'll have to
try again with IzPack 1.5, maybe it has improved.


Both. All documentation and examples will be moved into separate .xar
packages and the webapp directory will be nearly empty by default.
I'll start this cleanup once I have finished the last missing pieces.

Wolfgang

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: Installer fails to run in latest trunk

Efraim Feinstein — 2012-05-25T13:29:26

Hi,

I just rebuilt the installer on r16461, and using -console, I no longer 
get the ArrayBoundsException. The IzPack confirmation CLI UI would have 
made me thought it was hanging if you hadn't told me I needed to confirm 
it.

My use case involves running the installer inside a larger build. Is 
there any way to script the installation, so I don't get the 
confirmation prompts?

Also, this isn't important to me, but it's probably worth mentioning: 
the admin password is displayed a number of times on the console.

On 05/25/2012 09:08 AM, Wolfgang Meier wrote:

Good to know. Thanks for the heads up.
Is the 2.0.x branch expected to break, or just trunk?

Thanks!

Re: HTTPclient fetching json

Chris Wallace — 2012-05-24T23:30:51

It would be  a nice enhancement to support a JSON to XML conversion. At
present I'm using my own hack code (involves string replacing the marker
characters in the json text with xml text (eg {  to <div>  } to </div) and
then parsing the text to get XML) . Works fast on the json I getting from a
CKAN registry (why or why cant they just support XML! - I've asked and they
say there is no call  - sad)  The EXPath module is getting the binary file
without throwing errors so that's working well.

On Thu, May 24, 2012 at 10:14 PM, Joe Wicentowski <joewiz< at >gmail.com> wrote:

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
Exist-open mailing list
Exist-open< at >lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

Re: dom.dbx corrupt!?

Schouten, Sander — 2012-05-24T08:59:42

Hi Wolfgang,

Thanks for your answer.
I think these errors in the dom.dbx are there for a long time.
It's possible that the database was updated before I came on this project. Because of a problem with the user divined indexes we also noticed these errors. Now we know that this is not critical, we will plan a backup-restore when it's convenient.

Sander 

-----Original Message-----
From: Wolfgang Meier [mailto:wolfgang< at >exist-db.org] 
Sent: woensdag 23 mei 2012 21:45
To: Schouten, Sander
Cc: exist-open< at >lists.sourceforge.net
Subject: Re: [Exist-open] dom.dbx corrupt!?

Hi,


The error is not critical and does usually not require immediate
action. It is a failure in the dom index, but the document data itself
should not be affected. If you rely on query results for updating
documents, you may consider a backup/restore, just to be sure the
error has no unexpected side effects.

1.4.0 sometimes reported the error incorrectly. This has been fixed in
1.4.1 and I did not see the issue since quite some time. Did you
recently update from 1.4.0 to 1.4.1, keeping the old dbx files?

Wolfgang


Think green - keep it on the screen.
This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary material, confidential information and/or be subject to legal privilege. It should not be copied, disclosed to, retained or used by, any other party. If you are not an intended recipient then please promptly delete this e-mail and any attachment and all copies and inform the sender. Thank you. 
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: leave comments on web pages

Mr. Bean — 2012-05-25T07:40:08

Wolfgang that thread discussion feature sounds great.  I think our company
could also benefit from your efforts on this work

--
View this message in context: http://exist.2174344.n4.nabble.com/leave-comments-on-web-pages-tp4498104p4654132.html
Sent from the exist-open mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: Installer fails to run in latest trunk

Wolfgang Meier — 2012-05-25T13:08:58

Actually, IzPack does now support running the installer on the command
line, so we don't need our previous workaround anymore. I just
committed the necessary changes. You should be able to run the
installer like this:

java -jar installer/eXist-db-setup-2.1-dev.jar -console

The installer will guide you through the same options as in the GUI
version. User interaction is a bit tricky. I did not recognize that I
was supposed to confirm the JDK path by pressing enter and waited
minutes for something to happen ;-) Well, it does work if you know it.

Please note that there will soon be a major cleanup of the eXist-db
distribution. The installer may break again while we prepare for 2.0.

Wolfgang

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: HTTPclient fetching json

Peter Stadler — 2012-05-25T08:43:36

Hi Chris,

you can find the parser options at http://nekohtml.sourceforge.net/settings.html.
Last time I tried I succeeded with this syntax:
<options><property name="http://cyberneko.org/html/properties/default-encoding" value="UTF-8"/></options>

Nevertheless, there is no option to skip the parsing.

Best
Peter

Am 24.05.2012 um 19:25 schrieb Chris Wallace:

Re: Installer fails to run in latest trunk

Adam Retter — 2012-05-24T23:08:46

Wolf, I think commit 16364 was yours. Can you take a look please?

On 24 May 2012 23:41, Efraim Feinstein <efraim.feinstein< at >gmail.com> wrote:

Re: Installer fails to run in latest trunk

Efraim Feinstein — 2012-05-24T22:41:17

Yes, it worked. (I went back to r16363 and successfully installed).

Re: Installer fails to run in latest trunk

Adam Retter — 2012-05-24T22:37:19

Did the command line installer work before rev 16364. I did think it
was broken in trunk prior to that?

On 24 May 2012 23:32, Efraim Feinstein <efraim.feinstein< at >gmail.com> wrote:

Re: Installer fails to run in latest trunk

Efraim Feinstein — 2012-05-24T22:32:14

On 05/24/2012 06:19 PM, Adam Retter wrote:

I just tried it on an updated trunk. The build works. The command line 
install does not.

Re: Installer fails to run in latest trunk

Adam Retter — 2012-05-24T22:19:57

Temporary glitch. If you come up to the latest trunk, I know I could
build it on IzPack 4.3.5

On 24 May 2012 22:43, Efraim Feinstein <efraim.feinstein< at >gmail.com> wrote:

Re: Installer fails to run in latest trunk

Efraim Feinstein — 2012-05-24T21:43:25

Hi,

I looked into this a bit more. IzPack 4.3.3 does not work any better 
than any of the other versions, and it looks like the change in r16364 
is what broke the command line installer.

Thanks,
-Efraim

On 05/24/2012 03:04 PM, Efraim Feinstein wrote:

Re: HTTPclient fetching json

Joe Wicentowski — 2012-05-24T21:14:59

I haven't tried, but I don't see JSON in the list of supported modes
in EXPath HTTP Client:

  xml, text, html, xhtml, expath:base64, expath:hex

I'm getting these values from
http://code.google.com/p/expath-http-client/source/browse/trunk/java/http-client-java/src/org/expath/httpclient/impl/SinglePartRequestBody.java
lines 175-195.

Florent kindly added handling for binary fetching in the EXPath HTTP
Client v.0.3 in February (thanks, Florent!!).  I'm not sure what would
be involved in adding JSON.

Joe

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Installer fails to run in latest trunk

Efraim Feinstein — 2012-05-24T19:04:18

Hi,

I had been using IzPack 4.3.1, and I also tried IzPack 4.3.5. For both, 
I get similar errors (here's the one from 4.3.5:)
java -jar ././lib/exist/installer/eXist-db-setup-2.1-dev.jar -p 
/usr/local/opensiddur
Installing into directory: /usr/local/opensiddur
[ Starting automated installation ]
Read pack list from xml definition.
Try to add to selection [Name: core and Index: 0]
Try to add to selection [Name: sources and Index: 1]
Try to add to selection [Name: javadoc and Index: 2]
Modify pack selection.
java.lang.ArrayIndexOutOfBoundsException: 1 >= 1
java.lang.ArrayIndexOutOfBoundsException: 1 >= 1
         at java.util.Vector.elementAt(Vector.java:470)
         at 
com.izforge.izpack.installer.AutomatedInstaller.updateInstanceCount(Unknown 
Source)
         at 
com.izforge.izpack.installer.AutomatedInstaller.doInstall(Unknown Source)
         at 
org.exist.izpack.CommandLineInstaller$EXistAutomatedInstaller.run(CommandLineInstaller.java:130)
         at 
org.exist.izpack.CommandLineInstaller.execute(CommandLineInstaller.java:104)
         at 
org.exist.izpack.CommandLineInstaller.main(CommandLineInstaller.java:140)

I read in another thread (from 2011) that 4.3.3 was a good version, but 
it's hard to find the download, let alone from a legitimate site. Would 
it be possible to package the working IzPack in eXist (or otherwise 
provide it for download)?

Re: HTTPclient fetching json

Dmitriy Shabanov — 2012-05-24T18:08:06

On Thu, May 24, 2012 at 10:25 PM, Chris Wallace
<kit.wallace< at >googlemail.com>wrote:


Yes, it should work with json. Try it.

HTTPclient fetching json

Chris Wallace — 2012-05-24T17:25:30

I'm using the httpclient module to fecth json content. I notice that it throws
an exception when it tries to parse the body of the response as XML.  I see a
variant of the HTTPclient:get () with additional parser options but no
indication of what those options might be.  Can they be used to skip the parsing
and return as base64? Even better if it could return JSON rather than me doing a
hack parse.

Alternatively would the EXPath HTTP client module handle fetching JSON?

Chris 



------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: atom format not read by feedreaders

W.S. Hager — 2012-05-24T17:51:22

Yes, the problem is that I cannot have the atom namespace on the instance.

2012/5/24 Dmitriy Shabanov <shabanovd< at >gmail.com>:

Re: GML indexing sample availability

Pierrick Brihaye — 2012-05-24T16:24:33

Hi,

Le 24/05/2012 18:04, Ákos Maróy a écrit :


See eXist's SVN repository :

http://exist.svn.sourceforge.net/viewvc/exist/trunk/eXist/extensions/indexes/spatial/

Cheers,

p.b.

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: GML indexing sample availability

Dmitriy Shabanov — 2012-05-24T16:21:58

All I can say - that index did not see commit for long time.

Maybe, this will help you
http://exist.svn.sourceforge.net/viewvc/exist/trunk/eXist/extensions/indexes/spatial/test/src/org/exist/indexing/spatial/GMLIndexTest.java?revision=16290&view=markup


On Thu, May 24, 2012 at 9:04 PM, Ákos Maróy <akos< at >maroy.hu> wrote: