gmane.comp.web.curl.php

curl-multi returns connection errors for many URLs even if only one is problematic

Broekhuis,Robert R. — 2013-06-17T13:58:10

For years, I've been running a script that takes 10 URLs at a time and runs them through a standard curl-multi fetch loop as part of a link checker application.
Sometimes, if one of the 10 URLs is problematic (e.g., times out, or has a DNS problem), some or all of the other URLs will also come back with a curl error status, even when they are perfectly fine (as evidenced by a subsequent attempt to fetch just those URLs). This has been an intermittent problem since I started running the script, but it appears to have gotten worse in recent times. I get around it by somewhat elaborate retry strategies to cut back on the number of URLs falsely identified as being inactive, but the greater number of instances of the problem is starting to gum up my operations. Is there anything I can do (short of fetching the URLs one by one, which works but gives me timing problems) to reduce the incidence of this issue?

I'm using PHP Version 5.2.17 on Linux infong 2.4 #1 SMP Fri Mar 22 18:19:29 CET 2013 i686 GNU/Linux with li

JAVA Plugin

David Colter — 2013-06-12T15:28:03

Hello all. I've reached a dead-end and need help please.

A site I've been using curl to login and access account info has just implemented a JAVA application plugin. My script is running as cron on a Linux web server. Firefox (on local machine - for manual access) is warning that this application will have access to system wide resources. The plugin is apparently for computer recognition and registration in the name of increased security. 

Can cURL mimic this plugin to satisfy the remote server's need? If not, is there an alternate method to accomplish this? I have thought about bringing the script local, but that may not work either, if cURL cannot activate the plugin.

Any ideas?

David
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

>>>

Troy Davisson — 2013-06-03T01:08:33

http://lifearea.at/emd/elqihobwttyzjjrb.uphmr
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

php curl_exec stopped

Asaf Cohen — 2013-05-27T09:21:01

Hi,
I'm kinda new to curl in php and I have the following problem:

Once a form in my website is submitted, I start sending post requests to
another web service in a loop.
I need to send large number of requests, up to 300 one after another (not
simultaneously).
All requests are sent to HTTPS address.

everything is working great until certain request just kills the page
loading.
It usually happens after 80-90 requests though it can be sometimes also
after 20-30.
I debugged it and it dies in curl_exec()
(had a debug message before it but the one after didn't show)

Code doesn't have an error as the first requests are doing just fine.

I tried to have sleep after each request, or big sleep after 10 requests
but it didn't help.
I also counted the time until the fall/crash, it's not constant.

I tried to set max_input_time & max_execution_time to 600 (10 minutes),
again, no luck.

Tried also to turn on curl verbose flag and got the output to a file,
didn't see any error message or reason why it stopped.

Any id

Re: Case of gnutls_handshake() failed: A TLS warning alert has been received.

Daniel Stenberg — 2013-05-25T21:08:28


...


Old libcurl (>20 releases and >3 years old) and an old GnuTLS version. We've 
done numerous GnuTLS-related fixes since, and GnuTLS itself has improved too. 
I just can't be bothered to track down quirks in very old versions, sorry.

Case of gnutls_handshake() failed: A TLS warning alert has been received.

Daniel Fylstra — 2013-05-24T23:33:02

I would appreciate any advice about this TLS warning situation:

I am calling a REST API via https with pretty standard parameters: https://api.social123.com/services/socialdata.php?rquest=searchcontactpoints&key=xxx&first_name=xxx&last_name=xxx&content_mention=NULL-NULL

Entering this URL in a browser (with an appropriate API key) yields the expected JSON result.  When I try this in PHP on our server, I get "gnutls_handshake() failed: A TLS warning alert has been received" from curl_error().  I've read online about this error message, but I can't figure out what's happening in this situation.

A verbose error trace yields:

* About to connect() to api.social123.com port 443 (#0)
*   Trying 198.199.79.238... * connected
* Connected to api.social123.com (198.199.79.238) port 443 (#0)
* found 141 certificates in /etc/ssl/certs/ca-certificates.crt
* gnutls_handshake() failed: A TLS warning alert has been received.
* Closing connection #0

From this code:

  $ch = curl_init();
  curl_setopt($ch, CURLOPT_URL, $ur

CURL_OPENSSL_3 not found

Antonio Carlos Ribeiro — 2013-04-03T16:58:24

Guys,

I'm trying to complile curl (7.23.1 and 7.29.0) with ares and, after make
install, apache+php dies saying:

PHP Warning:  PHP Startup: Unable to load dynamic library
'/usr/lib/php5/20090626/curl.so' - /usr/local/lib/libcurl.so.4: version
`CURL_OPENSSL_3' not found (required by /usr/lib/php5/20090626/curl.so) in
Unknown on line 0

Here is what I'm doing to compile:

sudo make clean
sudo ./configure --with-ssl --enable-ares
sudo make
sudo make install

Any lights?

Thanks in advance,

AC
antoniocarlos< at >cys.com.br

(+55) 21-8088-2233 (celular TIM)
(+55) 21-9644-4722 (celular VIVO)
(+55) 21-2556-3164 (fixo residencial)

skype: antoniocarlosribeiro

_______________

*I must say I find television very educational. The minute somebody turns
it on, I go to the library and read a good book.** (**Devo dizer que acho
televisão muito educativo. Quando alguém a liga, vou à biblioteca e leio um
bom livro.)

(Groucho Marx)*
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinf

Fw: message

Henry Steinberg — 2013-03-10T18:54:06

http://www.easyhomethai.com/btx/sl/sxls/buzx/iv/zyh/ai.aq
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

php script retrive url

Denis K — 2013-03-05T15:27:03

Hy. I need help to resolve this task. How dase tracking that doing php
script runing from cli uses cron. And if have no answer from server restart
script from url adge.
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

Re: Weird cURL operation timed out error with HTTP POST

Daniel Stenberg — 2013-02-19T18:54:56


One word: old.


It happens when you provide the wrong length. If you compare with that is sent 
when you let libcurl do its business on its own, you'll find out that the sent 
header is different.

Setting Content-Length yourself in a PHP program using PHP/CURL is almost 
never the right way. Independently of libcurl version.

Weird cURL operation timed out error with HTTP POST

Phil — 2013-02-19T14:04:19

cURL-Version: 7.18.2
PHP Version: 5.3.17 (Suhosin Patch 0.9.10)

I'm getting a weird timeout when trying to use cURL to post to a server. The http_code of curl_getinfo() is 0.
"Operation timed out after 5000 milliseconds with 0 bytes received"


It does not depend on whether using HTTP or HTTPS.
The weird thing is: when omitting the content-length header, it works fine!
On another server with PHP 5.3.3-7 and cURL 7.21.0, everything works fine.

I attach these two files. Maybe anybody can confirm this issue?
Or does anybody have an idea what I'm doing wrong?
Thanks in advance. Phil

curltest_data.php
<?php
header('Content-type: application/json');
?>
{"ABC":"DEF"}
end curltest_data.php

curltest.php
<?php
$server = ''; // INSERT FULL URL OF curltest_data.php

$curlHandle = curl_init();

$str = json_encode(array());
$len = mb_strlen($str);
$headers = array('Content-type: application/json', 'Content-length: ' . $len); // WHEN OMITTING THIS CONTENT-LENGHT HEADER, IT WORKS FINE

curl_setopt($curlHandle,CURLOPT_HT

Re: replace code curl to libcurl

aksshay sharma — 2013-02-18T12:35:09

Hi Левченко Кирилл Сергеевич,

Hope it helps,

In PHP you have to give like this :

curl_setopt($ch, CURLOPT_USERPWD, 'user:pass');
curl_setopt($ch, CURLOPT_HTTPAUTH, CURLAUTH_DIGEST);

$ch is your curl handle.

On Mon, Feb 18, 2013 at 12:54 PM, Левченко Кирилл Сергеевич <
kirill< at >nsk.vtb24.ru> wrote:

replace code curl to libcurl

Левченко Кирилл Сергеевич — 2013-02-18T07:24:48

How to replace this command 

<curl --user abc:password --digest \http://172.1.1.1/KbrInterface/system/Main.aspx?Method=List >

code on  perl or php with libcurl?

 

_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

(unknown)

2013-02-17T17:20:57

http://www.mouscaillo.com/hmrd/v5n02mj7.9awwd?lr_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

migrate from curl to libcurl

Левченко Кирилл Сергеевич — 2013-02-14T12:47:27

Now use curl

curl --user abc:password --digest \"http://172.1.1.1/KbrInterface/system/Main.aspx?Method=List"

How to replace this command code on  perl or php with libcurl?

 

С уважением, 

руководитель группы

системного администрирования и телекоммуникаций

Филиала №5440 ВТБ24 

Левченко Кирилл Сергеевич

т. (383)325-23-10, 3-2750

 

_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

RE: CA Bundle issues

Chris Campbell — 2013-02-13T07:49:09

I got a work around by just turning off the peer verification, thanks!

Chris Campbell






Mobile:

0488 00 78 41

Direct Line:

08 6188 3662

Support:

1300 958 923

Email:

chrisc< at >winningwa.com.au<mailto:chrisc< at >winningwa.com.au>





[cid:image001.jpg< at >01CE0A01.A96C1180]





This email is confidential. If you are not the intended recipient, you must not disclose or use the information contained in it. If you have received this email in error, please notify us immediately by return email and delete the email and any attachments. Any personal views or opinions expressed by the writer may not necessarily reflect the views or opinions of Winning Solutions IT Services.


From: curl-and-php [mailto:curl-and-php-bounces< at >cool.haxx.se] On Behalf Of Chris Campbell
Sent: Wednesday, 13 February 2013 10:36 AM
To: curl-and-php< at >cool.haxx.se
Subject: CA Bundle issues


Hi guys,



I am connecting to paypal using curl and am getting the below error message:



Got error setting certificate verify locations:

  CAfile: D:

CA Bundle issues

Chris Campbell — 2013-02-13T02:36:25

Hi guys,



I am connecting to paypal using curl and am getting the below error message:



Got error setting certificate verify locations:

  CAfile: D:\inetpub\wwwroot\WSITportal\cacert.crt

  CApath: none

when processing IPN data

I have given full control to everyone and it is still giving me this error message, and the file does exists at that path specified so im not too sure what else could be the problem,  any ideas on what else could be causing the issue?

Regards,

Chris Campbell






Email:

chrisc< at >winningwa.com.au<mailto:chrisc< at >winningwa.com.au>





[cid:image001.jpg< at >01CE09D5.F852E7F0]





This email is confidential. If you are not the intended recipient, you must not disclose or use the information contained in it. If you have received this email in error, please notify us immediately by return email and delete the email and any attachments. Any personal views or opinions expressed by the writer may not necessarily reflect the views or opinions of Winning Solutions IT Services.


___________

Re: Q: about the server ip

humen1 — 2012-12-27T10:17:24

gethostbyname("example.com <http://example.com>"); ?? workd fine !!

? 2012/12/27 17:36, Jan Fedemo ??:

_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

Re: Q: about the server ip

Jan Fedemo — 2012-12-27T09:36:57

Thank you very much for your answer, now I know how to solve the problem, I
greet the Polish.


2012/12/27 shiplu <shiplu.net< at >gmail.com>

_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php

Re: Q: about the server ip

shiplu — 2012-12-27T07:20:25

If you want to get the IP of the client who requested your php page use
$_SERVER['REMOTE_ADDR'].

To get the IP of the server you are sending curl request use
gethostbyname() function as gethostbyname("example.com");




On Thu, Dec 27, 2012 at 11:04 AM, seven <humen1< at >gmail.com> wrote:

Q: about the server ip

seven — 2012-12-27T05:04:50

how can i get the remote server ip address??
_______________________________________________
http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-and-php