http://permalink.gmane.org/gmane.comp.web.curl.library hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://permalink.gmane.org/gmane.comp.web.curl.library/21589 Hi, I am working on a project that uses libcurl 7.19.2 to handle FTP, SFTP, and FTPS transfers. This is a cross platform project for Windows, Mac (both intel and PPC), and Linux, and we are running the same code on all platforms. Everything seems to working fine apart from SFTP transfers on intel macs. When we run our software on intel macs curl_easy_perform returns CURL_FAILED_INIT. Using the debugger I've traced the problem down to libssh2_session_startup, which is returning LIBSSH2_ERROR_KEX_FAILURE. Why it is doing this I don't know. Our high level sftp curl code looks like so, and this seems to be working fine on all platforms apart from intel macs. CURL* curl = curl_easy_init(); curl_easy_setopt(curl, CURLOPT_URL, urlString.c_str()); curl_easy_setopt(curl, CURLOPT_SSL_VERIFYPEER, 0L); if (verifyHostCertificate) curl_easy_setopt(curl, CURLOPT_SSL_VERIFYHOST, 2L); else curl_easy_setopt(curl, CURLOPT_SSL_VERIFYHOST, 0L); r = curl_easy_perform(curl); I think I must be missing something, Neil Wilson 2008-12-04T03:47:15 http://permalink.gmane.org/gmane.comp.web.curl.library/21588 Dear developer: I use libcurl 7.19.0. Fisrt step: set header callback and header data, body write callback and body write data, perform; second, set only header callback null, the header data line output in body write callback when I perform again. Thanks very much. Best Regards Shunlong Bai _________________________________________________________________ 新版客服页面提供最新MSN客服资讯，助您轻松解决问题。 http://help.cn.msn.com/Cs.html 白龙 2008-12-04T03:09:34 http://permalink.gmane.org/gmane.comp.web.curl.library/21587 Dear developer: I use libcurl 7.19.0 and finde a bug.I visit https://www.hsbcdirect.com with cacert bundle that get from your site. The trace show the url is redirected: first , response 302 and the content length is 217. second, redirect and the content is chunk. But in my body write callback, the content length get from curl_easy_getinfo is still 217. Thanks very much. Best Regards Shunlong Bai _________________________________________________________________ 超炫人气榜给您所有偶像的最新资讯和排名，快来支持自己的偶像！ http://cnweb.search.live.com/xrank/results.aspx?q=%e5%91%a8%e6%9d%b0%e4%bc%a6&FORM=MSNH 白龙 2008-12-04T03:01:54 http://permalink.gmane.org/gmane.comp.web.curl.library/21586 Hi, I am working on a project that uses libcurl 7.19.2 to handle FTP, SFTP, and FTPS transfers. This is a cross platform project for Windows, Mac (both intel and PPC), and Linux, and we are running the same code on all platforms. Everything seems to working fine apart from SFTP transfers on intel macs. When we run our software on intel macs curl_easy_perform returns CURL_FAILED_INIT. Using the debugger I've traced the problem down to libssh2_session_startup, which is returning LIBSSH2_ERROR_KEX_FAILURE. Why it is doing this I don't know. Our high level sftp curl code looks like so, and this seems to be working fine on all platforms apart from intel macs. CURL* curl = curl_easy_init(); curl_easy_setopt(curl, CURLOPT_URL, urlString.c_str()); curl_easy_setopt(curl, CURLOPT_SSL_VERIFYPEER, 0L); if (verifyHostCertificate) curl_easy_setopt(curl, CURLOPT_SSL_VERIFYHOST, 2L); else curl_easy_setopt(curl, CURLOPT_SSL_VERIFYHOST, 0L); r = curl_easy_perform(curl); I think I must be missing something Neil Wilson 2008-12-04T03:01:17 http://permalink.gmane.org/gmane.comp.web.curl.library/21585 Aah. Now I see and how I completely understand why that isn't right. multi->sockhash simply keeps sockets in the hash and when doing HTTP pipelining more than one easy handle can use the same socket and thus the Curl_hash_pick() function can (wrongly) fetch the one that isn't currently in the head of the recv_pipe. I think we can solve this particular issue like this: If the extract SessionHandle is part of a pipe we can check if it is first in one of the pipes (recv and send). I guess the input action bit needs to be used as a hint to what pipe that should be checked. If it isn't first in the pipe for the checked direction, we can traverse the linked list with handles on that pipe and instead pick the one in the head and proceed using that instead. In general we will also need to go over all other uses of the sockhash to make sure that we don't remove entries from the hash that are part of a pipe since then we still want the socket in there for the remaining handles. Like in the sh_delentry Daniel Stenberg 2008-12-03T22:15:06 http://permalink.gmane.org/gmane.comp.web.curl.library/21584 Yes I saw it and yes I think it's unnecessary. I tried to clarify the meaning of the XXXchannel_inuse fields in the code just a few days ago: they're just flags that mean that the "channel" is in use and nobody else can take it. So when we remove the handle at the head, the channel gets available and the _inuse field can safely be set to FALSE and the next handle in line would later become head and "take" the channel and set _inuse to TRUE again. Daniel Stenberg 2008-12-03T19:10:30 http://permalink.gmane.org/gmane.comp.web.curl.library/21583 Yes, I agree with that suspicion. But also, with CURLOPT_CONNECT_ONLY the protocol part of the URL has very little meaning (I figure default port and whether TCP or UDP basically) so trying a HTTP:// URL on port 21 as a work-around should be easy enough! Daniel Stenberg 2008-12-03T19:07:01 http://permalink.gmane.org/gmane.comp.web.curl.library/21582 phenomena for the event, it that the event By "On READ event" I mean "When curl_multi_socket_action() is called with READ action bit set". "Curl_read") set, in the the My complain is about algorithm that is used from within multi_socket in order to choose the handle to be passed to the multi_runsingle(). This algorithm uses Curl_hash_pick(). The last brings the handle 11961a8 that is not in head of the recv_pipe of the connection, on which the data was received. As a result the other handle 118d350 is chosen. This other handle is in the CURLM_STATE_WAITPERFORM state. But it doesn't move to the PERFORM state because it is not in the head of the recv_pipe. received the READ As it was mentioned before - in CURLM_STATE_WAITPERFORM. You can see this in the log I attached early. The multi handle is 118d350. It is in the second place of the recv_pipe. At the head the handle 11961a8. I attach the log again for your convenience. Thank you, Igor RequestCreate: request 0118D2B8 (ctx=00CF2EA0, easy=0118D350, DE Igor Novoseltsev 2008-12-03T17:16:22 http://permalink.gmane.org/gmane.comp.web.curl.library/21581 Hi, I didn't get response to my last update, quoted below. Did you see it? Do you think it is wrong? Thanks Date: 2008-12-03 10:33 Sender: ketamin <https://sourceforge.net/users/ketamin/> The patch works good! Thank you very much! Although I have one doubt. In ligth of your erlier remark regarding readchannel_inuse I think we should use if(Curl_removeHandleFromPipeline(data, conn->XXX_pipe) && conn->XXXchannel_inuse && conn->XXX_pipe->size > 0) conn->XXXchannel_inuse = FALSE; instead of if(Curl_removeHandleFromPipeline(data, conn->XXX_pipe) && conn->XXXchannel_inuse) conn->XXXchannel_inuse = FALSE; Igor Novoseltsev 2008-12-03T16:29:35 http://permalink.gmane.org/gmane.comp.web.curl.library/21580 [...] CURLOPT_CONNECT_ONLY is really designed for use while connecting through a proxy. In the case of a plain FTP URL, CURLOPT_CONNECT_ONLY would do exactly the same as a regular socket operation. I don't know why you'd want to use libcurl in such a situation. Still, you'd expect libcurl to do something sane in that case. I suspect it's simply never been tried and CURLOPT_CONNECT_ONLY with FTP is buggy. Dan Fandrich 2008-12-03T16:26:30 http://permalink.gmane.org/gmane.comp.web.curl.library/21579 Did you read and follow the guidelines for using libcurl in a multithreaded program? Did you try running your program against the latest libcurl version (7.19.2)? Dan Fandrich 2008-12-03T16:21:11 http://permalink.gmane.org/gmane.comp.web.curl.library/21578 Please don't top-post. It doesn't sound like that, no. When libcurl is waiting for a read event, it should have called the app using the socket callback saying so, so that the app will wait for a READ event and properly call libcurl when such an event arrives. When curl_multi_socket_action() is called with the READ action bit set, lib/multi.c:multi_runsingle() will be called and if the handle is then in the PERFORM state it will call Curl_readwrite() that will act according to the bits you passed to curl_multi_socket_action(). What is curl_multi_socket_action() doing then when you call it with the READ action bit set? In what state is the multi handle at that point? Daniel Stenberg 2008-12-03T15:51:31 http://permalink.gmane.org/gmane.comp.web.curl.library/21577 Hello All, I'm trying to setup an ftp connection using Libcurl 7.19.2. What I want to do is a CURLOPT_CONNECT_ONLY in order to use the recv function. My init : curlResult = curl_global_init(CURL_GLOBAL_ALL); //Create easy Curl object m_curlFtpHandle = curl_easy_init(); //set curl Parameters if handle is valid if(m_curlFtpHandle) { curl_easy_setopt(m_curlFtpHandle, CURLOPT_VERBOSE , 1); curl_easy_setopt(m_curlFtpHandle, CURLOPT_STDERR, stdout); //Set url curlResult = curl_easy_setopt(m_curlFtpHandle, CURLOPT_URL, m_sUrl); //Set username and password curlResult = curl_easy_setopt(m_curlFtpHandle, CURLOPT_USERPWD, "user:pw"); curlResult = curl_easy_setopt(m_curlFtpHandle, CURLOPT_FTP_USE_EPSV, 1); //Only connect curlResult = curl_easy_setopt(m_curlFtpHandle, CURLOPT_CONNECT_ONLY, 1L); } else { //error } curlResult = curl_easy_setopt(m_curlFtpHandle, CURLOPT_RESUME_FROM, m_uiStartPos); curlResult = curl_easy_perform(m Jacob Hooysma 2008-12-03T14:39:59 http://permalink.gmane.org/gmane.comp.web.curl.library/21576 Hi all, I've been using the 'libcurl' in a multithreaded C program. But frequently the program is crashing . I have tried to dump the core and the program is failing by the free() calls used inside the libcurl. The program is reporting a double free operation in libcurl and crashes. Following is the backtrace of the core when it crashes complaining about the double free operation. Core was generated by `./a.out'. Program terminated with signal 6, Aborted. #0 0x00341402 in __kernel_vsyscall () (gdb) bt #0 0x00341402 in __kernel_vsyscall () #1 0x00b12c00 in raise () from /lib/libc.so.6 #2 0x00b14451 in abort () from /lib/libc.so.6 #3 0x00b481fb in __libc_message () from /lib/libc.so.6 #4 0x00b4fe1e in _int_free () from /lib/libc.so.6 #5 0x00b535b0 in free () from /lib/libc.so.6 #6 0x00a38b94 in Curl_safefree () from /usr/lib/libcurl.so.4 #7 0x00a392d1 in Curl_disconnect () from /usr/lib/libcurl.so.4 #8 0x00a39578 in Curl_done () from /usr/lib/libcurl.so.4 #9 0x00a48cb7 in Curl_perform () from asvija b 2008-12-03T10:19:11 http://permalink.gmane.org/gmane.comp.web.curl.library/21575 libcurl is completely agnostic about the underlying transport layer being ethernet, gprs or carrier pigeons! What about the progress callback? Well, if there's no data coming to libcurl it will of course not called the write callback! That's up to you! libcurl does the transfers for you. You the logic around the actual transfers! Then perhaps CURLOPT_LOW_SPEED_LIMIT and friends are more suitable? Or do your own magic in the progress callback! -- / daniel.haxx.se Daniel Stenberg 2008-12-03T10:10:30 http://permalink.gmane.org/gmane.comp.web.curl.library/21574 Hi All, We have developed one application which uses Glibcurl to fetch data from a server. The data volumes are of 700K to 1M in size. The application never failed for ethernet, however once we tried running on GPRS, it started showing peculiar behavior. - After downloading ~300K it got stuck and the writeDataCallbackFunction stopped getting called. We suspect that GPRS was not dropped however connection was very slow and several packets might have been dropped. Question: How do we recover, if network stops sending data. We tried the CURLOPT_TIMEOUT option, but since the data is large for a slow connection, we want to detect if packets stop coming to us in the middle and not to judge on total download time. I hope I am making myself clear. Please let me know if any other information is required. Thanks, Shakti Shakti Ashirvad 2008-12-03T10:03:13 http://permalink.gmane.org/gmane.comp.web.curl.library/21573 It looks like I totally misunderstood the traced code. Could you advice please, what details can help to understand the problem? Do you want me to add some prints to the log, attached to the mail? Meanwhile I'll try to explain how did I get the conclusions. But before that I would like to get your opinion regarding the phenomena itself: On READ event libcurl neither reads from the socket nor registers for the READ event again. Is it legal flow? In the attached log you can see, that the Curl_read() (look for "Curl_read") was not called after the last READ (look for "events=0x1") event. I suspect that the READ event that was ignored stands for the received response. As a result of ignoring, the response is not handled causing the application to stuck. Respectfully yours, Igor -----Original Message----- From: curl-library-bounces< at >cool.haxx.se [mailto:curl-library-bounces< at >cool.haxx.se] On Behalf Of Daniel Stenberg Sent: Wednesday, December 03, 2008 12:34 AM To: libcurl development Subject: Re: hangs up o Igor Novoseltsev 2008-12-03T07:24:07 http://permalink.gmane.org/gmane.comp.web.curl.library/21572 Enabling pipelining too I conclude. That splay tree is only used for timeouts, and timeouts are set on a per easy-handle basis. Timeouts that have expired will thus cause action to be taken. I don't follow you how they are related to the problem you describe. As a result of timeouts? This means that if the receiving "channel" isn't in used but the specific connection is first in the receive queue it will be moved there. Sorry but I don't understand how it ends up in this situation. But if there's a connection in the receive pipeline, why won't the app get a READ event if there's data to be read? Not exactly, that handles timeouts and if you don't have anything particular to timeout on you won't get any. I'm afraid I need more details or a more elaborate description to understand what you're saying! Daniel Stenberg 2008-12-02T22:33:46 http://permalink.gmane.org/gmane.comp.web.curl.library/21571 I didn't see any libcurl question, either. You probably want a PHP forum. Dan Fandrich 2008-12-02T16:59:49 http://permalink.gmane.org/gmane.comp.web.curl.library/21570 wrote: Sorry, new to curl and libcurl. I posted in the wrong forum, this would be a libcurl question, I'll post in that forum. Jeff Dunlap 2008-12-02T16:32:41 http://permalink.gmane.org/gmane.comp.web.curl.library/21569 I don't see any Curl-related question in here. Joe Nardone 2008-12-02T16:19:24 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.web.curl.library