Skip Menu |
 

This queue is for tickets about the WWW-Curl CPAN distribution.

Report information
The Basics
Id: 37160
Status: rejected
Priority: 0/
Queue: WWW-Curl

People
Owner: Nobody in particular
Requestors: mark [...] hindley.org.uk
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: (no value)
Fixed in: (no value)



MIME-Version: 1.0
X-Spam-Status: No, hits=-0.6 required=8.0 tests=BAYES_00,RDNS_DYNAMIC,TVD_RCVD_IP
Content-Disposition: inline
content-type: text/plain; charset="utf-8"
Received: from x1.develooper.com (x1.develooper.com [63.251.223.170]) by diesel.bestpractical.com (Postfix) with SMTP id A8A0A4D8280 for <bug-WWW-Curl [...] rt.cpan.org>; Fri, 27 Jun 2008 04:33:17 -0400 (EDT)
Received: (qmail 7905 invoked from network); 27 Jun 2008 08:33:16 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 27 Jun 2008 08:33:16 -0000
Received: from 83-216-141-215.markhi700.adsl.metronet.co.uk (HELO mx.hindley.org.uk) (83.216.141.215) by 16.mx.develooper.com (qpsmtpd/0.43rc1) with ESMTP; Fri, 27 Jun 2008 01:33:11 -0700
Received: from mercury.hindleynet ([192.168.1.2] ident=Debian-exim) by mx.hindley.org.uk with esmtp (Exim 4.50) id 1KC9OG-0005nT-Ha for bug-WWW-Curl [...] rt.cpan.org; Fri, 27 Jun 2008 09:33:08 +0100
Received: from mark by mercury.hindleynet with local (Exim 4.69) (envelope-from <mark [...] hindley.org.uk>) id 1KC9OA-0000Kn-20 for bug-WWW-Curl [...] rt.cpan.org; Fri, 27 Jun 2008 09:33:02 +0100
Delivered-To: cpan-bug+WWW-Curl [...] diesel.bestpractical.com
Subject: Segfaults with db4.6
User-Agent: Mutt/1.5.16 (2007-06-11)
Return-Path: <mark [...] hindley.org.uk>
X-Original-To: bug-WWW-Curl [...] rt.cpan.org
X-Spam-Check-BY: 16.mx.develooper.com
Date: Fri, 27 Jun 2008 09:33:02 +0100
X-Spam-Level: *
Message-Id: <20080627083302.GE28249 [...] hindley.org.uk>
To: bug-WWW-Curl [...] rt.cpan.org
From: Mark Hindley <mark [...] hindley.org.uk>
X-RT-Original-Encoding: us-ascii
Content-Length: 471
Download (untitled) / with headers
text/plain 471b
Hi, I maintain Debian apt-cacher which has recently started to use libwww-curl. Since upgrading to version 4.00 and libdb4.6 users (and I) have been getting intermittent segfaults. I haven't managed to nail down a minimal test case. Take a look at Debian bug http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=487789 I have no experience of debugging C/perl bindings, so you will have to tell me how to get the further info you require. Cheers, Mark -- Mark Hindley
MIME-Version: 1.0
X-Spam-Status: No, hits=-2.6 required=8.0 tests=BAYES_00
In-Reply-To: <rt-3.6.HEAD-22481-1214555614-1988.37160-4-0 [...] rt.cpan.org>
References: <RT-Ticket-37160 [...] rt.cpan.org> <20080627083302.GE28249 [...] hindley.org.uk> <rt-3.6.HEAD-22481-1214555614-1988.37160-4-0 [...] rt.cpan.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
X-RT-Original-Encoding: utf-8
Received: from x1.develooper.com (x1.develooper.com [63.251.223.170]) by diesel.bestpractical.com (Postfix) with SMTP id E98064D82BB for <bug-WWW-Curl [...] rt.cpan.org>; Fri, 27 Jun 2008 11:01:24 -0400 (EDT)
Received: (qmail 31540 invoked from network); 27 Jun 2008 15:01:24 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 27 Jun 2008 15:01:24 -0000
Received: from mail.i5invest.com (HELO mail.i5invest.com) (81.16.155.26) by 16.mx.develooper.com (qpsmtpd/0.43rc1) with ESMTP; Fri, 27 Jun 2008 08:01:13 -0700
Received: from [192.168.1.64] (dsl54013AD4.pool.t-online.hu [84.1.58.212]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.i5invest.com (Postfix) with ESMTP id 8AA08541BA for <bug-WWW-Curl [...] rt.cpan.org>; Fri, 27 Jun 2008 17:01:07 +0200 (CEST)
Delivered-To: cpan-bug+WWW-Curl [...] diesel.bestpractical.com
Subject: Re: [rt.cpan.org #37160] Segfaults with db4.6
User-Agent: Mozilla-Thunderbird 2.0.0.14 (X11/20080509)
Return-Path: <szbalint [...] cpan.org>
X-Spam-Check-BY: 16.mx.develooper.com
X-Original-To: bug-WWW-Curl [...] rt.cpan.org
Date: Fri, 27 Jun 2008 17:01:06 +0200
X-Spam-Level: *
Message-Id: <486500B2.30701 [...] cpan.org>
To: "bug-WWW-Curl [...] rt.cpan.org" <bug-WWW-Curl [...] rt.cpan.org>
Content-Transfer-Encoding: 8bit
From: Balint Szilakszi <szbalint [...] cpan.org>
RT-Message-ID: <rt-3.6.HEAD-23209-1214579408-1524.37160-0-0 [...] rt.cpan.org>
Content-Length: 2089
Hi Mark, Mark Hindley via RT wrote: Show quoted text
> Hi, > > I maintain Debian apt-cacher which has recently started to use > libwww-curl. > > Since upgrading to version 4.00 and libdb4.6 users (and I) have been > getting intermittent segfaults. I haven't managed to nail down a minimal > test case.
I've recently released WWW::Curl 4.01 through 4.04, these fix a bunch of bugs. Could you please install 4.04 from CPAN and check whether the issue still occurs? Show quoted text
> Take a look at Debian bug > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=487789 > > I have no experience of debugging C/perl bindings, so you will have to > tell me how to get the further info you require.
At the moment the only known bug that I know about is duphandle not working correctly on some systems. I haven't seen intermittent segfaults with WWW::Curl yet, in my experience it is either hit or miss, depending on Perl version and platform. I've been slowly improving upon the situation though. If the bug exists in 4.04, then unfortunately it'll be pretty hard to track down, because it depends on some combination of perl, libcurl and WWW::Curl. For example, I'm running WWW::Curl in some pretty demanding environments, where a single process is making 200-300 thousand requests in a few hours' space. I haven't had a segfault yet. Since the latest release, I'm also testing with different combinations of perl and libcurl on debian sid. Btw, I've noticed that you've got this at line 1234 in the file apt-cacher2: $curl->setopt(CURLOPT_WRITEHEADER, [\$response, ($pkfdref ? 1 : 0)]); This parameter expects a filehandle, or a reference to a filehandle. I'm not sure what happens if an arrayref gets assigned, but things could get gravely messed up. In future WWW::Curl versions this will probably croak. Also, please note that WWW::Curl 4.01 fixed the bug where if something was not assigned to CURLOPT_WRITEHEADER, header content appeared on STDOUT. That is no longer the case, however if you do set a filehandle to WRITEHEADER, then you'll get the header output. Regards, Bálint Szilakszi
MIME-Version: 1.0
X-Spam-Status: No, hits=-2.6 required=8.0 tests=BAYES_00
In-Reply-To: <rt-3.6.HEAD-22481-1214555614-1988.37160-4-0 [...] rt.cpan.org>
References: <RT-Ticket-37160 [...] rt.cpan.org> <20080627083302.GE28249 [...] hindley.org.uk> <rt-3.6.HEAD-22481-1214555614-1988.37160-4-0 [...] rt.cpan.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
X-RT-Original-Encoding: utf-8
Received: from x1.develooper.com (x1.develooper.com [63.251.223.170]) by diesel.bestpractical.com (Postfix) with SMTP id E98064D82BB for <bug-WWW-Curl [...] rt.cpan.org>; Fri, 27 Jun 2008 11:01:24 -0400 (EDT)
Received: (qmail 31540 invoked from network); 27 Jun 2008 15:01:24 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 27 Jun 2008 15:01:24 -0000
Received: from mail.i5invest.com (HELO mail.i5invest.com) (81.16.155.26) by 16.mx.develooper.com (qpsmtpd/0.43rc1) with ESMTP; Fri, 27 Jun 2008 08:01:13 -0700
Received: from [192.168.1.64] (dsl54013AD4.pool.t-online.hu [84.1.58.212]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.i5invest.com (Postfix) with ESMTP id 8AA08541BA for <bug-WWW-Curl [...] rt.cpan.org>; Fri, 27 Jun 2008 17:01:07 +0200 (CEST)
Delivered-To: cpan-bug+WWW-Curl [...] diesel.bestpractical.com
Subject: Re: [rt.cpan.org #37160] Segfaults with db4.6
User-Agent: Mozilla-Thunderbird 2.0.0.14 (X11/20080509)
Return-Path: <szbalint [...] cpan.org>
X-Spam-Check-BY: 16.mx.develooper.com
X-Original-To: bug-WWW-Curl [...] rt.cpan.org
Date: Fri, 27 Jun 2008 17:01:06 +0200
X-Spam-Level: *
Message-Id: <486500B2.30701 [...] cpan.org>
To: "bug-WWW-Curl [...] rt.cpan.org" <bug-WWW-Curl [...] rt.cpan.org>
Content-Transfer-Encoding: 8bit
From: Balint Szilakszi <szbalint [...] cpan.org>
RT-Message-ID: <rt-3.6.HEAD-23227-1214581224-1251.37160-0-0 [...] rt.cpan.org>
Content-Length: 2089
Hi Mark, Mark Hindley via RT wrote: Show quoted text
> Hi, > > I maintain Debian apt-cacher which has recently started to use > libwww-curl. > > Since upgrading to version 4.00 and libdb4.6 users (and I) have been > getting intermittent segfaults. I haven't managed to nail down a minimal > test case.
I've recently released WWW::Curl 4.01 through 4.04, these fix a bunch of bugs. Could you please install 4.04 from CPAN and check whether the issue still occurs? Show quoted text
> Take a look at Debian bug > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=487789 > > I have no experience of debugging C/perl bindings, so you will have to > tell me how to get the further info you require.
At the moment the only known bug that I know about is duphandle not working correctly on some systems. I haven't seen intermittent segfaults with WWW::Curl yet, in my experience it is either hit or miss, depending on Perl version and platform. I've been slowly improving upon the situation though. If the bug exists in 4.04, then unfortunately it'll be pretty hard to track down, because it depends on some combination of perl, libcurl and WWW::Curl. For example, I'm running WWW::Curl in some pretty demanding environments, where a single process is making 200-300 thousand requests in a few hours' space. I haven't had a segfault yet. Since the latest release, I'm also testing with different combinations of perl and libcurl on debian sid. Btw, I've noticed that you've got this at line 1234 in the file apt-cacher2: $curl->setopt(CURLOPT_WRITEHEADER, [\$response, ($pkfdref ? 1 : 0)]); This parameter expects a filehandle, or a reference to a filehandle. I'm not sure what happens if an arrayref gets assigned, but things could get gravely messed up. In future WWW::Curl versions this will probably croak. Also, please note that WWW::Curl 4.01 fixed the bug where if something was not assigned to CURLOPT_WRITEHEADER, header content appeared on STDOUT. That is no longer the case, however if you do set a filehandle to WRITEHEADER, then you'll get the header output. Regards, Bálint Szilakszi
MIME-Version: 1.0
X-Spam-Status: No, hits=-0.6 required=8.0 tests=BAYES_00,RDNS_DYNAMIC,TVD_RCVD_IP
Content-Disposition: inline
References: <RT-Ticket-37160 [...] rt.cpan.org> <20080627083302.GE28249 [...] hindley.org.uk> <rt-3.6.HEAD-22481-1214555614-1988.37160-4-0 [...] rt.cpan.org> <486500B2.30701 [...] cpan.org>
Content-Type: text/plain; charset="utf-8"
X-RT-Original-Encoding: utf-8
Received: from x1.develooper.com (x1.develooper.com [63.251.223.170]) by diesel.bestpractical.com (Postfix) with SMTP id 2CAEF4D82AB for <bug-WWW-Curl [...] rt.cpan.org>; Fri, 27 Jun 2008 12:55:37 -0400 (EDT)
Received: (qmail 18345 invoked from network); 27 Jun 2008 16:55:36 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 27 Jun 2008 16:55:36 -0000
Received: from 83-216-141-215.markhi700.adsl.metronet.co.uk (HELO mx.hindley.org.uk) (83.216.141.215) by 16.mx.develooper.com (qpsmtpd/0.43rc1) with ESMTP; Fri, 27 Jun 2008 09:55:31 -0700
Received: from mercury.hindleynet ([192.168.1.2] ident=Debian-exim) by mx.hindley.org.uk with esmtp (Exim 4.50) id 1KCHDw-0001QN-AB for bug-WWW-Curl [...] rt.cpan.org; Fri, 27 Jun 2008 17:55:00 +0100
Received: from mark by mercury.hindleynet with local (Exim 4.69) (envelope-from <mark [...] hindley.org.uk>) id 1KCHDw-0002Og-K8 for bug-WWW-Curl [...] rt.cpan.org; Fri, 27 Jun 2008 17:55:00 +0100
Delivered-To: cpan-bug+WWW-Curl [...] diesel.bestpractical.com
User-Agent: Mutt/1.5.16 (2007-06-11)
Subject: Re: [rt.cpan.org #37160] Segfaults with db4.6
Return-Path: <mark [...] hindley.org.uk>
X-Spam-Check-BY: 16.mx.develooper.com
X-Original-To: bug-WWW-Curl [...] rt.cpan.org
Date: Fri, 27 Jun 2008 17:55:00 +0100
X-Spam-Level: *
Message-Id: <20080627165500.GS28249 [...] hindley.org.uk>
To: Balint Szilakszi via RT <bug-WWW-Curl [...] rt.cpan.org>
From: Mark Hindley <mark [...] hindley.org.uk>
RT-Message-ID: <rt-3.6.HEAD-23245-1214585744-1216.37160-0-0 [...] rt.cpan.org>
Content-Length: 2263
Download (untitled) / with headers
text/plain 2.2k
On Fri, Jun 27, 2008 at 11:40:26AM -0400, Balint Szilakszi via RT wrote: Show quoted text
> <URL: http://rt.cpan.org/Ticket/Display.html?id=37160 > > > Hi Mark, > > Mark Hindley via RT wrote:
> > Hi, > > > > I maintain Debian apt-cacher which has recently started to use > > libwww-curl. > > > > Since upgrading to version 4.00 and libdb4.6 users (and I) have been > > getting intermittent segfaults. I haven't managed to nail down a minimal > > test case.
> > I've recently released WWW::Curl 4.01 through 4.04, these fix a bunch of > bugs. Could you please install 4.04 from CPAN and check whether the > issue still occurs? >
> > Take a look at Debian bug > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=487789 > > > > I have no experience of debugging C/perl bindings, so you will have to > > tell me how to get the further info you require.
> > At the moment the only known bug that I know about is duphandle not > working correctly on some systems. > > I haven't seen intermittent segfaults with WWW::Curl yet, in my > experience it is either hit or miss, depending on Perl version and > platform. I've been slowly improving upon the situation though. > > If the bug exists in 4.04, then unfortunately it'll be pretty hard to > track down, because it depends on some combination of perl, libcurl and > WWW::Curl. For example, I'm running WWW::Curl in some pretty demanding > environments, where a single process is making 200-300 thousand requests > in a few hours' space. I haven't had a segfault yet. Since the latest > release, I'm also testing with different combinations of perl and > libcurl on debian sid.
I'll have a go. Show quoted text
> > Btw, I've noticed that you've got this at line 1234 in the file apt-cacher2: > > $curl->setopt(CURLOPT_WRITEHEADER, [\$response, ($pkfdref ? 1 : 0)]);
That has gone in my development version. Now switched to using WWW::Curl::Multi in a separate process so that I can get DNS caching to work across all requests. My initial hope had been to use Curl::Share. But I couldn't get it to work.Presumably if I used a single WWW::Curl::Share and then used a WWW::Curl::Easy handle in a forked process, the DNS cache in the parent wouldn't get updated and propagted to the next forked WWW::Curl::Easy Thanks, Mark
MIME-Version: 1.0
In-Reply-To: <20080627083302.GE28249 [...] hindley.org.uk>
X-Mailer: MIME-tools 5.426 (Entity 5.426)
Content-Disposition: inline
Charset: utf8
References: <20080627083302.GE28249 [...] hindley.org.uk>
Message-Id: <rt-3.6.HEAD-32268-1215958878-983.37160-0-0 [...] rt.cpan.org>
Content-Type: text/plain
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
Content-Length: 156
Download (untitled) / with headers
text/plain 156b
It looks like the apt-cacher problem was resolved. I don't see any indication that this problem is present in the current release, so I'm closing this bug.


This service is sponsored and maintained by Best Practical Solutions and runs on Perl.org infrastructure.

Please report any issues with rt.cpan.org to rt-cpan-admin@bestpractical.com.