Bug #86234 for IO-Compress: io-compress 2.061 fails bzip2 tests on OS X 10.7

# Tue Jun 18 10:45:51 2013 fink [...] snaggledworks.com - Ticket created

From fink [...] snaggledworks.com Tue Jun 18 10:	45:51 2013
CC:	fink-devel <fink-devel [...] lists.sourceforge.net>
MIME-Version:	1.0
X-Spam-Status:	No, score=-6.9 tagged_above=-99.9 required=10 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5] autolearn=ham
X-Spam-Flag:	NO
X-Proofpoint-Spam-Details:	rule=notspam policy=default score=0 spamscore=0 suspectscore=1 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1305240000 definitions=main-1306180115
content-type:	text/plain; charset="utf-8"; format="flowed"
Message-ID:	<51C07270.7050503 [...] snaggledworks.com>
X-Virus-Scanned:	Debian amavisd-new at bestpractical.com
X-Spam-Score:	-6.9
Received:	from localhost (localhost [127.0.0.1]) by hipster.bestpractical.com (Postfix) with ESMTP id 097EB240B3E for <cpan-bug+IO-Compress [...] hipster.bestpractical.com>; Tue, 18 Jun 2013 10:45:51 -0400 (EDT)
Received:	from hipster.bestpractical.com ([127.0.0.1]) by localhost (hipster.bestpractical.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4OFQj2vEvyup for <cpan-bug+IO-Compress [...] hipster.bestpractical.com>; Tue, 18 Jun 2013 10:45:47 -0400 (EDT)
Received:	from la.mx.develooper.com (x1.develooper.com [207.171.7.70]) by hipster.bestpractical.com (Postfix) with SMTP id 510EA240B3B for <bug-IO-Compress [...] rt.cpan.org>; Tue, 18 Jun 2013 10:45:47 -0400 (EDT)
Received:	(qmail 12521 invoked by alias); 18 Jun 2013 14:45:46 -0000
Received:	from vm-emlprdomg-06.its.yale.edu (HELO vm-emlprdomg-06.its.yale.edu) (130.132.50.169) by la.mx.develooper.com (qpsmtpd/0.28) with ESMTP; Tue, 18 Jun 2013 07:45:36 -0700
Received:	from Aurora.local ([128.36.153.75]) (authenticated bits=0) by vm-emlprdomg-06.its.yale.edu (8.14.5/8.14.5) with ESMTP id r5IEj42h007393 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 18 Jun 2013 10:45:04 -0400
Delivered-To:	cpan-bug+IO-Compress [...] hipster.bestpractical.com
Subject:	io-compress 2.061 fails bzip2 tests on OS X 10.7
User-Agent:	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6
X-Proofpoint-Virus-Version:	vendor=fsecure engine=2.50.10432:5.10.8794,1.0.431,0.0.0000 definitions=2013-06-18_05:2013-06-18,2013-06-18,1970-01-01 signatures=0
Return-Path:	<fink [...] snaggledworks.com>
X-RT-Mail-Extension:	io-compress
X-Original-To:	cpan-bug+IO-Compress [...] hipster.bestpractical.com
X-Spam-Check-BY:	la.mx.develooper.com
X-Yale-Not-Spam:	For more info see: http://www.yale.edu/email/spam/content.html
Date:	Tue, 18 Jun 2013 10:45:04 -0400
X-Spam-Level:
To:	bug-IO-Compress [...] rt.cpan.org
Content-Transfer-Encoding:	7bit
From:	Hanspeter Niederstrasser <fink [...] snaggledworks.com>
X-RT-Original-Encoding:	iso-8859-1
X-RT-Interface:	Email
Content-Length:	4482

Download (untitled) / with headers
text/plain 4.3k

While building io-compress-2.0.61 on OS X 10.7, all the bzip2 tests fail. I am using Apple's perl 5.12.3. compres-raw-bzip2 is at 2.061, and it passed all of its tests. This is the build log truncated around the first couple failing tests. The full log is at <http://www.snaggledworks.com/fink/logs/fink-build-log_io-compress-pm5123_2.061-1_2013.06.18-10.37.50> + make test PERL_DL_NONLAZY=1 /usr/bin/arch -x86_64 perl5.12 "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t t/000prereq.t ................... ok t/001bzip2.t .................... ok .... t/100generic-zip.t .............. ok bad bad bad at t/compress/CompTestUtils.pm line 647. # Looks like your test died before it could output anything. t/101truncate-bzip2.t ........... Dubious, test returned 255 (wstat 65280, 0xff00) Failed 4012/4012 subtests t/101truncate-deflate.t ......... ok .... t/103newtied-zip.t .............. ok # Failed test (t/compress/destroy.pl at line 52) # got: '' # expected: 'hello world # this is a test # ' # Failed test (t/compress/destroy.pl at line 74) # Looks like you failed 2 tests of 15. t/104destroy-bzip2.t ............ Dubious, test returned 2 (wstat 512, 0x200) Failed 2/15 subtests t/104destroy-deflate.t .......... ok t/104destroy-gzip.t ............. ok t/104destroy-rawdeflate.t ....... ok t/104destroy-zip.t .............. ok # Failed test (t/compress/oneshot.pl at line 305) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 319) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 334) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 349) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 367) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 385) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 404) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 420) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 440) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 460) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 477) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 500) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 305) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 319) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 334) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 349) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 367) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 385) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 404) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 420) # got: '' # expected: 'abcde' # Failed test (t/compress/oneshot.pl at line 440) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 460) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 477) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 500) # got: 'abcde' # expected: '' # Failed test (t/compress/oneshot.pl at line 551) # Structures begin differing at: # $got->[1] = '' # $expected->[1] = 'data1' Error uncompressing -- Inflation Error: data error at t/compress/CompTestUtils.pm line 545. main::anyUncompress('ARRAY(0x7fd529a72df8)') called at t/compress/oneshot.pl line 567 main::run() called at t/105oneshot-bzip2.t line 22 # Looks like you planned 989 tests but only ran 475. # Looks like your test died just after 475. t/105oneshot-bzip2.t ............ Dubious, test returned 255 (wstat 65280, 0xff00) Failed 539/989 subtests (less 2 skipped subtests: 448 okay) t/105oneshot-deflate.t .......... ok And it keeps going on like that, failing all bzip2 tests. Hanspeter

# Tue Jun 18 15:16:05 2013 pmqs [...] cpan.org - Correspondence added

MIME-Version:	1.0
In-Reply-To:	<51C07270.7050503 [...] snaggledworks.com>
X-Mailer:	MIME-tools 5.504 (Entity 5.504)
Content-Disposition:	inline
X-RT-Interface:	Web
References:	<51C07270.7050503 [...] snaggledworks.com>
Content-Type:	text/plain; charset="utf-8"
Message-ID:	<rt-4.0.13-31923-1371582965-890.86234-0-0 [...] rt.cpan.org>
Content-Transfer-Encoding:	binary
X-RT-Original-Encoding:	utf-8
X-RT-Encrypt:	0
X-RT-Sign:	0
Content-Length:	895

Download (untitled) / with headers
text/plain 895b

Hey Hanspeter, very strange. The error that jumps out at me is this one # Failed test (t/compress/multi.pl at line 201) # $gz isn't a 'IO::Uncompress::Bunzip2' it's a 'IO::Uncompress::RawInflate' That's saying that I uncompressed some content, but it wasn't the expected type of bzip2, it was rawinflate. Could you try temporarily moving this block of code from AnyUncompress.pm if (defined $IO::Uncompress::Bunzip2::VERSION and $magic = $self->ckMagic('Bunzip2')) { *$self->{Info} = $self->readHeader($magic) or return undef ; my ($obj, $errstr, $errno) = IO::Uncompress::Adapter::Bunzip2::mkUncompObject(); return $self->saveErrorString(undef, $errstr, $errno) if ! defined $obj; *$self->{Uncomp} = $obj; return 1; } to just before the line # try zlib first Does that help? Paul

# Tue Jun 18 15:16:05 2013 The RT System itself - Status changed from 'new' to 'open'

# Tue Jun 18 21:12:26 2013 fink [...] snaggledworks.com - Correspondence added

From fink [...] snaggledworks.com Tue Jun 18 21:	12:25 2013
MIME-Version:	1.0
X-Spam-Status:	No, score=-6.9 tagged_above=-99.9 required=10 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5] autolearn=ham
In-Reply-To:	<rt-4.0.13-31923-1371582965-736.86234-6-0 [...] rt.cpan.org>
X-Spam-Flag:	NO
X-RT-Interface:	API
References:	<RT-Ticket-86234 [...] rt.cpan.org> <51C07270.7050503 [...] snaggledworks.com> <rt-4.0.13-31923-1371582965-736.86234-6-0 [...] rt.cpan.org>
X-Proofpoint-Spam-Details:	rule=notspam policy=default score=0 spamscore=0 suspectscore=1 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1305240000 definitions=main-1306180286
X-Virus-Scanned:	Debian amavisd-new at bestpractical.com
Message-ID:	<51C10568.9080800 [...] snaggledworks.com>
content-type:	text/plain; charset="utf-8"; format="flowed"
X-RT-Original-Encoding:	utf-8
X-Spam-Score:	-6.9
Received:	from localhost (localhost [127.0.0.1]) by hipster.bestpractical.com (Postfix) with ESMTP id 78A15240B50 for <cpan-bug+IO-Compress [...] hipster.bestpractical.com>; Tue, 18 Jun 2013 21:12:25 -0400 (EDT)
Received:	from hipster.bestpractical.com ([127.0.0.1]) by localhost (hipster.bestpractical.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Dm9KRRE7INLH for <cpan-bug+IO-Compress [...] hipster.bestpractical.com>; Tue, 18 Jun 2013 21:12:23 -0400 (EDT)
Received:	from la.mx.develooper.com (x1.develooper.com [207.171.7.70]) by hipster.bestpractical.com (Postfix) with SMTP id 54A352409CB for <bug-IO-Compress [...] rt.cpan.org>; Tue, 18 Jun 2013 21:12:22 -0400 (EDT)
Received:	(qmail 25604 invoked by alias); 19 Jun 2013 01:12:22 -0000
Received:	from vm-emlprdomg-08.its.yale.edu (HELO vm-emlprdomg-08.its.yale.edu) (130.132.50.187) by la.mx.develooper.com (qpsmtpd/0.28) with ESMTP; Tue, 18 Jun 2013 18:12:15 -0700
Received:	from [192.168.1.123] (99-18-15-204.lightspeed.wlfrct.sbcglobal.net [99.18.15.204]) (authenticated bits=0) by vm-emlprdomg-08.its.yale.edu (8.14.5/8.14.5) with ESMTP id r5J1C8Rp009749 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for <bug-IO-Compress [...] rt.cpan.org>; Tue, 18 Jun 2013 21:12:08 -0400
Delivered-To:	cpan-bug+IO-Compress [...] hipster.bestpractical.com
User-Agent:	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6
Subject:	Re: [rt.cpan.org #86234] io-compress 2.061 fails bzip2 tests on OS X 10.7
Return-Path:	<fink [...] snaggledworks.com>
X-Proofpoint-Virus-Version:	vendor=fsecure engine=2.50.10432:5.10.8794,1.0.431,0.0.0000 definitions=2013-06-18_09:2013-06-18,2013-06-18,1970-01-01 signatures=0
X-Spam-Check-BY:	la.mx.develooper.com
X-Original-To:	cpan-bug+IO-Compress [...] hipster.bestpractical.com
X-RT-Mail-Extension:	io-compress
Date:	Tue, 18 Jun 2013 21:12:08 -0400
X-Yale-Not-Spam:	For more info see: http://www.yale.edu/email/spam/content.html
X-Spam-Level:
To:	bug-IO-Compress [...] rt.cpan.org
Content-Transfer-Encoding:	7bit
From:	Hanspeter Niederstrasser <fink [...] snaggledworks.com>
RT-Message-ID:	<rt-4.0.13-14436-1371604346-1745.86234-0-0 [...] rt.cpan.org>
Content-Length:	1223

Download (untitled) / with headers
text/plain 1.1k

On 6/18/2013 3:16 PM, Paul Marquess via RT wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=86234 > > > Hey Hanspeter, > > very strange. The error that jumps out at me is this one > > # Failed test (t/compress/multi.pl at line 201) > # $gz isn't a 'IO::Uncompress::Bunzip2' it's a 'IO::Uncompress::RawInflate' > > That's saying that I uncompressed some content, but it wasn't the expected type of bzip2, it was rawinflate. > > Could you try temporarily moving this block of code from AnyUncompress.pm > > if (defined $IO::Uncompress::Bunzip2::VERSION and > $magic = $self->ckMagic('Bunzip2')) { > *$self->{Info} = $self->readHeader($magic) > or return undef ; > > my ($obj, $errstr, $errno) = IO::Uncompress::Adapter::Bunzip2::mkUncompObject(); > > return $self->saveErrorString(undef, $errstr, $errno) > if ! defined $obj; > > *$self->{Uncomp} = $obj; > > return 1; > } > > to just before the line > > # try zlib first > > > Does that help?

Yes it did. All tests successful. Files=87, Tests=71978, 55 wallclock secs ( 7.04 usr 0.61 sys + 33.27 cusr 2.66 csys = 43.58 CPU) Result: PASS Hanspeter