Skip Menu |
 

This queue is for tickets about the Hadoop-Streaming CPAN distribution.

Report information
The Basics
Id: 59164
Status: resolved
Priority: 0/
Queue: Hadoop-Streaming

People
Owner: SPAZM [...] cpan.org
Requestors: SPAZM [...] cpan.org
Cc:
AdminCc:

Bug Information
Severity: Important
Broken in:
  • 0.100050
  • 0.100060
  • 0.100270
Fixed in:
  • 0.101880
  • 0.101881



Download (untitled) / with headers
text/plain 5.5k
Automated smoke test failures on multiple platforms. I assume this has to do with problems making system calls out to run more perl copies to simulate running nthe independent mapper and reducer scripts. 0.101860 introduced better logging on STDERR errors from these calls to Test::Command. There are now lots of reports with two general themes: can't load moose, can't load .so for Sub::Name. 1) Can't find moose: # Failed test 'map stderr is blank' # at t/01-wordcount.t line 31. # got: 'Can't locate Moose.pm in @INC (@INC contains: /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/blib/lib /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/blib/arch /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/arch /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/lib /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/arch /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/lib /usr/perl5/5.8.4/lib/i86pc-solaris-64int /usr/perl5/5.8.4/lib /usr/perl5/site_perl/5.8.4/i86pc-solaris-64int /usr/perl5/site_perl/5.8.4 /usr/perl5/site_perl /usr/perl5/vendor_perl/5.8.4/i86pc-solaris-64int /usr/perl5/vendor_perl/5.8.4 /usr/perl5/vendor_perl .) at /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/t/wordcount/map.pl line 4. # BEGIN failed--compilation aborted at /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/t/wordcount/map.pl line 4. http://www.cpantesters.org/cpan/report/07563141-b19f-3f77-b713-d32bba55d77f http://www.cpantesters.org/cpan/report/07566623-b19f-3f77-b713-d32bba55d77f http://www.cpantesters.org/cpan/report/07565919-b19f-3f77-b713-d32bba55d77f 2) Can't load Sub::Name [ERROR] [Tue Jul 6 13:03:00 2010] MAKE TEST failed: No such file or directory PERL_DL_NONLAZY=1 /usr/home/cpan/pit/bare/perl-5.10.0/bin/perl "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t t/00-load.t ....... ok ... # Failed test 'map stderr is blank' # at t/01-wordcount.t line 31. # got: 'Can't load '/usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Sub-Name-0.04/blib/arch/auto/Sub/Name/Name.so' for module Sub::Name: /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Sub-Name-0.04/blib/arch/auto/Sub/Name/Name.so: Undefined symbol "PL_unitcheckav" at /usr/local/lib/perl5/5.8.9/mach/DynaLoader.pm line 226. # at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP/Mixin/HasMethods.pm line 12 # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP/Mixin/HasMethods.pm line 12. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP/Mixin/HasMethods.pm line 12. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 18. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 18. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose.pm line 14. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose.pm line 14. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. # ' http://www.cpantesters.org/cpan/report/6c8c09ca-88f6-11df-ae63-e0e88fbefd91 http://www.cpantesters.org/cpan/report/07570221-b19f-3f77-b713-d32bba55d77f 3) Just found a third: a problem with weaken in Class::MOP requiring XS version of Scalar::Util. I wonder how I list that as a requirement? # Failed test 'map stderr is blank' # at t/01-wordcount.t line 31. # got: 'weaken is only available with the XS version of Scalar::Util at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 12 # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 12. # Compilation failed in require at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # Compilation failed in require at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose.pm line 14. # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose.pm line 14. # Compilation failed in require at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. http://www.cpantesters.org/cpan/report/07570938-b19f-3f77-b713-d32bba55d77f
Download (untitled) / with headers
text/plain 351b
released Hadoop-Streaming-0.101880 with change to query Config module for perl path instead of 'env perl' hack. Will see if this improves test results. If you have downloaded Hadoop::Streaming and it failed to build, please comment on this ticket so I can get this working for more people. It works for me, which is making testing/fixing difficult.
Subject: Test results for 101880 look good so far
Download (untitled) / with headers
text/plain 762b
Test results for 101880: first 7 results are PASS, but those look like they are all from the same box. http://www.cpantesters.org/distro/H/Hadoop-Streaming.html#Hadoop-Streaming-0.101880 Grade Perl version OS name OS version Architecture PASS 5.8.7 Linux 2.6.26-1-amd64 x86_64-linux-thread-multi-ld PASS 5.8.9 Linux 2.6.26-1-amd64 x86_64-linux PASS 5.10.1 Linux 2.6.30-1-amd64 x86_64-linux-ld PASS 5.12.1 Linux 2.6.32-2-amd64 x86_64-linux PASS 5.13.0 Linux 2.6.32-2-amd64 x86_64-linux-thread-multi-ld PASS 5.13.1 Linux 2.6.32-2-amd64 x86_64-linux-thread-multi-ld PASS 5.13.2 Linux 2.6.32-2-amd64 x86_64-linux I'm glad they're able to pull 101880 for testing. I'm still seeing 100270, not even 101870 from 3 days ago. Not sure what that is all about.
fixed with the changes for 0.01880 and 0.01881!


This service is sponsored and maintained by Best Practical Solutions and runs on Perl.org infrastructure.

Please report any issues with rt.cpan.org to rt-cpan-admin@bestpractical.com.