Skip Menu |
 

This queue is for tickets about the Dist-Zilla-Plugin-Test-EOL CPAN distribution.

Report information
The Basics
Id: 76038
Status: resolved
Priority: 0/
Queue: Dist-Zilla-Plugin-Test-EOL

People
Owner: Nobody in particular
Requestors: dolmen [...] cpan.org
Cc:
AdminCc:

Bug Information
Severity: Critical
Broken in: 0.04
Fixed in: 0.05



Subject: Tests should not be skipped if Test::EOL is missing
MIME-Version: 1.0
Content-Type: text/plain; charset="UTF-8"
X-Mailer: MIME-tools 5.427 (Entity 5.427)
Content-Disposition: inline
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
Content-Length: 358
Download (untitled) / with headers
text/plain 358b
DZP::Test::EOL is a release plugin. What is the point of adding a test to the release if the test is simply skipped if a dependency is missing? That's the current problem of DZPTE. So, instead of conditionally loading Test::EOL with Test::Requires, the test should completely fail if Test::EOL is missing. -- Olivier Mengué - http://perlresume.org/DOLMEN
From xenoterracide [...] gmail.com Sun Mar 25 19: 37:36 2012
MIME-Version: 1.0
X-Spam-Status: No, score=-2.526 tagged_above=-99.9 required=10 tests=[AWL=-1.306, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, SPF_NEUTRAL=0.779] autolearn=no
In-Reply-To: <rt-3.8.HEAD-12231-1332717096-1154.76038-4-0 [...] rt.cpan.org>
X-Spam-Flag: NO
References: <RT-Ticket-76038 [...] rt.cpan.org> <rt-3.8.HEAD-12231-1332717096-1154.76038-4-0 [...] rt.cpan.org>
X-Virus-Scanned: Debian amavisd-new at bestpractical.com
Message-ID: <CAAHKNRHV81+uscemkuj_JP=HVbx6CFxMTJCxdHB5FamQi+quWQ [...] mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
X-RT-Original-Encoding: utf-8
X-Spam-Score: -2.526
Authentication-Results: hipster.bestpractical.com (amavisd-new); dkim=pass header.i= [...] gmail.com
Received: from localhost (localhost [127.0.0.1]) by hipster.bestpractical.com (Postfix) with ESMTP id 3A0682400DB for <cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com>; Sun, 25 Mar 2012 19:37:36 -0400 (EDT)
Received: from hipster.bestpractical.com ([127.0.0.1]) by localhost (hipster.bestpractical.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kKhU0NviW10l for <cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com>; Sun, 25 Mar 2012 19:37:35 -0400 (EDT)
Received: from la.mx.develooper.com (x1.develooper.com [207.171.7.70]) by hipster.bestpractical.com (Postfix) with SMTP id 2419924002A for <bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org>; Sun, 25 Mar 2012 19:37:34 -0400 (EDT)
Received: (qmail 13940 invoked by uid 103); 25 Mar 2012 23:37:34 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 25 Mar 2012 23:37:34 -0000
Received: from mail-ob0-f178.google.com (HELO mail-ob0-f178.google.com) (209.85.214.178) by 16.mx.develooper.com (qpsmtpd/0.80/v0.80-19-gf52d165) with ESMTP; Sun, 25 Mar 2012 16:37:27 -0700
Received: by obbuo19 with SMTP id uo19so5077644obb.9 for <bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org>; Sun, 25 Mar 2012 16:37:20 -0700 (PDT)
Received: by 10.60.18.137 with SMTP id w9mr24534419oed.7.1332718640722; Sun, 25 Mar 2012 16:37:20 -0700 (PDT)
Received: by 10.60.19.8 with HTTP; Sun, 25 Mar 2012 16:37:20 -0700 (PDT)
Delivered-To: cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com
Subject: Re: [rt.cpan.org #76038] Tests should not be skipped if Test::EOL is missing
Return-Path: <xenoterracide [...] gmail.com>
Dkim-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=AXPKFQkru2TtsNGQGLNW8VLvnhrFINSFsBGeQvBkP7k=; b=uMtABeUeCSVQw5y47aPEZceJeLvLoqveJRYF9Yl04jzPrF9kVP6qWgIoWhiKQJvnDM JCw3ZhbUzYDQVma/nrwKCC/wrFJ9lgoa7qwapfpd9NZiC1hlIW/f3Sl1IONNrYzcOipU lWte7f2T133rkoHrDgIl/zsB85PQV2cWJ1uQjU2j9wAllT9Zn/sElinAkGIkkyERMOFf BDjYFYYZLvAe3Pxro7GkB7wZz7lp4OMNYKyhEbf1t8Z5/ShIxc61nfJRYAG+7JZa0PhY /6c7VkQ6gRsnrMPU/Jauxb54qV1dWe9oHo0XzgBlpuLFllnMrmMRVJr6N+ak9ML7m0Sq aVcA==
X-Spam-Check-BY: 16.mx.develooper.com
X-Original-To: cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com
X-RT-Mail-Extension: dist-zilla-plugin-test-eol
Date: Sun, 25 Mar 2012 18:37:20 -0500
X-Spam-Level:
To: bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org
Content-Transfer-Encoding: quoted-printable
From: Caleb Cushing <xenoterracide [...] gmail.com>
RT-Message-ID: <rt-3.8.HEAD-10814-1332718656-397.76038-0-0 [...] rt.cpan.org>
Content-Length: 1063
2012/3/25 Olivier Mengué via RT <bug-Dist-Zilla-Plugin-Test-EOL@rt.cpan.org>: Show quoted text
> DZP::Test::EOL is a release plugin. > What is the point of adding a test to the release if the test is simply > skipped if a dependency is missing?
Actually it's an Author test not a release test Show quoted text
> That's the current problem of DZPTE. > > So, instead of conditionally loading Test::EOL with Test::Requires, the > test should completely fail if Test::EOL is missing.
I see your point though, I need to confer with Mike Doherty, because this plugin is a part of TestingMania, and I believe he currently would rather stuff skip instead of fail. I was pretty sure thought that installing this plugin actually requires you to have Test::EOL installed... though it appears that I forgot to add it, I'll see about doing that by the end of the week (my workstation at home currently has network issues). The idea was more that people just running the test suite can have it skipped, though perhaps that's a mistake given it's an author test. -- Caleb Cushing http://xenoterracide.com
From xenoterracide [...] gmail.com Sun Mar 25 19: 38:16 2012
MIME-Version: 1.0
X-Spam-Status: No, score=-2.506 tagged_above=-99.9 required=10 tests=[AWL=-1.286, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, SPF_NEUTRAL=0.779] autolearn=no
In-Reply-To: <CAAHKNRHV81+uscemkuj_JP=HVbx6CFxMTJCxdHB5FamQi+quWQ [...] mail.gmail.com>
X-Spam-Flag: NO
References: <RT-Ticket-76038 [...] rt.cpan.org> <rt-3.8.HEAD-12231-1332717096-1154.76038-4-0 [...] rt.cpan.org> <CAAHKNRHV81+uscemkuj_JP=HVbx6CFxMTJCxdHB5FamQi+quWQ [...] mail.gmail.com>
X-Virus-Scanned: Debian amavisd-new at bestpractical.com
Message-ID: <CAAHKNRH43y=DGQuV9PWe2O51Re_tfbpSuPXdzkFYs0k35P+=9Q [...] mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
X-RT-Original-Encoding: utf-8
X-Spam-Score: -2.506
Authentication-Results: hipster.bestpractical.com (amavisd-new); dkim=pass header.i= [...] gmail.com
Received: from localhost (localhost [127.0.0.1]) by hipster.bestpractical.com (Postfix) with ESMTP id 372DC2400DB for <cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com>; Sun, 25 Mar 2012 19:38:16 -0400 (EDT)
Received: from hipster.bestpractical.com ([127.0.0.1]) by localhost (hipster.bestpractical.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id M0uF7QUZAXBe for <cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com>; Sun, 25 Mar 2012 19:38:15 -0400 (EDT)
Received: from la.mx.develooper.com (x1.develooper.com [207.171.7.70]) by hipster.bestpractical.com (Postfix) with SMTP id 2BB1924002A for <bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org>; Sun, 25 Mar 2012 19:38:15 -0400 (EDT)
Received: (qmail 13983 invoked by uid 103); 25 Mar 2012 23:38:14 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 25 Mar 2012 23:38:14 -0000
Received: from mail-ob0-f178.google.com (HELO mail-ob0-f178.google.com) (209.85.214.178) by 16.mx.develooper.com (qpsmtpd/0.80/v0.80-19-gf52d165) with ESMTP; Sun, 25 Mar 2012 16:38:12 -0700
Received: by obbuo19 with SMTP id uo19so5078230obb.9 for <bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org>; Sun, 25 Mar 2012 16:38:09 -0700 (PDT)
Received: by 10.60.18.137 with SMTP id w9mr24535952oed.7.1332718689450; Sun, 25 Mar 2012 16:38:09 -0700 (PDT)
Received: by 10.60.19.8 with HTTP; Sun, 25 Mar 2012 16:38:09 -0700 (PDT)
Delivered-To: cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com
Subject: Re: [rt.cpan.org #76038] Tests should not be skipped if Test::EOL is missing
Return-Path: <xenoterracide [...] gmail.com>
Dkim-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=XjAgZElBGUTABk7o/L0j+QeZCq+1P74Kl/YPjNb/yXM=; b=pewLRc4z8gZ6Ib7JExoIjSE7SGoQ+d0/Yp33HGmquYdm3YwVWzt/7J6j8T29rci9kI 7pMOyUAIc0nL6SJqrxwBihu+CpR/ZddfMHmFNEN2hZw1MZiIB7NcMzII0rsT0uLU2PVj QMT104gh9YdY57SQvYHF+s+pt4kQnjV0Aj8vwKMd9WTYT4RUrtIWPnczxM2L+1lbd+Ff GgxmU3oCyOmAG50wKLH5QvxnpKBAorlv2hh5KfUFwzJ9/pcpgFgH2lyL86YPsfNYetmK fddyoqdo0FjhXeqMCWwyXyjjYGBs2ML/3gqZF9D+TNIYW9odAZ8kq+HjuDNDS6MEHUW9 fAiw==
X-Spam-Check-BY: 16.mx.develooper.com
X-Original-To: cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com
X-RT-Mail-Extension: dist-zilla-plugin-test-eol
Date: Sun, 25 Mar 2012 18:38:09 -0500
X-Spam-Level:
To: bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org
From: Caleb Cushing <xenoterracide [...] gmail.com>
RT-Message-ID: <rt-3.8.HEAD-12231-1332718696-1152.76038-0-0 [...] rt.cpan.org>
Content-Length: 156
Download (untitled) / with headers
text/plain 156b
also , per the pod Please report any bugs or feature requests on the bugtracker website https://github.com/xenoterracide/Dist-Zilla-Plugin-Test-EOL/issues
MIME-Version: 1.0
X-Mailer: MIME-tools 5.427 (Entity 5.427)
Content-Disposition: inline
Content-Type: text/plain; charset="UTF-8"
Message-ID: <rt-3.8.HEAD-12231-1333145688-958.76038-0-0 [...] rt.cpan.org>
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
Content-Length: 979
Download (untitled) / with headers
text/plain 979b
On Sun Mar 25 19:11:35 2012, DOLMEN wrote: Show quoted text
> DZP::Test::EOL is a release plugin. > What is the point of adding a test to the release if the test is
simply Show quoted text
> skipped if a dependency is missing? > That's the current problem of DZPTE. > > So, instead of conditionally loading Test::EOL with Test::Requires,
the Show quoted text
> test should completely fail if Test::EOL is missing.
This test injects a test into the dist that'll be uploaded to PAUSE. If an end-user runs the test, I don't see why it should fail if they don't already have Test::EOL installed - I think skipping is the right behaviour there. If you're working on the module, it is your responsibility to have Test::EOL installed. To that end, I think the Dist::Zilla plugin should require Test::EOL (because, if you don't have it then how will you run your tests prior to release in a meaningful way?). I take it you disagree with the first case there - you want the end- user's tests to fail, right? My question is why.
From xenoterracide [...] gmail.com Fri Mar 30 18: 28:47 2012
MIME-Version: 1.0
X-Spam-Status: No, score=-2.469 tagged_above=-99.9 required=10 tests=[AWL=-1.249, BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, SPF_NEUTRAL=0.779] autolearn=no
In-Reply-To: <rt-3.8.HEAD-12231-1333145688-522.76038-5-0 [...] rt.cpan.org>
X-Spam-Flag: NO
References: <RT-Ticket-76038 [...] rt.cpan.org> <rt-3.8.HEAD-12231-1333145688-522.76038-5-0 [...] rt.cpan.org>
X-Virus-Scanned: Debian amavisd-new at bestpractical.com
Message-ID: <CAAHKNREHfr6=epnTfeG-erEXpTTy68TKskwj189SPx1VRtmCCw [...] mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
X-RT-Original-Encoding: utf-8
X-Spam-Score: -2.469
Authentication-Results: hipster.bestpractical.com (amavisd-new); dkim=pass header.i= [...] gmail.com
Received: from localhost (localhost [127.0.0.1]) by hipster.bestpractical.com (Postfix) with ESMTP id F201724021F for <cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com>; Fri, 30 Mar 2012 18:28:46 -0400 (EDT)
Received: from hipster.bestpractical.com ([127.0.0.1]) by localhost (hipster.bestpractical.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JMLzPu+WLCWj for <cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com>; Fri, 30 Mar 2012 18:28:46 -0400 (EDT)
Received: from la.mx.develooper.com (x1.develooper.com [207.171.7.70]) by hipster.bestpractical.com (Postfix) with SMTP id DA194240212 for <bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org>; Fri, 30 Mar 2012 18:28:45 -0400 (EDT)
Received: (qmail 13878 invoked by uid 103); 30 Mar 2012 22:28:45 -0000
Received: from x16.dev (10.0.100.26) by x1.dev with QMQP; 30 Mar 2012 22:28:45 -0000
Received: from mail-ob0-f178.google.com (HELO mail-ob0-f178.google.com) (209.85.214.178) by 16.mx.develooper.com (qpsmtpd/0.80/v0.80-19-gf52d165) with ESMTP; Fri, 30 Mar 2012 15:28:41 -0700
Received: by obceq6 with SMTP id eq6so462924obc.9 for <bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org>; Fri, 30 Mar 2012 15:28:38 -0700 (PDT)
Received: by 10.182.89.36 with SMTP id bl4mr180693obb.33.1333146518760; Fri, 30 Mar 2012 15:28:38 -0700 (PDT)
Received: by 10.60.19.8 with HTTP; Fri, 30 Mar 2012 15:28:38 -0700 (PDT)
Delivered-To: cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com
Subject: Re: [rt.cpan.org #76038] Tests should not be skipped if Test::EOL is missing
Return-Path: <xenoterracide [...] gmail.com>
Dkim-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=DCXXWRI+gu72oXKGpnuADIIV60EWNRJcQqntZUcXIIs=; b=TEaPqvXpwaf3tchjLYeCipvGinA51QYcL6prlIhuW2PAFQTs5Ykj4zzUwpOQ1Ss4Yx sO1MSmdhjaxZjHzlmgY5tOQAuiRle5fCyBb193ewkJ5wqiIInehkL1GlrUJZPTpMp8ee GgPWV9aELG8Wi6eHdMd4abij5oEoDaPLjalnWRFW+hiCNlX5LnFgulqL6F2VFbIHFKqd sCU5fsovr/qpIjV+XLR3rGulV1R0moCWdMegxBSiM1UFxBQkuZ+SW48tKUqRuIY+2TSR aR9VBIuFUkNDqSnq/SU/zzqIAJTQc/ghlm4eurEjRuRvpxXlBWbd4dmRxH+NcCfTXM7K fveQ==
X-Spam-Check-BY: 16.mx.develooper.com
X-Original-To: cpan-bug+Dist-Zilla-Plugin-Test-EOL [...] hipster.bestpractical.com
X-RT-Mail-Extension: dist-zilla-plugin-test-eol
Date: Fri, 30 Mar 2012 17:28:38 -0500
X-Spam-Level:
To: bug-Dist-Zilla-Plugin-Test-EOL [...] rt.cpan.org
From: Caleb Cushing <xenoterracide [...] gmail.com>
RT-Message-ID: <rt-3.8.HEAD-12231-1333146527-851.76038-0-0 [...] rt.cpan.org>
Content-Length: 423
Download (untitled) / with headers
text/plain 423b
On Fri, Mar 30, 2012 at 5:14 PM, Mike Doherty via RT <bug-Dist-Zilla-Plugin-Test-EOL@rt.cpan.org> wrote: Show quoted text
> I take it you disagree with the first case there - you want the end- > user's tests to fail, right? My question is why.
I think what he's saying is this test will be skipped if AUTHOR_TESTING is not set, so it should be skipped for users anyways (unless they set that) -- Caleb Cushing http://xenoterracide.com
MIME-Version: 1.0
In-Reply-To: <rt-3.8.HEAD-12231-1333145688-958.76038-0-0 [...] rt.cpan.org>
X-Mailer: MIME-tools 5.427 (Entity 5.427)
Content-Disposition: inline
References: <rt-3.8.HEAD-12231-1333145688-958.76038-0-0 [...] rt.cpan.org>
Content-Type: text/plain; charset="UTF-8"
Message-ID: <rt-3.8.HEAD-2606-1333372904-1983.76038-0-0 [...] rt.cpan.org>
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
RT-Send-CC: xenoterracide [...] gmail.com
Content-Length: 1568
Download (untitled) / with headers
text/plain 1.5k
Le 2012-03-31 00:14:48, DOHERTY a écrit : Show quoted text
> This test injects a test into the dist that'll be uploaded to PAUSE. If > an end-user runs the test, I don't see why it should fail if they don't > already have Test::EOL installed - I think skipping is the right > behaviour there.
EOL problems are not the problem of the final user. They are problems of the author that he has to fix before a release. The test must be skipped on the user machine indepently of wether or not Test::EOL is installed or not. This behavior is correct. Show quoted text
> If you're working on the module, it is your responsibility to have > Test::EOL installed. To that end, I think the Dist::Zilla plugin should > require Test::EOL (because, if you don't have it then how will you run > your tests prior to release in a meaningful way?).
That's my point, and here are the problems: - dependencies are wrong in META.yml: Test::EOL and Test::Requires are missing from the dependencies of DZPTE, so they are not installed on the author machine when he installs DZPTE. The test will fail not because the author has wrong EOL, but because he doesn't have Test::Requires - Test::Requires will skip the test if Test::EOL instead of enforcing its presence. So once the author manually installs Test::Requires (because the problem above), the test succeed, but not because all EOL are fine. Instead it is because Test::EOL is missing so nothing has been tested, but a success is still reported. The fix: - drop Test::Requires usage as Test::EOL is mandatory for the author - add Test::EOL in dependencies
MIME-Version: 1.0
In-Reply-To: <rt-3.8.HEAD-2606-1333372904-1983.76038-0-0 [...] rt.cpan.org>
X-Mailer: MIME-tools 5.427 (Entity 5.427)
Content-Disposition: inline
References: <rt-3.8.HEAD-12231-1333145688-958.76038-0-0 [...] rt.cpan.org> <rt-3.8.HEAD-2606-1333372904-1983.76038-0-0 [...] rt.cpan.org>
Content-Type: text/plain; charset="UTF-8"
Message-ID: <rt-3.8.HEAD-2610-1333378548-275.76038-0-0 [...] rt.cpan.org>
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
RT-Send-CC: xenoterracide [...] gmail.com
Content-Length: 83


This service is sponsored and maintained by Best Practical Solutions and runs on Perl.org infrastructure.

Please report any issues with rt.cpan.org to rt-cpan-admin@bestpractical.com.