Skip Menu |
 

This queue is for tickets about the CPAN CPAN distribution.

Report information
The Basics
Id: 17353
Status: stalled
Priority: 0/
Queue: CPAN

People
Owner: ANDK [...] cpan.org
Requestors: adamk [...] cpan.org
Cc:
AdminCc:

Bug Information
Severity: Wishlist
Broken in: (no value)
Fixed in: (no value)



Subject: Allow CPAN.pm to detect bad/old mirrors
MIME-Version: 1.0
X-Mailer: MIME-tools 5.418 (Entity 5.418)
Content-Type: text/plain; charset="utf8"
Content-Disposition: inline
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
Content-Length: 1299
Download (untitled) / with headers
text/plain 1.2k
In the middle of November mirror.aarnet.edu.au, by far the most common Australian mirror, broke. It stopped syncing with the master site. And it was until 3 weeks later that I actually noticed, because I couldn't install something from the Recent list. It still hasn't been corrected. The oldest that a mirror should ever get is 9 days (one week, plus two more days to handle incorrect timezone settings and miscellania). One a mirror gets to 231 hours old, the CPAN client should flag it as old somehow (per-session, NOT saving it in the config) rotate the mirror to the end of the list of selected mirrors. Then, ONLY if all other mirrors in the list fail or are also old, should it try to pull files from the old mirror. By not saving the changes, if a month down the track the mirror resyncs, then the client will start to use it again. The data required to establish server age is easy to get. If you want to ignore this bug for now and consider it just a tracking module for me, please do. I'm developing parallel functionality to this (mirror autoselection) as part of writing the JSAN::Client module, and I hope to recycle some of this new functionality into CPAN.pm (and the 6CPAN client) down the line. But I thought I should leave it here to let you know I would like to do this.
X-Scanned-BY: AMaViS-ng at bestpractical
MIME-Version: 1.0
X-Spam-Status: No, hits=-2.5 required=8.0 tests=BAYES_00,FORGED_RCVD_HELO
X-Authentication-Warning: k75.linux.bogus: k set sender to andreas.koenig.gmwojprw [...] franz.ak.mind.de using -f
In-Reply-To: <rt-3.5.HEAD-28632-1138597203-1273.17353-4-0 [...] rt.cpan.org> (via RT's message of "Mon, 30 Jan 2006 00:00:03 -0500 (EST)")
Received-SPF: pass (x1.develooper.com: local policy)
References: <RT-Ticket-17353 [...] rt.cpan.org> <rt-3.5.HEAD-28632-1138597203-1273.17353-4-0 [...] rt.cpan.org>
Content-Type: text/plain; charset="utf-8"
X-RT-Original-Encoding: us-ascii
Received: from localhost (localhost.localdomain [127.0.0.1]) by diesel.bestpractical.com (Postfix) with ESMTP id 19CC64D8108 for <cpan-bug+cpan [...] diesel.bestpractical.com>; Mon, 30 Jan 2006 04:13:53 -0500 (EST)
Received: from la.mx.develooper.com (unknown [63.251.223.170]) by diesel.bestpractical.com (Postfix) with SMTP id EF2494D8106 for <bug-CPAN [...] rt.cpan.org>; Mon, 30 Jan 2006 04:13:40 -0500 (EST)
Received: (qmail 10482 invoked by alias); 30 Jan 2006 09:07:40 -0000
Received: from franz.ak.mind.de (HELO k75.linux.bogus) (212.42.235.66) by la.mx.develooper.com (qpsmtpd/0.28) with ESMTP; Mon, 30 Jan 2006 01:07:33 -0800
Received: from k75.linux.bogus (localhost.localdomain [127.0.0.1]) by k75.linux.bogus (8.13.5/8.13.5/Debian-3) with ESMTP id k0U97Tan014741 for <bug-CPAN [...] rt.cpan.org>; Mon, 30 Jan 2006 10:07:29 +0100
Received: (from k [...] localhost) by k75.linux.bogus (8.13.5/8.13.5/Submit) id k0U97ToF014738; Mon, 30 Jan 2006 10:07:29 +0100
Delivered-To: cpan-bug+cpan [...] diesel.bestpractical.com
User-Agent: Gnus/5.110004 (No Gnus v0.4) Emacs/21.4 (gnu/linux)
Subject: Re: [rt.cpan.org #17353] Allow CPAN.pm to detect bad/old mirrors
Return-Path: <andreas.koenig.gmwojprw [...] franz.ak.mind.de>
X-Spam-Check-BY: la.mx.develooper.com
X-Original-To: cpan-bug+cpan [...] diesel.bestpractical.com
Date: Mon, 30 Jan 2006 10:07:29 +0100
Message-Id: <87ek2qytgu.fsf [...] k75.linux.bogus>
To: bug-CPAN [...] rt.cpan.org
From: andreas.koenig.gmwojprw [...] franz.ak.mind.de (Andreas J. Koenig)
X-RT-Original-Encoding: utf-8
RT-Message-ID: <rt-3.5.HEAD-28619-1138612444-1655.17353-0-0 [...] rt.cpan.org>
Content-Length: 444
Download (untitled) / with headers
text/plain 444b
Show quoted text
>>>>> On Mon, 30 Jan 2006 00:00:03 -0500 (EST), " via RT" <bug-CPAN@rt.cpan.org> said:
Show quoted text
> But I thought I should leave it here to let you know I would like to do > this.
ACK. If I should come near the relevant code I'll do something about it, otherwise I'm looking forward to your implementation. To be safe, make sure you get the current version from the repository: https://pause.perl.org:5460/svn/cpanpm/trunk Thanks, -- andreas
X-Scanned-BY: AMaViS-ng at bestpractical
MIME-Version: 1.0
X-Spam-Status: No, hits=-2.6 required=8.0 tests=BAYES_00
In-Reply-To: <rt-3.5.HEAD-28619-1138612444-1655.17353-6-0 [...] rt.cpan.org>
Received-SPF: neutral (x1.develooper.com: local policy)
References: <RT-Ticket-17353 [...] rt.cpan.org> <rt-3.5.HEAD-28632-1138597203-1273.17353-4-0 [...] rt.cpan.org> <87ek2qytgu.fsf [...] k75.linux.bogus> <rt-3.5.HEAD-28619-1138612444-1655.17353-6-0 [...] rt.cpan.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at linearg.com
X-RT-Original-Encoding: utf-8
Received: from localhost (localhost.localdomain [127.0.0.1]) by diesel.bestpractical.com (Postfix) with ESMTP id 976644D8125 for <cpan-bug+cpan [...] diesel.bestpractical.com>; Mon, 30 Jan 2006 11:22:34 -0500 (EST)
Received: from la.mx.develooper.com (x1.develooper.com [63.251.223.170]) by diesel.bestpractical.com (Postfix) with SMTP id 3EC644D8123 for <bug-CPAN [...] rt.cpan.org>; Mon, 30 Jan 2006 11:22:33 -0500 (EST)
Received: (qmail 16656 invoked by alias); 30 Jan 2006 16:22:00 -0000
Received: from starfury.linearg.com (HELO starfury.linearg.com) (202.90.48.2) by la.mx.develooper.com (qpsmtpd/0.28) with ESMTP; Mon, 30 Jan 2006 08:21:50 -0800
Received: from localhost (localhost [127.0.0.1]) by starfury.linearg.com (Postfix) with ESMTP id BEB1780228CB for <bug-CPAN [...] rt.cpan.org>; Tue, 31 Jan 2006 03:21:42 +1100 (EST)
Received: from starfury.linearg.com ([127.0.0.1]) by localhost (starfury [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 11778-10 for <bug-CPAN [...] rt.cpan.org>; Tue, 31 Jan 2006 03:21:42 +1100 (EST)
Received: from [172.31.0.178] (hq-nat.linearg.net [202.90.48.125]) by starfury.linearg.com (Postfix) with ESMTP id 8516680228C7 for <bug-CPAN [...] rt.cpan.org>; Tue, 31 Jan 2006 03:21:42 +1100 (EST)
Delivered-To: cpan-bug+cpan [...] diesel.bestpractical.com
Subject: Re: [rt.cpan.org #17353] Allow CPAN.pm to detect bad/old mirrors
User-Agent: Thunderbird 1.5 (Windows/20051201)
Return-Path: <adam [...] phase-n.com>
X-Spam-Check-BY: la.mx.develooper.com
X-Original-To: cpan-bug+cpan [...] diesel.bestpractical.com
Date: Tue, 31 Jan 2006 03:19:12 +1100
Message-Id: <43DE3C80.9080108 [...] phase-n.com>
To: bug-CPAN [...] rt.cpan.org
Content-Transfer-Encoding: 7bit
From: Adam Kennedy <adam [...] phase-n.com>
X-RT-Original-Encoding: utf-8
RT-Message-ID: <rt-3.5.HEAD-28642-1138638159-90.17353-0-0 [...] rt.cpan.org>
Content-Length: 551
Download (untitled) / with headers
text/plain 551b
I'll let you know before I do anything. andreas.koenig.gmwojprw@franz.ak.mind.de via RT wrote: Show quoted text
>>>>>> On Mon, 30 Jan 2006 00:00:03 -0500 (EST), " via RT" <bug-CPAN@rt.cpan.org> said:
>
> > But I thought I should leave it here to let you know I would like to do > > this.
> > ACK. If I should come near the relevant code I'll do something about > it, otherwise I'm looking forward to your implementation. To be safe, > make sure you get the current version from the repository: > > https://pause.perl.org:5460/svn/cpanpm/trunk > > Thanks,
MIME-Version: 1.0
X-Mailer: MIME-tools 5.418 (Entity 5.418)
Content-Disposition: inline
Message-Id: <rt-3.6.HEAD-23174-1163576169-497.17353-0-0 [...] rt.cpan.org>
Content-Type: text/plain; charset="utf8"
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
X-RT-Original-Encoding: utf-8
Content-Length: 603
Download (untitled) / with headers
text/plain 603b
Just to keep the ticket up to date: 1.88_62 now has the hosts command. If the user has a few URLs in the urllist and has set randomize_urllist to something > 0 and has downloaded a few items, the hosts command displays two small statistical tables about baandwidth and failed downloads. Next thing to do is to integrate freshness and find a formula to calculate the best hosts: fewest failed downloads, highest bandwidth, average freshness. One should always combine the own dataset with data from http://www.cs.uu.nl/people/henkp/mirmon/cpan.html because calculating these is an unnecessary burden.
MIME-Version: 1.0
X-Mailer: MIME-tools 5.427 (Entity 5.427)
Content-Disposition: inline
Content-Type: text/plain; charset="UTF-8"
Message-ID: <rt-3.8.HEAD-3226-1281111136-1498.17353-0-0 [...] rt.cpan.org>
Content-Transfer-Encoding: binary
X-RT-Original-Encoding: utf-8
Content-Length: 252
Download (untitled) / with headers
text/plain 252b
What is missing according to this ticket is some kind of warning when a user is running against bad mirrors. I have no clear picture in mind how this might look like and how it should be implemented. I'd neither consider it trivial nor very important.


This service is sponsored and maintained by Best Practical Solutions and runs on Perl.org infrastructure.

Please report any issues with rt.cpan.org to rt-cpan-admin@bestpractical.com.