|Subject:||install_tested may install distributions not listed in is_tested|
It seems that install_tested installs also optional prerequisites (if recommends_policy is set to a true value), but this is not previously reported by is_tested. Attached is a Dockerfile which reproduces the problem with CPAN 2.21-TRIAL (but earlier versions are probably also affected --- I encountered this problem also with 2.16, I think). Here are the interesting lines of the output: ... Result: PASS MARIOROY/MCE-1.837.tar.gz /usr/bin/make test -- OK Call now is_tested: Fri Nov 30 17:09:44 2018 /root/.cpan/build/MCE-1.837-0 Call now install_tested: install_tested: Running for MARIOROY/MCE-1.837.tar.gz Running install for module 'Sereal::Encoder' Fetching with HTTP::Tiny: ... That is: MCE was tested (and just MCE), then is_tested correctly reports that only this distribution was tested, and install_tested continues with building and testing other modules... What I would expect: Either: install_tested only installs what was reported by is_tested, and ignores the recommends_policy setting. Or: "test Something" would test the optional prereqs in the same phase as normal prereqs (but ignores failures of these prereqs). Then is_tested would probably report exactly the same what would be installed later with install_tested.
Message body not shown because it is not plain text.