Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid
 
PerlMonks  

Re: How to merge two different coverage reports remotely

by 1nickt (Abbot)
on May 25, 2021 at 20:57 UTC ( #11133025=note: print w/replies, xml ) Need Help??


in reply to How to merge two different coverage reports remotely

Hi,

"The code that I test is the same on both sites"

So why do you need to run the coverage report on both hosts?


The way forward always starts with a minimal test.
  • Comment on Re: How to merge two different coverage reports remotely

Replies are listed 'Best First'.
Re^2: How to merge two different coverage reports remotely
by ovedpo15 (Pilgrim) on May 25, 2021 at 21:28 UTC
    Hi!
    Thank you for your comment. I test the code on different hosts, since it's depends on the environment. I copied the code to those hosts to be able to run it there and then get the results. It works but now I want to find the coverage. I want able to get the coverage for each one of them but I want to merge it into one report. The question is how?

      Hi again,

      "I test the code on different hosts, since it's depends on the environment."

      That's one thing, and should be done for sure. But generating a test coverage report depends on the codebase, not the environment, unless you're using it in some way I've not encountered.


      The way forward always starts with a minimal test.
        But generating a test coverage report depends on the codebase, not the environment, unless you're using it in some way I've not encountered.

        I hadn't chimed in because I've never tried merging the coverage report. But I can think of lots of situations where the environment will influence which code can be covered in a given environment, and thus will influence the test coverage report.

        Here are three examples:

        # the coverage report on MSWin32 will be different on Win10 from Ubunt +u Linux. # I assume the OP would like to merge the two reports to make sure tha +t all the # functions are covered at least once between the two (or more) differ +ent # environments if($^O eq 'MSWin32') { run_this_function(); } else { run_a_different_function(); } # or # the coverage report is different in the environment where # MY_ENV_VAR is set true vs where it's false or undefined, # and the OP would like to merge the two reports to make sure that all + the # functions are covered at least once between the two (or more) differ +ent # environments if( $ENV{MY_ENV_VAR} ) { run_special_case(); } # different parts of the code are covered depending on whether some ot +her # executable is found, so that it can be run if( -x '/x/y/bin/my_executable' ) { my $ret = qx(/x/y/bin/my_executable); # cannot run on system X, wher +e repo is in /a/b/repo/run.pl, and /x/y/ hierarchy might not even exi +st! ... error processing ... $some_outer_variable += $ret; }

        In all of these situations, on system X the coverage will show certain functions or blocks of code run, but others not; and system Y may have a different group of functions or blocks that are run. So for example, maybe each system can run the same 80% base coverage, but system X covers 5% of code blocks that cannot run on Y and system Y has 15% of code blocks that cannot run on X; the individual reports say 85% coverage on X and 95% coverage on Y, when in reality, together they make 100% coverage, but neither report shows that. So the OP is asking how to merge those so that they can tell whether or not all lines of code are covered in at least one of the test systems.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11133025]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (1)
As of 2021-10-16 08:30 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My first memorable Perl project was:







    Results (69 votes). Check out past polls.

    Notices?