Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation

Re^4: Testing my tests

by szabgab (Priest)
on Feb 27, 2017 at 05:39 UTC ( #1182931=note: print w/replies, xml ) Need Help??

in reply to Re^3: Testing my tests
in thread Testing my tests (mutation testing)

I am not sure why do you see the requirements paradoxical. You were the closest by far to what I was thinking and brought an excellent example. I've updated the original post with that and some further explanation.

And you are right this probably requires the full introspection of all the code.

Replies are listed 'Best First'.
Re^5: Testing my tests
by LanX (Sage) on Feb 27, 2017 at 06:04 UTC
    > the requirements paradoxical.

    because without further explanation it sounded like

    • wanting tests that never fail
    • or having test heuristics intelligent enough to make you unemployed.

    at least now I'm sure what your up to.

    Regarding your update, you can't avoid false positive tests.

    But like I said you can reduce the likelyhood of them drastically for a reasonable prize by bundling many random test vectors.

    Some my produce false positives, but hardly all of them.

    In our case (2,0) may be OK but (666,42) would not.

    Cheers Rolf
    (addicted to the Perl Programming Language and ☆☆☆☆ :)
    Je suis Charlie!

Log In?

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1182931]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others surveying the Monastery: (4)
As of 2022-08-08 22:31 GMT
Find Nodes?
    Voting Booth?

    No recent polls found