If I understand then yes you can. It’s a kinda convoluted, expensive, and hacky way to do what I think you’re asking. Plus you’ll probably have to, at some point, munge the IO layers so the TAP output isn’t visible. FWIW, I rely on it frequently in testing.

ok some_test(), "Some test passed"
    or diag "BUNCH O'DEBUG INFO or $@ or whatever...";
[download]

There is a Test::* space module that purports to run tests without output but I can’t remember the name because when I tried to use it a few months ago it did not work as advertised so I wouldn’t be recommending it even if I could remember it. :P