You could do that, but beware that the TAP standard is slowly evolving. You need to make sure that you can cope when new features are added to it. You may also need to cope with code that doesn't actually use Test::More and just outputs something vaguely TAP-ish. Lots of old code's test suites contain things like this:

print 'not ' unless($foo == 42);
print 'ok '.$test++."\n";
[download]

instead of

ok($foo == 42);
[download]