Is it really the case that scripts and applications that depend on old modules will get broken if they are removed from CPAN?

They would be broken in the sense that if module Foo depending on CPAN module Bar, and module Bar was removed, then Foo could no longer be easily installed via CPAN. The person who wanted to use Foo would have to figure out what had happened and install Bar manually from backpan.