Do you mean the name of the tarball?
Yes.
I've wandered around for days looking for an issue tracker for the development releases like there is for the full releases.
Is there such a thing?
Yes, it's at https://rt.cpan.org/. You can raise issues against dev releases there just the same as prod releases.
The Kwalitee thing talks about META.yml or META.json but the tools create MYMETA.* instead.
Do I just rename them?
No! Those are totally different - the MYMETA.* files are generated when the user installs the module. Do not distribute these. The META.* files should be generated by you when you roll the release and should be distributed. The make dist should handle this for you automatically - if not, check your Makefile.PL and/or MANIFEST. See the Module Meta-Data section of the EU::MM docs for more on this.
Are there alternative interfaces to this
Maybe, assuming you mean The Monastery. Although the normal interface at https://www.perlmonks.org/ is highly customisable if that's what you're after. See How do I change my preferences?