Many Dist::Zilla project only have a dist.int and no Makefile.PL, so you will need the whole bloody suite to get started anyway.
However I applaud people using something to make their dist meet every standard and make their own lives easier to maintain and distribute their modules, IMHO Dist::Zilla is a (very) bad part of the toolchain to draw in fresh blood or make it easier for others (not using it) to submit changes.
I have not seen a project that uses Dist::Zilla where I could get away without Dist::Zilla installed
Enjoy, Have FUN! H.Merijn