And if files are all that are needed (no directories), why not filter out all directories, not just those 2 special ones?

   my @files = grep {-f "$dir/$_"} readdir(DIR);
[download]

where $dir is the directory path which DIR points to.