Your life will improve measurably if you make users a hash instead of an array.

Not to discourage anyone from using perl, but you can probably do this as well with cut, sort and comm.