I disagree. Giving XP for votes encourages new users to start voting. As you rise in ranks, XP becomes less important (for most, I'm pretty sure at least - especially as it makes less and less difference to the total) but by then you have gotten into the habit of voting.
Of course people vote when they shouldn't, but generally, good nodes rise and bad nodes doesn't just the same. The votes on frontpaged nodes and the first posts are another matter however. ;-)
You have moved into a dark place.
It is pitch black. You are likely to be eaten by a grue.