From a purely UI point of view, it's a pain to have to scroll to the bottom of the page to click the 'Vote' button, especially if there are a lot of replies.

Then you may not be aware that pressing Enter does the same thing as clicking on the Vote button. I do that all the time .. the alternative would be End, followed by a mouse click. Still not that bad.