Other ways to alter XP:

25% chance of +1 every time you vote
+1/6 number of votes cast if all votes are cast on any given day(This bonus only exists until you reach level 5)
25% of gaining 2 XP points once a day if you were logged in within the past 24 hours