If I posted more rather than lurking AND actually used my votes, I'd be a lot further along the XP field than I am. But I have trouble finding time to visit and lurk, let alone make good use of the voting system. Hence the reason I tend to avoid XP topics.
It's been interesting to watch the growing pains of Perlmonks from a distance. I'm sure I'll continue to lurk for quite some time.
As for the experience system, I rarely think about it. If I were more active rather than a simple lurker, then I might get a bit more interested in keeping my XP up.