How about using "early" votes just to cater for individual taste, not for article points/karma/whatever? By "early" I mean before a user has acquired enough karma, or gravitas, or pompousness to actually be known to make a positive contribution.