Sunday, August 10, 2008

Changes to the rating system

We've heard complaints from a number of theme artists about the rating system. Personally I think it's a nice way to give quick and easy feedback to the artists. Unfortunately it's been abused. In an attempt to make the rating system a little better (i.e. so that people aren't artificially inflating or deflating the rankings) we decided to expose who voted what for each theme. Now if you click on the Comments link to view the individual theme you'll see a listing of all the users that have voted. It should be pretty obvious if someone is trying to game the system. We've already noticed some suspicious behavior that's now exposed. So, to allow people to save some face and "do the right thing" we've also added a "Delete my vote" link so you can wipe out any trace of what you voted for on a theme. You can also use this if you accidentally vote the wrong number of stars and need to fix it.

Yes, you'll probably notice that some of the votes aren't matching up to the number of votes it says the theme has. This is a bug that's been lurking for quite some time. The bug is fixed for the future votes, but the numbers are still off. I'll be working on a way of normalizing all the votes so that all the math adds up in the future.

Let me know what you guys think of the openness of the rating system now.

BTW, sk08themes.com is open and in beta now as we try to implement some new features. :)