PoSmedley PoSmedley

Do We Need The Rating System?

Do We Need The Rating System?

An open discussion

How does the rating system work? It is partly based on the level of the user doing the rating. For example, someone at level eight would vote and it would count eight times, while someone at level one would have a vote that counts one time. That's a rough explanation. Based on that, a level eight vote could counter 3 or 4 not so sensible votes. Your trusty Admins and Mods carry the most weight. And they do keep watch on these things and on the not-so-sensible voters.

 Is there a perfect rating system? I have seen a lot of suggestions. I have even made some. We all have seen them or made some. The ideas I have seen often involve more work on the Admin and Mods part. None are perfect. This is because we are human and we have our own tastes and opinions.

Often we disagree with one another. Sometimes we disagree drastically. As long as everyone is allowed an opinion, as they should be, and an opportunity to voice it through comments or rating, there is going to be conflict. Even when two people absolutely love the same thing, it may be for entirely different reasons.

Then you have people who rate something from the gut.  They may be rating from their own sense of who they think the artist is and what they think the artist deserves and not on the actual art. They may rate high just to show support whether as a fan or a friend. They may also rate the work low based on other personal feelings and again, not on the actual work. We may tend to like an artist so much we rate everything they do high, overlooking flaws, because we put the artist first. On the opposite end, we may have such a negative view of an artist that we rate everything low., looking for every imperfection we can find.

There is no way to detect in advance the motivation behind a persons vote. If you question a persons positive vote, you can put them on the defensive. No one wants to be accused of doing something for anything other than the right reasons. If you question their negative vote (a personally motivated vote to be more precise) they can just lie. If someone truly wants to bring it down, they will find a way.

Making anyone jump through hoops to rate one's work, by having to comment first or download first mat deter the positive ratings as much as the negative ones. In my experience, negativity can be a much stronger motivation for some people, whether it is the thrill of what they consider a victory or they are so self-absorbed they feel it won't be rated properly until they have had their say or done their damage.

While we wait to see what the new rating system will be (if there even will be one) I think time is well spent trying to ask ourselves if we truly need one. Often it is said "It's the downloads that count." and I believe this is true. When you have 348,000 downloads or more (or less) does the rating system really matter?

The only two thing I have personally ever seen that boosts downloads of my work is Number One:when it is featured on the home page or in one of Island Dogs threads. My screenshots are proof of this. Any screenshot that has made Screenshot of the Day has had multiple downloads, sometimes going into the double digits. All the others are either low to no downloads at all. And not all of the ones featured had high ratings to begin with, screenshots or any other skins but they were featured. Even the folks picking the features have their own opinions.

Number Two would be anything I have made being featured in someone else's screenshot. (Thanks to all who provide links to my work in their screenshots)

The rating system, in my opinion is mute. It's the promotion of one's work that really makes the difference and should be the topic of discussion. As a community we can do more for each other by promoting one another's work than any rating system can. As a community, that is what we should be doing. The rating system does not hurt your work or the community half as much as the complaining about it and all the negative attention focused on the actual system. My 'suggestion' for a ratings system (like we need another one) is either a simple 'thumbs up and thumbs down' or 'favorites'.Or just leave it all to the number of downloads. Wincustomize is a community and should always be treated as such. As a community we should be about one another as a whole. The Lone Wolfs or folks with an agenda should just get out of the way and limiting the rating system (I'm not saying my idea is perfect) to a 'thumbs up or thumbs down' will help in limiting their (negative) impact on the community.

As the site gets ready to change I think it is important that we are ready to change with it, no matter what rating system is applied to it. As a community we should be bigger and stronger than a few 'stars'. We should be one in why we are here. The love of skinning . Whether you're just an observer, a user, an appreciator, or a skinner. It should be about creating - and sharing, supporting, and promoting everything that is fun, enjoyable, and satisfying about skinning. In my opinion, we don't need the rating system. What's yours?

22,085 views 77 replies
Reply #26 Top

Whilst Po' makes a very worthwhile point I'm all for staying with the current system, for the reasons that Jafo sets forth |-)

Reply #27 Top

(Rainlendar does pretty much everything that DesktopX is doing right now, and in my opinion, in a much easier to skin format),
End of quote

Well, This statement is so far off that I can't read it without laughing...lol..

Other than that, the rating system means nada to me.

Reply #28 Top

Quoting Snowman, reply 9
The/our rating system actually works perfectly fine.
It's some users that doesn't use it correctly - intentionally.

Some (ab)use it to 'down-rate' other artists (read: competition). (Not the actual submission).
Some (ab)use it to 'up-rate' their friends. (Regardless that the submission looks shaite)
Some (ab)use their user-level when rating.

Yeah, we (Admins/Mods) are able to see who rated what on any submission, and are able 'correct' any kind of wrong doing.
End of Snowman's quote

 

5*    k6

Reply #29 Top

Quoting RedneckDude, reply 28

Quoting Snowman, reply 9The/our rating system actually works perfectly fine.
It's some users that doesn't use it correctly - intentionally.

Some (ab)use it to 'down-rate' other artists (read: competition). (Not the actual submission).
Some (ab)use it to 'up-rate' their friends. (Regardless that the submission looks shaite)
Some (ab)use their user-level when rating.

Yeah, we (Admins/Mods) are able to see who rated what on any submission, and are able 'correct' any kind of wrong doing.

  5* k6

  
End of RedneckDude's quote


Suckup :P

Reply #30 Top

The solution to this is so obvious...

... I should be the only one to rate skins. After all, I am fair and impartial, and above all else, right...

If anyone then disagrees with a rating, they are wrong.

I expect to see this implemented as soon as possible...

;p

Reply #31 Top

... I should be the only one to rate skins. After all, I am fair and impartial, and above all else, right...
End of quote

 

I thought you were gonna be touring for the next year?

Reply #32 Top

I remember making a post a few years ago lets see...it was  called "OK I just got to ask!" amyway I am reminded of the words of Fuzzy's Logic  Reply 4.

All I can say is abuse is the issue not the system as it has been stated there is no flawless system only mods/admins and our own checks and balamces can solve this.

Just for point of reference I joined Wincustomize in October 2006 it was August 2008 two years later before I earned my 1st 5star rating ,I was very proud I wonder if I would have been as happy had it been easier to come by or would I have tried so hard without a goal to accomplish.

At work it feels good when someone says great job , it equally feels good when your extended family The WC syas hey now thats really cool great job .Now after being here 3 1/2 yrs (the last couple as a Journeyman) I still get just as excited when I see a good rating .

Just my 2.5 cents;)

Reply #33 Top

Good article, Po! I have read a few others about the rating system but what ticks me off is that it seems that all this angst is stirred up because of a few abusers. For whatever reasons they have for giving negative ratings, whether it is due to immaturity or what, we should not have to change something just because of them. No anonymous bully should be handed that much control!

 

Forget the stars and let the downloads and comments speak for themselves. At deviantART, there isnt a rating system, but I certainly know from the amount of views and comments that people like what I have put together in a screenshot.

 

Maybe that could be added in - number of views.

Reply #34 Top

Forget the stars and let the downloads and comments speak for themselves
End of quote

consider that 90% of dowloads are from unregistered\visitors moreover the citizens can comment but they are not allowed to vote what remains ?

as Po well pointed out the 5 stars (10 points) rating seems quite elitarian, how to mix the two completly different systems

maybe 1 bonus star when the skin reaches 10.000 downloads ? ore something similar

Reply #35 Top

Instead of all this worry about ratings, I would think one would put in more time to produce great skins and the ratings would follow.  What I'am see (for the most part) people mass uploading to get their download count to rise.  Maybe it another reason, I'am just guessing, but we do have people uploading 1/2 a day.  Go figure.  I see uploads with 30 downloads and they have been there a while.  A lot with 100-300.  In the old days, that was considered a failure.  But they are mass produced and uploaded.  So, how do ya rate something that you see, how do ya compare it to the others?  How many uploads do ya'll think is perfect?  Low average is 2 1/2 stars.  High average is 3 stars.  Oh well, the debate goes on.

Reply #36 Top

 

Low average is 2 1/2 stars. High average is 3 stars.
End of quote

Could they fix it so the mods rating is the minimum and it could only be rated "up"?
End of quote

 

every system has some limitation and every kind of change has his expenses

on the other hand talking about stars (points) and numbers is talking about the human being so

I'm trying to give my contribution as a skinner but also as psychologist (of work and organizations)

1) the idea from the 2 quotes (the second by MouseGoddess in another similar post) is very simple and I think not expensive

leaving the rating system like it is but only "showing the rate when is equal or more than 3.5/4 stars" nobody will be hurted if the skin rate is not superior to the "Hight average" and who will care anymore to downgrade a skin to an always "Hight average" ?

2) just a second idea: to add a sticky poll in the Wincustomize HomePage: "Which skin are you using right now?"

personally apart the rating  \ dowloads number \ featured,  I noticed that for a skinner nothing is more rewarding of knowing that the skin is in good use on other persons desktops !

 

 

 

 

 

 

Reply #37 Top

Hum.  So if your skin dosn't have a rating the world will know it doesn't have 3 1/2-4 stars.  But at least they won't know how many stars it has(1-3 1/2 or 4).

I'am using     StealthOS

Reply #38 Top

I think part of the problem when skinners are checking the ratings of their skins they are not eating pizza.  :O

Pizza makes everything better. :sun:

Reply #39 Top

... the skins reaching the main gallery already have gained the honorific to be shown to the world, as with a very poor first moderators rating the skin is only uploaded in the personal pages

what about the second idea: leaving everything as it is now just adding

  a sticky poll in the Wincustomize HomePage: "Which skin are you using right now?"
End of quote

naturally with a pizza and maybe a beer as first prize ! :beer:

Reply #40 Top

Pizza makes everything better.
End of quote

...till the next day, when you're all bloated from the salt content.

Reply #41 Top

Quoting k10w3, reply 40
Pizza makes everything better.

...till the next day, when you're all bloated from the salt content.
End of k10w3's quote

Reply #42 Top

Xiandi

We dont need to see ratings at all.
End of quote

 

I agree.  Ratings are not relevant from my perspective

Reply #43 Top

Well, I guess that answers Po's question of "Do We Really Need A Rating System" -- doesn't matter if we need it, it's going to continue, exactly has it has. As for me, I think I'm going to adopt that snotty French waiter attitude about my skin ratings -- "what would you know about taste anyway, you common, boorish, simpleton!"
End of quote

I agree with you K10w3, very well saidXD

Reply #44 Top

I've had a little time to think about this and I'm sort of torn between expanding the rating system, increasing the number of starts to equal the rating values, and doing something radically different.

the radically different aspect would be to drop the rating system and the number of downloads altogether. downloads could be available to the skinner (I use this as a gauge) on their skin page but not shown on the skin preview pages. this would level the playing field for all skins. One could still sort by skinner's name.

Reply #45 Top

My solution to the whole thing was to avoid it. I download what I like, and assign my own rating in WB7, and go from there. The system has pluses and minuses like any system. The Mods catch bad abuses... what else can one do?

Reply #46 Top

Some people vote based on how well the skin applies, other on if they like the design, someone else on the composition of each individual element and some even rate based on if they know the person who made the skin. There are also other factors, like how many votes has been cast, and how votes are weighed (if at all). DEtermining quality or sorting by votes will never be useful, regardless of how the voting system is implemented (unless the only thing you want to achieve is removing the absolute worst of the bunch that noone in their right mind would like).

Quoting DrJBHL, reply 45
My solution to the whole thing was to avoid it. I download what I like, and assign my own rating in WB7, and go from there. The system has pluses and minuses like any system. The Mods catch bad abuses... what else can one do?
End of DrJBHL's quote

I download what I like, and erase everything I don't see as 4 or 5 star worthy. Why would I use a good skin with all the absolutely wonderful skins I have to pick from? The personal rating system in windowblinds and other software is useless, it should be replaced with a custom tag and filtering system. Wincustomize needs tagging and filtering too instead of that messed up old "sections and subsection"-baloney.

Reply #47 Top

Mick...ya gotta lay off that Surstromming. ;)

It ain't gonna change...so relax, my friend. :grin:

Reply #48 Top

Quoting DrJBHL, reply 47
Mick...ya gotta lay off that Surstromming.

It ain't gonna change...so relax, my friend.
End of DrJBHL's quote

Not that I'm gonna be prevented from relaxing by this, but no change is cause for more concern than the other way around. ;)

Reply #49 Top

but no change is cause for more concern than the other way around
End of quote

but the more things change the more they stay the same. ;)

No matter what direction the rating system goes, there will always be people who will have issues with it or the way other folks use it. There has been some great input here and some interesting ideas. I think the most important thing is that no matter where this goes we can all get behind it.

 

Reply #50 Top

You should never minimize your contribution here. It's folks like you and Doc that are the heart and soul of the community.
End of quote

Yes, and there are plenty of others who wish to represent another body part by abusing the ratings.:-"

Still,I think the ratings do serve as a guide but they shouldn't be used by themselves to judge a skin.