Sorry everyone. Discussing ideas takes a crapload of text. In the interest of improving NUMA, please read this and give me your thoughts.
Section 1
First off, I have a couple new ideas about how a "top-rated of all time" system could be better. For example, instead of dealing with making a formula, you could simply have a top-rated system that ignored all maps with less than 20 or 30 votes. Alternatively, perhaps maps couldn't get on that list until they were 2 weeks old (after they have been obligatorily removed from the "recent top-rated" page). Yet another idea is to use a different exact average that negates all 0's, because really, if a map is rated so highly by so many, it shouldn't be worth a 0 to anyone. I would understand a 1 and definitely a 2, but 0? On any half-decent map, the only real use for a 0 is for sniping or plagiarism. I suppose that is my opinion, though I imagine most would agree with me.
Section 2
Now to address b_t:
blue_tetris wrote:Do you think the ratings system really allowed the Top Rated page to show the absolute best ten maps on the front page? I think it showed the least-sniped maps, perhaps. I think it's a bold lie to say those maps were better than the other 100,000 maps on NUMA.
I assume you're not merely suggesting that this feature was rightfully removed simply because it didn't function properly, but rather that it is
impossible for the feature to function properly. In that case, here's my response:
Yes, it showed the best ten maps, but in a technical way that no one really cares about: in the sense that "best" means "has the highest average rating at that given moment".
The thing is, this entire community needs to deal with their ideas of a rating system. I'm going to make another thread to deal with this issue (and a few others that have similar origins), but for now I'll just say that it seems to me that people are thinking along these lines:
"Because everybody likes different things, ratings are rather useless because they don't represent how well a particular user will like a particular map."
I know
I certainly used to think like this. Or rather, when thinking about the issue of ratings, I couldn't get around this issue. But now I have. Here's what I say to it:
This isn't Netflix, people. NUMA isn't supposed to take your ratings and run it through complicated systems to produce modified averages that try to predict whether or not you'll like maps. NUMA runs on a normal rating system, which allows the community the quantify their feelings about maps. Because of this function, it has the
potential to serve as a rough indicator of how well you'll like a map, but ultimately it depends on how similar your tastes are compared with the wider community. Now keep in mind that this is assuming that ratings are perfect - that is, if everyone in the community weighed in on every map. Of course, that idea is ludicrous. But for top-rated, it
starts to come back into play. Generally, a map can be considered as being closer to this magical "community consensus" the more rates it has. This is how top-rated is ideally supposed to be a rough indicator of the maps that have the best community consensus. Or at least, it is if you filtered out maps that are 5/5 from 5 people.
So that's my argument as to why top-rated roughly does serve the function it's intended to serve (or rather, that it
can serve that function with some modification). Furthermore, you really really REALLY need to understand that the top-rated page needn't present the absolute ten best maps on the first page. There's genres to consider, and there's a "Next" button. This is why putting up the Dronies lists can't possibly supplant the top-rated page: the top-rated listing has pages upon pages upon pages of highly rated maps. There are just a handful of Dronie-winning maps each year. Clearly, top-rated is more extensive.
Section 3
This leads us straight to:
blue_tetris wrote:Why were the people checking the Top Rated page those who had visited the site hundreds of times before? Are the best maps really changing that often? Do old maps suck that bad?
People are checking the top-rated page because it served as BOTH top-rated of all time and recent top-rated. Separating it into two top-rated sections (recent and not recent) more or less solves that.
Furthermore, if you had really played all the top-rated you cared to, then yes, in my suggested system you would probably only ever check the recent top-rated and new maps listings. HOWEVER, there are still a huge mass of people who have not gone through the top-rated listings to their liking, largely comprised of all the current and future newcomers to this community. In trying to rid yourself of what you considered an eyesore, you screwed over pretty much everyone in that group. And for the love of all that is holy, can someone please acknowledge that concept? I've repeated it like 5 times total spread over 2 or 3 threads and none of you anti-top-rated people has said anything in response to it. :/
Section 4
Now I also have to apologize. Communicating these ideas takes so much friggin text and I bet people are sick of me typing up encyclopedias when I post. I know I just spent forever defending my ideas, but I never really addressed an issue that seemed very important to you, b_t, and that's sniping. Sniping on the top-rated page happens all the time, true. But really, it's more of side issue. If you are saying that you would be fine with a top-rated listing if snipers didn't exist, then holy hell, please say so and we'll work from there.
I see two ways to deal with snipers:
(1) Make the top-rated listing less vulnerable to them. For example, this could be done by using new averages to rank maps - these could automatically not include all 0's, or remove the highest and lowest 10% of votes. Or you could simply show a histogram of all the votes a map has received on its page. Perhaps seeing that a top-rated map has already been sniped 10 times will dissuade sniping (either true snipers, who may realize that they're activities aren't so novel, or regular members who really don't think the map should be rated so highly and are sniping in an attempt to return the average to a more reasonable number).
(2) Make sniping less possible. I've seen many an idea shot down because of potential abuse by snipers. I've got an idea - why don't we actually DO something about sniping in the first place? If >20% of a user's placed rates are 0's (once they have a sufficient # of rates), can't we safely assume they aren't rating properly? I don't know, it just seems like this community has an incredibly laissez-faire attitude towards sniping. I have nothing against that on its own, but it becomes a serious problem when that attitude serves as an excuse to not implement good ideas.
Section 5
blue_tetris wrote:...just because people rate differently now.
Someone else said that recently as well. I don't understand what you guys mean. Are you saying that there is a significant difference in the way people rate now that rating is confined to whole numbers only? And that this difference affects top-rated?