Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to mitigate against bandwagon effect (voting behavior) in my ranking system?

What I mean by bandwagon effect describes itself like so:
Already top-ranked items have a higher tendency to get voted on at all, possibly even to get upvoted.

What I am hoping to get is some concrete recommendations, at best based on your practical experience with a mathematical formula and in which situation it helped.

However, any useful pointers are more than welcome!

My ranking system

Please consider a ranking system at a website that has a reputation system and where users cast only upvotes on items and the ranking table is reset to start fresh every month.
Every user has one upvote per item within each month, and there is a reward for users who, within a certain month, upvoted an item that made it into the top ranks at the end of that month.

Users are told the following about what increases the weight of their upvote:
1)... the more reputation you have at the time of upvoting
2)... the fewer items you upvote within the current month (including the current upvote)
3)... the fewer upvotes that item already has within the current month before your own upvote

The ranking table is recalculated once a day and is visible to all.

Goal

I'd like to implement part 3) in an effort to correct the ranks of items where one cannot tell if some users just upvoted it because of the bandwagon effect (those users might hope to gain a "tactical" advantage simply by voting what they perceive lots of other users already upvoted)

Also, I hope to mitigate this way against the possible use of sock puppets that managed to attain some reputation, but upvote the same item or group of items.

Question

Is there a (maybe even tested?) mathematical formula that I could just apply on the time-ordered list of upvotes for each item to get a coffecient for each of those upvotes so that their weights will be corrected in a sensible fashion?
I'm thinking it's got to be something of a lograthmic function but I can't quite get a grip on it...

Thank you!

Edit

Zack says: "beyond a certain level of popularity, additional upvotes decrease the probability that something will be displayed"

To further clarify: what I am after is which actual mathematical approaches are worth trying out that will, in the form of a mathematical function, translate this descrease in pop (i.e., apply coefficients to the weights, see above) in sensible, balanced manner.

My hope is someone has practical experience with such approaches in a simmilar or general situation to the one above.

like image 538
Geradeausanwalt Avatar asked Oct 15 '22 02:10

Geradeausanwalt


1 Answers

Consider applying the "Indie Rock Peter Principle": beyond a certain level of popularity, additional upvotes decrease the probability that something will be displayed.

Term coined by Leonard Richardson in this paper. Indie Rock Peter is of course from Diesel Sweeties.

like image 82
zwol Avatar answered Oct 18 '22 13:10

zwol