We're using statistics to make sure the rankings are actually fair and accurate. Here's what's going on behind the scenes:
- Cross Validation: We check how well each person's ratings match what everyone else thinks. Basically, we pretend your ratings don't exist and see how well you "predict" the community consensus. If you're usually right, your ratings count more.
- Controversial Detection: Some players get both really high and really low ratings (like some people put them in S+ and others in C). We flag these as controversial (⚡) because the community is clearly split on them.
- Expertise Validation: If you're ranked high yourself (S+ or S tier), your opinions count more. The better players usually know what they're talking about.
- Regional Bias Detection: We catch people who are clearly favoring their own region. If you're consistently ranking your region's players higher than everyone else does, your reliability gets knocked down.
- Head to Head Comparison: We look at direct comparisons between players. If Player A is ranked above Player B in most lists, their "win rate" goes up. This helps fine-tune the order, especially for players who are close together.
- Submission Quality: Not all tier lists are equal. If you just put everyone in one tier or clearly didn't put effort in, your ratings count less. Good lists have more impact.
- Anomaly Detection: We spot and downweight ratings that are clearly wrong or troll attempts, so one bad rating doesn't mess up the whole average.
- Tiers Normalization: Whether someone uses 5 tiers or 20, we normalize it so every list is treated fairly.
- Bayesian Smoothing: Players with only a few ratings get pulled towards the average, so nobody gets an extreme score just because of bad luck with who rated them.
What the numbers mean:
- Score: Lower is better. S+ is around 1.0, S is 1.5, A is 2.0, etc.
- C (Confidence): How certain we are about this ranking. More ratings = higher confidence.
- A (Agreement): How much everyone agrees on this player's placement. High agreement means most people put them in the same tier.
- W (Win Rate): How often this player is ranked above others in head-to-head comparisons across all the lists.
⚡ Controversial players: If you see this lightning bolt, it means the community is split on this player - some rate them really high, others really low. Their ranking is less certain and might change as more lists come in.