ranked#
Features#
A common interface for ranking algorithms
Elo (Chess & Generic)
Glicko2
NoSkill (similar to Trueskill, i.e bayesian inference on a bipartite graph)
Synthetics benchmarks
Basic match maker
Matchup replay to calibrate and experiment on real data
Model calibration using black-box optimizer Orion
Note
For team based games; When benchmarking ranking algorithm against real data you have to keep in mind that the matchmaking algorithm that created the groups was based on its own external ranking system so any measure that would come out of such benchmarks would end up being biased.
Note
Similarly, matchmaking or the team building algorithm can impact the performance of the ranking algorithm. It is up to the matchmaking algorithm to make sure the teams it builds are as fair as possible.
The ranking algorithm only provide an estimate of each player’skill to help the matchmaker to make the best decision possible.
WIP#
NoSkill2
Dota2 extracted matches
Server Protocol for matchmaking
pip install ranked
