In April 2024, Activision released an 18-page report outlining Call of Duty’s matchmaking system. The report, available for download at the link provided, provided insight into the game’s skill-based matchmaking process. Further details on this feature were promised to be shared in June.
Despite the developers missing the deadline, players continued to express their frustrations. In response to the complaints, Activision released a blog detailing the results of a test conducted in North America, which showed the effects of loosened skill considerations in MW3 matchmaking.
According to Activision, the results of the test indicated that players with a larger skill gap had a higher tendency to leave ongoing matches and were not as likely to resume playing the game compared to players with unchanged matchmaking.
According to a graph shared by CharlieIntel on their website, the study revealed that players with lower to mid-level skills tended to stop playing more frequently compared to those who were more skilled.
Activision revealed the results of the MW3 MP test where skill factor was reduced for 50% of players in NA. This chart shows player retention % based on skill rating. Lower-to-mid skill players saw retention decline. Only the highest skill bucket had an increase. pic.twitter.com/68SCahiPsz
— CharlieIntel (@charlieINTEL) July 26, 2024
Activision also stated that there was an 80% increase in the probability of a player leaving a match and that 90% of players in a relaxed skill group did not come back at a higher rate compared to the control group.
“According to Activision, while playing against tougher opponents can improve players’ skills in the long run, our research has revealed that being significantly outmatched in matches often causes players to either abandon the game or avoid playing multiplayer altogether.”
Tests were conducted with stricter skill-based matchmaking as well. The findings revealed a 90% decrease in the quit rate, however, it had a negative effect on highly skilled players. As a result, the concept was abandoned.
After careful consideration, the Call of Duty development team has decided against launching a multiplayer playlist that excludes skill as a factor in matchmaking. Extensive testing revealed that this would lead to a lack of interest from low and mid-skilled players, resulting in primarily high-skilled players dominating the lobbies.
Therefore, although ping remains the primary factor in matchmaking, skill remains a crucial aspect and will continue to be a significant factor in upcoming series releases.
To learn more about skill-based matchmaking, read about the controversy surrounding the system and why certain FPS games, like XDefiant, ultimately chose not to implement it.
Leave a Reply