Are your traditional retention metrics useless?

Originally published by Kevin Chou on LinkedIn: Are your traditional retention metrics useless?

At Kabam, we believe that the commonly used retention benchmarks today are holding the mobile gaming industry back.

Traditional retention metrics simply do not provide utility for where our company and the broader industry is heading. We are so confident in this belief that we have shifted our entire company strategy away from using traditional Day 1 to Day 90 (D1-D90) metrics. This was not a trivial decision—we have hundreds of millions of dollars invested into our vision of the future. But our results to date show great promise: the first game born from our new strategy, Marvel Contest of Champions, is on track to be the most popular Marvel-based video game of all time across any gaming platform, and it continues to grow its key audiences 18 months after launch.

If we are not focusing on traditional retention metrics, the obvious question then is what are we focusing on? The answer is multiyear retention. Kabam is one of the few mobile game companies that has been around long enough to even consider this degree of retention, and it is this experience that enabled the insight that D1, D30, and even D90 metrics are not predictive of long-term success. We now think exclusively in terms of years — not days, weeks, or months.

Given the relative nascency of the mobile games industry, it’s no surprise that it has no common parlance to refer to players who play games for years. Yet a significant portion of our existing player community today fall into this category. A good example is with our Castle Age fantasy game. Not only is it celebrating its seventh birthday—a huge feat given the assumed lifespan of most games—but its player base is still extraordinarily active. These players, which we call “Regulars,” lie at the core of our retention-defining work.

We hypothesized that standard D1-D90 metrics were not helpful in discovering if we had a game that Regulars could sink their teeth into for years. So we started by asking, “Of the Regulars still playing years after the launch of our older games, what was remarkable about them in the first few days/weeks when compared to other players that ended up leaving earlier?”

One of the dimensions that jumped out was time spent. Our Regulars on average play 15 hours a week, and our most dedicated players play over 40 hours a week! These numbers alone undercut the popular thinking that mobile gaming is inherently casual, and it challenged our company’s traditional design assumptions. As it became increasingly clear that our Regulars continued to play consistently over multiple years (and became the heart of our thriving player communities), we knew we had to completely throw out the idea of the typical “DAU.”