Case Study: Using data to drive app design increases LTVs 10%
Random Logic Games uses Firebase AB testing and AdLibertas Audience Reporting to test game mechanics and increases user LTVs 10% in a single AB test.
Background:
Random Logic Games has a knack for creating engaging apps for users, they’ve racked up millions of users across their portfolio of puzzles and are no strangers to using data-driven app design for demonstrating success.
Alex McArdle is in charge of refining gameplay metrics on RLG’s newest app Infinite Connections, with the goal to keep users engaged and drive up user retention and profitability.
“I’m currently testing how puzzle complexity drives user engagement. Do users like small, easy puzzles that get them in and out of the game quickly, or are they more interested in larger complex puzzles?
Personally I think users would get frustrated with large, complex boards and bail early.”
The Problem:
Like many app developers RLG uses Firebase remote configuration and AB testing to split users into different groups, then test new game mechanics on the users. However, like many app developers it can be difficult to get definitive outcomes across their testing and performance strategies.
“When trying to see a winner from Firebase AB testing, getting a simple retention number or the probability of a user’s action isn’t helpful. I want to know retention, revenue earned, and user-engagement all in one.
To rely on just Firebase numbers I would need to run way more users through the test and event then it would be tough to get a clear indication of higher user-value.”
The Solution:
Alex wanted an easy way to determine his AB test winners so he opted to use AdLibertas Audience Reporting to measure the variant LTV performance.
The Results:
“It turns out there was a very specific formula of a few small easy games interspaced by larger, more complex puzzles that were clear winners. I wouldn’t have guessed this on gut alone but this formula clearly outperformed the baseline by almost 10% — and for our users a 10% difference in LTV can make a significant difference in the profitability of a user.”
Interested in how Audience Reporting works? See a demo above or read about how the product works by reading the product release at the link below.
