Firebase远程配置A/B测试24小时后未显示任何结果 [英] Firebase Remote Config A/B testing shows no results after 24 hours

问题描述

我为Android配置了Firebase远程配置A/B测试，我们至少在1万台设备上进行了部署. 由于某些原因，超过24小时后，我的A/B测试中看到"0位用户".

I configured Firebase Remote Config A/B testing for Android, and we did rollout on at least 10K devices. For some reason, I see "0 users" in my A/B test after more than 24 hours.

Firebase GMS版本为:11.8.0

Firebase GMS version is: 11.8.0

它应该实时显示A/B参与者还是24小时后可以看到0个用户?

Should it show A/B participants in real-time or it's ok to see 0 users after 24 hours?

P.S:我们能够通过Firebase实例ID在测试设备上获得AB测试变体，效果很好.

P.S: We are able to get AB test variants on test devices through Firebase Instance Id, it works well.

正在运行的最简单的实验仅将应用程序包作为目标，而没有其他过滤器.而且它也显示0个用户.

The simplest experiment which is running has only app package as a target, with no additional filters. And it shows 0 users as well.

推荐答案

最后，我们找到了答案！

也许有人会觉得有帮助:

Maybe somebody will find it helpful:

现在，如果您为A/B测试实验配置了激活事件，则它会发生(Firebase远程配置A/B测试实验中没有数据).

For now, it happens (no data in Firebase remote config A/B test experiment) if you have an activation event configured for A/B test experiment.

如果您有2个不同的实验，即使您仅在其中1个实验中配置了激活事件"，两个实验都将无法获得结果. 此外，远程配置也无法正常运行，您将只能获得默认值.

If you have 2 different experiments, both will fail to get results even if you have "activation event" configured only in 1 of them. Additionally, remote config will not work as well, you'll be able to get only default values.

我们已经向Google报告过，因此他们会在希望的某个时间对其进行修复.

We already reported to Google about, so they'll fix it at some point I hope.

另一个很难获得的有用信息:

• 在我刚刚进行的实验中，看到"0个总用户"可以持续多长时间 开始了吗?

• How long is it ok to see "0 Total Users" in experiment I've just started?

要花很多小时才能看到实验中的任何数据.在实验开始后的21个小时之后，我们才能够看到结果，因此，如果您对所有设置进行了正确配置，请不要担心，至少要等待24个小时.在启动后的许多小时内，它将显示0个总用户".

It takes many hours before you can see any data in your experiment. We were able to see results only after 21 hours after experiment start, so if you configured everything well, don't worry and wait for at least 24 hours. It will show 0 "Total Users" for many hours after the start.

• 我应该在版本"字段的版本"字段中使用应用程序versionName还是versionCode 实验设置?

• Should I use app versionName or versionCode in "Version" field of experiment setup?

您应该使用versionName.

You should use versionName.

一些来自支持部门的有用信息:

• Firebase SDK

确保您的用户使用最新的SDK来安装您的应用程序版本.

Make sure your users have the version of your app with the latest SDK.

• 因为您的实验是使用Remote Config

当调用activateFetched()时，此后的所有事件都将被标记为实验.如果您有一个目标或激活事件发生在activateFetched()之前，例如first_open，session_start等自动事件，则实验设置可能是错误的.

When activateFetched() is called, all events from that point on will be tagged with the experiment. If you have a goal or activation event that happens before activateFetched(), such as automatic events like first_open, session_start, etc., the experiment setup might be wrong.

• 您是否正在使用激活事件?

请确保在激活事件发生之前调用fetch()和activateFetched().

Make sure to call fetch() and activateFetched() before the activation event occurs.

• 实验的实验ID(如果支持询问您的情况)

它是查看实验结果时URL末尾的数字.

It's the number at the end of the URL while viewing experiment results.

此调试日志 可能是了解正在发生的事情

This debugging log could be useful to get what is going on

也:

检查实验是否正在运行的好方法是将其设置为尚未发布的特定版本，并使用全新的应用程序安装来检查来自远程配置的日志(或清除所有应用程序数据并重新启动).

The good way to check if your experiment is working now is to set it to a specific version you didn't publish yet and check logs from remote config with the fresh app install(or erase all app data & restart).

每次重新安装应用程序时，它应该显示不同的变体，因为在重新安装应用程序/清除应用程序数据后，Firebase实例ID会更改. 如果您看到变体有所变化-那么A/B测试运行良好.

It should show different variant every time you reinstall the app, since your Firebase Instance ID changes after app reinstall/app data erase. If you see variants change - then A/B test is running well.

在您的"build.graddle"中:不要忘记设置与在实验设置中设置的相同的versionName.

这篇关于Firebase远程配置A/B测试24小时后未显示任何结果的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！