A sudden drop matters because personal accounts created after November 13, 2023 need at least 12 testers opted in continuously for 14 consecutive days. Falling under 12 can interrupt that continuous window—even if you previously had a healthy roster. (Current minimum is 12, not 20.)
Assess the Situation
Check Play Console under Release > Testing > Closed testing: how many are still opted in, how many stopped opening the app, and whether uninstalls or opt-outs caused the change. Still above 12 with soft activity is different from 9 opted in.
Immediate Actions
Still above 12: Identify who left, message them, keep backups warm, and watch the next 24 hours.
At or below 12: Add replacement testers the same day, resend opt-in links, and confirm installs before assuming continuity is restored.
Far below 12: Treat it as urgent—recruit a batch, fix whatever caused mass exits (crash, access bug), and be ready to restart a clean continuous 14-day stretch if the window already broke.
Finding the Cause
- Uninstalls / opt-outs: Quality or motivation issues; fix the app and replace people.
- Inactivity: Reminders failed; engagement dropped even if opt-in remains.
- Access regressions: Update broke installs, country change, or Google Group removals.
- Reporting confusion: Confirm whether Console lag is masking real activity—verify with testers directly.
If new testers hit item not found / opt-in 404, fix account, country, and group membership before counting them.
Prevention
Start with a buffer (15–20), monitor daily, and automate reminders. Closed Test Pro helps detect drop-offs early and refill from a developer community so a sudden dip does not erase two weeks of progress.