Subset of Android users is experiencing issues with drive detection functionality.
Affected components
Android App
Updates

Write-up published

Read it here

Resolved

Lead-up:

  • Google Play introduced a new mandatory version requirement

  • We released compliant version 1.64.xx in early Jan and have been observing normal operations for 3 weeks and several minor release iterations

Incident:

  • On Feb 1 we started observing early signs of deteriorating detection on Android for a very small subset of user and started investigation

  • On Feb 4 volume of impacted users started approaching ~10% with disproportionate bulk of the affected users being on Samsung devices running Android 12 and 13

  • On Feb 6 impacted users count escalated to ~15% and thorough our investigation efforts we have isolated the issue to be in the transport layer of the app

  • On Feb7 we started testing potential fix and created backend workaround to facilitate the drive capture

  • On Feb 8 we started seeing mitigation measures take effect and we rolled out an app fix, percentage of users started seeing recovery at that time

  • On Feb 9 we created additional app update and rolled it out to 100%, effectively resolving the issue

Learnings:

  • We will be prioritizing transport layer robustness as a part of our ongoing product modernization

  • We were under-monitored in some areas and will focus on additional telemetry that would have sped up the detection and remediation

  • We will allow for more time to soak test mandatory Play Store target SDK updates

Fri, Feb 10, 2023, 08:22 PM

Resolved

We've been observing normal operations for some time now on versions 1.64.6 and above.

Fri, Feb 10, 2023, 08:15 PM

Monitoring

We're observing normal operation and processing rates on the latest Android update available in Play Store.Please update to version 1.64.6 or above if you're still experiencing issues.

Fri, Feb 10, 2023, 04:29 PM(3 hours earlier)

Monitoring

We've started rollout of a new version which includes improvements around drive detection stability and additional telemetry.

Fri, Feb 10, 2023, 07:11 AM(9 hours earlier)

Identified

We have started putting remedial measures in place earlier today and observe a significant improvement in drive detection and processing operations.

Thu, Feb 9, 2023, 07:38 PM(11 hours earlier)

Investigating

We are continuing the investigation and are pursuing multiple paths in parallel.Our current belief is that the issue is related to the mandatory Google Play target version changes.We will provide further updates as they become available.

Wed, Feb 8, 2023, 03:26 PM(1 day earlier)

Investigating

We see the problem to be prevalent on Samsung devices running Android 12 and 13.We're continuing investigation and will provide more updates as the become available.

Wed, Feb 8, 2023, 01:27 AM(13 hours earlier)

Investigating

Our team is actively investigating the issue.

Tue, Feb 7, 2023, 11:02 PM(2 hours earlier)