Test Lab lets you test your app on a wide variety of different devices and
Android versions. There are a few ways to see which devices are available:
Firebase console:
If you're running tests from the Firebase console,
you can see a list of available devices during the
Select dimensions
step
of the
Run a test
workflow.
gcloud CLI:
To see a list of available devices from the Google Cloud
CLI, use the following command:
gcloud firebase test android models list
Google APIs Explorer:
You can even look up the devices directly, without a
Firebase project or the gcloud CLI, using the
Google APIs Explorer
.
Device stability indicator
Test Lab indicates devices that are experiencing degraded stability in the
Firebase console and Google Cloud CLI with a
Reduced Stability
indicator.
Devices that have been labeled with the
Reduced Stability
indicator have
returned higher rates of inconclusive results for a prolonged period of 30 days
or more. This feature helps you better choose devices for your use case by
letting you know if the stability of a test device is degraded.
View device stability in the Firebase console
You can view device stability in the Firebase console when you're setting up
a new test for a specific device.
To view device stability, follow these instructions:
Open the Test Lab page in the Firebase console.
Select
Run a test
and then select a test type.
Upload your app binary.
On the Select dimensions step, click
Customize
.
Choose one or more devices to run your test on. Depending on device
stability, you might see a
Reduced Stability
label next to the selected
devices.
Run your test.
View device stability in the Google Cloud CLI
You can view device stability in the gcloud CLI for a specific device when
you're setting up a new test.
To view device stability, follow these instructions:
Download the latest
Google Cloud SDK
and follow the
instructions.
Run one of these commands:
gcloud firebase test android models list
or
gcloud firebase test android models describe MODEL_ID
If a test device is experiencing degraded stability, you can see the
reduced_stability
tag in the TAGS column listing the versions that are affected.
Device capacity
Test Lab provides aggregated mobile device capacity information
through the Firebase console and Firebase CLI.
Device capacity
is the
aggregated number of online devices in Google's mobile device lab. This feature
helps you ensure that there are enough devices in our device lab to run your
tests more efficiently. Device capacity is measured as High, Medium, and Low.
Tests running on any device capacity level may take longer due to the
following factors:
- Traffic, which affects when the test starts. To check if there are reported
outages or failures, see the
Firebase status dashboard
.
- Device or infrastructure failures, which can happen at any time and affect
how long the test takes to run.
The following table describes the types of device capacity and
provides recommendations about when to use each capacity type:
Capacity
|
Description
|
Recommended use
|
High capacity
|
The Test Lab device catalog contains many devices.
|
Use when you are running a large number of tests.
|
Medium capacity
|
The Test Lab device catalog contains a moderate number of devices.
|
This capacity level is suitable for running most of your tests.
|
Low capacity
|
The Test Lab device catalog contains few devices. While deprecated
devices belong to the low-capacity group, not all low-capacity devices are
deprecated.
|
Use when you need to run a test on a specific device model and version.
These tests are not suitable for test sharding. Due to low capacity,
tests might take a long time to finish, especially if you invoke a large
number of tests at the same time.
|
Note: Android virtual devices have variable capacity. The number of pre-booted
virtual devices is based on typical recent usage, and can auto scale larger
during periods of heavier usage.
View device capacity in the Firebase console
You can view device capacity in the Firebase console for a specific device
when you're setting up a new test.
To view device capacity, follow these instructions:
Open the Test Lab page in the Firebase console.
Select
Run a test
and then select a test type.
Upload your app binary.
On the Select dimensions step, click
Customize
.
(Optional) To filter devices by capacity level, follow these steps:
Click the
Filter
icon.
Select
Capacity
.
Click the capacity level you want to filter by:
Medium
or
High
.
To filter out any low-capacity devices, filter by both Medium and High.
Click
Apply
.
Choose one or more devices to run your test on. Depending on device
capacity, you might see a
Medium
or
High
label next
to the selected devices.
Run your test.
View device capacity in the Google Cloud CLI
You can view device capacity in the gcloud CLI for a specific device
when you're setting up a new test.
To view device capacity, follow these instructions:
- Download the latest
Google Cloud SDK
and follow the instructions. The version must be 417.0.0 or greater.
- Run one of these commands:
gcloud firebase test android list-device-capacities
or
gcloud firebase test android models describe
MODEL_ID
The output includes device capacity, model ID, model name, and OS version ID.
Deprecated devices and versions
Deprecated devices are available for at least one month before being removed
from the Test Lab device catalog. Once a device is removed, Test Lab
no longer runs test requests targeted at the device; those requests are
marked as
Skipped
.
Deprecated devices
Manufacturer
|
Model
|
Type
|
Device/Version
|
Removing on
|
Xiaomi
|
Mi A2 Lite
|
Physical
|
daisy_sprout/29
|
2024-04-14
|
Motorola
|
XT1650
|
Physical
|
griffin/24
|
2024-04-14
|
Samsung
|
Galaxy Tab S3
|
Physical
|
gts3lltevzw/28
|
2024-04-14
|
Motorola
|
Moto G Play
|
Physical
|
harpia/23
|
2024-04-14
|
Google
|
Pixel
|
Physical
|
sailfish/25
|
2024-04-14
|
Samsung
|
Galaxy Z Fold3
|
Physical
|
q2q/31
|
2024-04-14
|
Samsung
|
SM-G950F
|
Physical
|
dreamlte/28
|
2024-04-14
|
Google
|
Google Nexus 5
|
Physical
|
hammerhead/23
|
2024-02-05
|
Honor
|
Honor Play
|
Physical
|
HWCOR/27
|
2024-03-03
|
Request a device
If you want to use a device that is not available in Test Lab, you can
submit a request
for a device
to be added to the catalog.