This page includes the key CTS changes introduced in Android 14.
CTS features
Android 14 includes new and updated documentation for the following CTS features.
| Area | Features | Description | Added/Updated |
|---|---|---|---|
| Test Highlights | Add utility functions to run as carrier service | This change introduces new utility functions in CarrierPrivilegeUtils to allow CTS to run as a carrier service (implicitly with carrier privileges) and improve the testability for many carrier APIs and connectivity classes.
|
Updated |
| Test module | Add multi-device CTS tests for Bluetooth | This feature allows advertisements to expose only specified GATT services, allowing for better privacy when continuously advertising in connectable mode. | Added |
| Test module | Add multi-device CTS tests for UWB ranging distance accuracy | Add new test cases for UWB ranging distance measurement accuracy to enforce the UWB CDD requirement. | Added |
| Test module | Add CtsDevicePolicySimTestCases to CTS SIM test plan | The test case was updated to require a valid SIM as a part of test setup. | Added |
| Test module | Added UWB multi-device CTS test suite | Added a new UWB multi-device CTS test suite which uses 2 UWB enabled android devices to verify various UWB functionalities. | Added |
| Test module | Increased test cases in dEQP module | Updated dEQP branch for Android 14 CTS to use vulkan-cts-1.3.5 (instead of 1.3.1). Many new tests are added as this update brings many new tests for the new Vulkan features such as dynamic rendering. | Updated |
| Test Setup | Increase heap size to 16GB | Increased heap memory size to help execute CTS tests that consume greater memory. | Updated |
| Test Setup | Upgrade RAM to 128GB and HDD to 256GB | Upgrade host system memory to handle added Java heap space requirements. | Updated |
CTS Verifier features
Android 14 includes new and updated documentation for the following CTS Verifier features.
| Area | Features | Description | Added/Updated |
|---|---|---|---|
| Test Setup | Update required peripherals for Dynamic Sensor Test | Update CTS Verifier test guidance page to include updated pheripherals and instructions for the dynamic sensor tests. | Updated |
| Test Setup | Improve Camera ITS to support Foldable Devices | Support foldable device testing in Camera ITS. Made changes in ItsService side to determine the available physical cameras with each fold/open state. | Updated |
| CTS-V test class | Wi-Fi Aware pairing | Wi-Fi aware pairing provide a encrypt and fast re-auth way for peer-to-peer communication throw Wifi aware. Add test in CTS-V as other multi devices tests for Aware. The test needs both devices support this feature. | Added |
| CTS-V test class | Test activities for home Controls embedded panel | Starting in Android 14, a new API is provided so apps can use an embedded activity (in the SystemUI controls space) instead of passing the information through the Controls API. New test activities added to enforce the API behavior. | Added |
| CTS-V test class | Tests for Presence requirements (BLE & NAN/Wi-Fi Ranging) | To ensure that users' smart devices work well together, it's critical that all devices in the Android ecosystem can determine the relative proximity between devices. Android U introduces presence calibration requirements that outline the acceptable performance of available radio technologies such as UWB, Wi-Fi, and BLE that are used to determine proximity. | Added |
| CTS-V test class | CTS Verifier for AAudio Disconnect | Test to verify that AAudio should disconnect a stream when the stream device is unplugged. | Added |
| CTS-V test class | CTS Verifier Screenshot Work Profile test | Add new test cases to enforce CDD requirement 3.9.2/C-1-10. User will be instructed to take a screenshot. ContentObserver detects URI of the screenshot saved and displays the result. User must visually confirm the image, which does not contain other apps or SystemUI (status bar, etc). | Added |
| Test Highlights | CTS Verifier Capture Content for Notes APIs test. | Add new test activity to enforce Notes APIs, which are linked to system note-taking integrations in SysUI. The test can be skipped if the NOTES role isn't enabled. See Capture Content for Notes Tests for more details.
|
Added |
| Test Setup | Execute adb command to turn on the screen automatically when the tests finish | Starting in Android 14, android.permission.TURN_SCREEN_ON permission has been added to allow the screen to be turn on after the test is completed. To enable the feature, user will need to execute the adb command adb shell appops set com.android.cts.verifier TURN_SCREEN_ON 0 in the setup step.
|
Updated |
| Test Setup | Update Rotation Vector testing instruction | Users should download OpenCV-3.0.0-android-sdk.zip and install the OpenCV Manager on the Android device being tested. Load the APK on the device from a computer using the adb install command with the --bypass-low-target-sdk-block option. For devices running Android 13 or lower, this --bypass-low-target-sdk-block option isn't necessary. For more information, see Install an app.
|
Updated |
| Test Setup | Add adb install notes regarding OpenCV APK | Due to a new security feature that was introduced in Android 14, the
adb command --bypass-low-target-sdk-block must be added every time when
installing the Open CV APK. See Rotation vector CV crosscheck
for more information.
|
Added |
CTS modules
The number of test modules and test cases are as follows:
- ~ 1151 modules depending on the devices
- ~ 4.4M test cases over 2 ABIs
In Android 14, a total of 136 new modules are added and a total of 19 modules are removed. See the following tables for more information.
New modules
| Added test module name | ABIs | Instant App test |
| AndroidTest_MultiUser | arm64-v8a | |
| art-run-test-018-stack-overflow | arm64-v8a | |
| art_standalone_dex2oat_cts_tests | arm64-v8a | |
| CtsAdIdEndToEndTest | arm64-v8a | |
| CtsAdServicesDebuggableDeviceTestCases | arm64-v8a | |
| CtsAdServicesEndToEndTestMeasurement | arm64-v8a | |
| CtsAdServicesEndToEndTests | arm64-v8a | |
| CtsAdServicesHostTests | arm64-v8a | |
| CtsAdServicesMddTests | arm64-v8a | |
| CtsAdServicesNotInAllowListEndToEndTests | arm64-v8a | |
| CtsAdServicesPermissionsAppOptOutEndToEndTests | arm64-v8a | |
| CtsAdServicesPermissionsNoPermEndToEndTests | arm64-v8a | |
| CtsAdServicesPermissionsValidEndToEndTests | arm64-v8a | |
| CtsAdServicesTopicsAppUpdateTests | arm64-v8a | |
| CtsAdServicesTopicsConnectionTests | arm64-v8a | |
| CtsAppCloningDeviceTestCases | arm64-v8a | |
| CtsAppCloningMediaProviderHostTest | arm64-v8a | |
| CtsAppCloningMediaProviderHostTest[instant] | arm64-v8a | Yes |
| CtsAppFgsTestCases | arm64-v8a | |
| CtsAppFgsTestCases[instant] | arm64-v8a | Yes |
| CtsAppSetIdEndToEndTest | arm64-v8a | |
| CtsAttributionSourceTestCases | arm64-v8a | |
| CtsAttributionSourceTestCases[instant] | arm64-v8a | Yes |
| CtsBatteryHealthTestCases | arm64-v8a | |
| CtsBiometricsHostTestCases | arm64-v8a | |
| CtsBluetoothMultiDevicesTestCases | arm64-v8a | |
| CtsBroadcastRadioTestCases | arm64-v8a | |
| CtsBroadcastTestCases | arm64-v8a | |
| CtsCompanionDeviceManagerMultiProcessTestCases | arm64-v8a | |
| CtsCompilationTestCases | arm64-v8a | |
| CtsContentProviderTestsWithoutVisibility | arm64-v8a | |
| CtsContentProviderTestsWithVisibility | arm64-v8a | |
| CtsCredentialManagerTestCases | arm64-v8a | |
| CtsCurrentApiSignatureTestCases[instant] | arm64-v8a | Yes |
| CtsDeviceLockTestCases | arm64-v8a | |
| CtsDevicePolicySimTestCases | arm64-v8a | |
| CtsDevicePolicySimTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsDevicePolicySimTestCases[run-on-secondary-user] | arm64-v8a | |
| CtsDevicePolicySimTestCases[run-on-work-profile] | arm64-v8a | |
| CtsDevicePolicyTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsDomainVerificationDeviceMultiUserTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsGrammaticalInflectionHostTestCases | arm64-v8a | |
| CtsGrammaticalInflectionTestCases | arm64-v8a | |
| CtsHealthConnectControllerTestCases | arm64-v8a | |
| CtsHealthConnectHostSideDeviceTestCases | arm64-v8a | |
| CtsHealthConnectHostTestCases | arm64-v8a | |
| CtsHealthFitnessDeviceTestCases | arm64-v8a | |
| CtsHealthFitnessDeviceTestCasesNoPermission | arm64-v8a | |
| CtsHealthFitnessDeviceTestCasesNoPermission[instant] | arm64-v8a | Yes |
| CtsHibernationTestCases | arm64-v8a | |
| CtsJvmtiRunTest1940HostTestCases | arm64-v8a | |
| CtsJvmtiRunTest911HostTestCases | arm64-v8a | |
| CtsJvmtiRunTest912HostTestCases | arm64-v8a | |
| CtsJvmtiRunTest913HostTestCases | arm64-v8a | |
| CtsJvmtiRunTest988HostTestCases | arm64-v8a | |
| CtsLaunchNonExportedComponentsTestCases | arm64-v8a | |
| CtsLocalVoiceInteraction | arm64-v8a | |
| CtsLocalVoiceInteraction[instant] | arm64-v8a | Yes |
| CtsMediaBetterTogetherTestCases | arm64-v8a | |
| CtsMediaBetterTogetherTestCases[instant] | arm64-v8a | Yes |
| CtsMediaBetterTogetherTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsMediaBetterTogetherTestCases[run-on-secondary-user] | arm64-v8a | |
| CtsMediaBetterTogetherTestCases[run-on-work-profile] | arm64-v8a | |
| CtsMediaProjectionTestCases | arm64-v8a | |
| CtsMediaProjectionTestCases[instant] | arm64-v8a | Yes |
| CtsMicrodroidDisabledTestCases | arm64-v8a | |
| CtsMultiUserTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsNativeResourcesTestCases | arm64-v8a | |
| CtsNativeResourcesTestCases[instant] | arm64-v8a | Yes |
| CtsNetHttpTestCases | arm64-v8a | |
| CtsNetTestCasesMaxTargetSdk30 | arm64-v8a | |
| CtsNetTestCasesMaxTargetSdk30[instant] | arm64-v8a | Yes |
| CtsNetTestCasesMaxTargetSdk33 | arm64-v8a | |
| CtsNetTestCasesMaxTargetSdk33[instant] | arm64-v8a | Yes |
| CtsNotificationTestCases | arm64-v8a | |
| CtsOsTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsPackageInstallTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsPackageInstallTestCases[run-on-secondary-user] | arm64-v8a | |
| CtsPackageInstallTestCases[run-on-work-profile] | arm64-v8a | |
| CtsPackageSchemeTestsWithoutVisibility | arm64-v8a | |
| CtsPackageSchemeTestsWithVisibility | arm64-v8a | |
| CtsPerfettoReporterTestCases | arm64-v8a | |
| CtsPermissionMultiUserTestCases | arm64-v8a | |
| CtsPermissionMultiUserTestCases[run-on-clone-profile] | arm64-v8a | |
| CtsPermissionMultiUserTestCases[run-on-secondary-user] | arm64-v8a | |
| CtsPermissionMultiUserTestCases[run-on-work-profile] | arm64-v8a | |
| CtsPermissionPolicyTestCases | arm64-v8a | |
| CtsPermissionPolicyTestCases[instant] | arm64-v8a | Yes |
| CtsPhotoPickerTest[run-on-clone-profile] | arm64-v8a | |
| CtsSandboxedAdIdManagerTests | arm64-v8a | |
| CtsSandboxedAppSetIdManagerTests | arm64-v8a | |
| CtsSandboxedFledgeManagerTests | arm64-v8a | |
| CtsSandboxedMeasurementManagerTests | arm64-v8a | |
| CtsSandboxedTopicsManagerTests | arm64-v8a | |
| CtsSdkSandboxHostSideTests | arm64-v8a | |
| CtsSdkSandboxInprocessTests | arm64-v8a | |
| CtsSdkSandboxWebkitTestCases | arm64-v8a | |
| CtsShortFgsTestCases | arm64-v8a | |
| CtsShortFgsTestCases[instant] | arm64-v8a | Yes |
| CtsSurfaceControlTests | arm64-v8a | |
| CtsTareTestCases | arm64-v8a | |
| CtsTelecomHostCases | arm64-v8a | |
| CtsThreadLocalRandomHostTest | arm64-v8a | |
| CtsVideoCodecTestCases | arm64-v8a | |
| CtsVideoEncodingQualityHostTestCases | arm64-v8a | |
| CtsVideoEncodingQualityHostTestCases[instant] | arm64-v8a | Yes |
| CtsVoiceInteractionHostTestCases | arm64-v8a | |
| CtsWallpaperSdk33TestCases | arm64-v8a | |
| CtsWallpaperSdk33TestCases[instant] | arm64-v8a | Yes |
| CtsWallpaperTestCases | arm64-v8a | |
| CtsWallpaperTestCases[instant] | arm64-v8a | Yes |
| CtsWearableSensingServiceTestCases | arm64-v8a | |
| CtsWindowManagerBackgroundActivityTestCases | arm64-v8a | |
| CtsWrapHwasanTestCases | arm64-v8a | |
| SdkSandboxManagerDisabledTests | arm64-v8a | |
| SdkSandboxManagerTests | arm64-v8a | |
| art-run-test-018-stack-overflow | armeabi-v7a | |
| art_standalone_dex2oat_cts_tests | armeabi-v7a | |
| CtsBiometricsHostTestCases | armeabi-v7a | |
| CtsBroadcastRadioTestCases | armeabi-v7a | |
| CtsCompilationTestCases | armeabi-v7a | |
| CtsDevicePolicySimTestCases | armeabi-v7a | |
| CtsJvmtiRunTest1940HostTestCases | armeabi-v7a | |
| CtsJvmtiRunTest911HostTestCases | armeabi-v7a | |
| CtsJvmtiRunTest912HostTestCases | armeabi-v7a | |
| CtsJvmtiRunTest913HostTestCases | armeabi-v7a | |
| CtsJvmtiRunTest988HostTestCases | armeabi-v7a | |
| CtsMediaBetterTogetherTestCases | armeabi-v7a | |
| CtsMediaProjectionTestCases | armeabi-v7a | |
| CtsNativeResourcesTestCases | armeabi-v7a | |
| CtsNetHttpTestCases | armeabi-v7a | |
| CtsSurfaceControlTests | armeabi-v7a | |
| CtsVideoCodecTestCases | armeabi-v7a | |
| CtsVideoEncodingQualityHostTestCases | armeabi-v7a | |
| CtsWindowManagerDeviceTestCases | armeabi-v7a | |
| CtsWrapHwasanTestCases | armeabi-v7a |
Removed modules
| Deleted Test module name | ABIs | Instant App Test |
| CtsActivityManagerBackgroundActivityTestCases | arm64-v8a | |
| CtsAdServicesDeviceTestCases[instant] | arm64-v8a | Yes |
| CtsCameraApi31TestCases | arm64-v8a | |
| CtsHostTzDataTests | arm64-v8a | |
| CtsIncidentHostTestCases | arm64-v8a | |
| CtsIncidentHostTestCases[instant] | arm64-v8a | Yes |
| CtsOnDevicePersonalizationTestCases | arm64-v8a | |
| CtsOnDevicePersonalizationTestCases[instant] | arm64-v8a | Yes |
| CtsPermission2TestCases | arm64-v8a | |
| CtsPermission2TestCases[instant] | arm64-v8a | Yes |
| CtsPermission4TestCases | arm64-v8a | |
| CtsPermission5TestCases | arm64-v8a | |
| CtsPermission5TestCases[instant] | arm64-v8a | Yes |
| CtsSystemUiHostTestCases[instant] | arm64-v8a | Yes |
| CtsVirtualDevicesTestCases[instant] | arm64-v8a | Yes |
| CtsActivityManagerBackgroundActivityTestCases | armeabi-v7a | |
| CtsCameraApi31TestCases | armeabi-v7a | |
| CtsGwpAsanTestCases | armeabi-v7a | |
| CtsIncidentHostTestCases | armeabi-v7a |