Skip to content

ci: run the Android emulator jobs on standard runners - #5812

Draft
ric-oliv wants to merge 1 commit into
ci/test-unsupported-aot-in-build-legsfrom
ci/run-android-emulators-on-standard-runners
Draft

ric-oliv wants to merge 1 commit into
ci/test-unsupported-aot-in-build-legsfrom
ci/run-android-emulators-on-standard-runners

Conversation

@ric-oliv

@ric-oliv ric-oliv commented Oct 25, 2026 •

Copy link
Copy Markdown
Member

Part 6 of 6 for #5806, based on #5811. The Android emulator jobs run on ubuntu-latest-4-cores, a larger runner. #2139 moved them there in March 2023, because the 2-core standard Linux runners couldn't run a hardware-accelerated emulator then. Since April 2024 they can, with the same KVM udev rule this workflow already sets. On public repositories, ubuntu-latest has 4 CPUs and 16 GB of RAM. So both emulator jobs, the device tests and the integration tests, move to ubuntu-latest.

Measured in #5795, against the last 10 runs on the larger runner:

Larger runner ubuntu-latest
Run Tests step 2.3 to 4.4 min 2.5 to 4.5
Device tests 2,921 run, 2,872 passed, 49 ignored the same
Integration cases 12 on net9, 24 on net10 the same, all passed
Wait for a runner up to 14 min 2 to 3 s
Free disk 88 GB at the start, 67 at the end

On this PR's own CI

3 runs. Android Device Tests took 17.9, 18.4 and 17.5 minutes. The emulator jobs started within 0.1 minutes of being queued. On #5810, with the same jobs still on the larger runner, they waited up to 11.9, 25.6 and 20.5 minutes for one. Run Tests took 2.3 to 3.5 minutes here, against 2.8 to 3.5 there. The whole stack's numbers are in #5806.

Closes #5806

#skip-changelog

@codecov

codecov Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 76.13%. Comparing base (a807d74) to head (4bfc23a).

Additional details and impacted files
@@                          Coverage Diff                           @@
##           ci/test-unsupported-aot-in-build-legs    #5812   +/-   ##
======================================================================
  Coverage                                  76.13%   76.13%           
======================================================================
  Files                                        528      528           
  Lines                                      19579    19579           
  Branches                                    3829     3829           
======================================================================
  Hits                                       14906    14906           
  Misses                                      3791     3791           
  Partials                                     882      882           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

The emulator jobs ran on the ubuntu-latest-4-cores larger runner. #2139
moved them there in 2023 because the 2-core standard runners couldn't
run a hardware-accelerated emulator. Since April 2024 they can, with
the same KVM udev rule this workflow already sets, and on public
repositories ubuntu-latest now has 4 CPUs and 16 GB of RAM. Both the
device test and the integration test jobs move.

On the first runs the device tests took 2.5 to 4.5 minutes, against
2.3 to 4.4 on the larger runner, with the same 2,921 tests. The
standard runner listed less disk, but had 88 GB free at the start and
67 at the end.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@ric-oliv
ric-oliv force-pushed the ci/test-unsupported-aot-in-build-legs branch from 1f30f05 to a807d74 Compare October 25, 2026 16:22
@ric-oliv
ric-oliv force-pushed the ci/run-android-emulators-on-standard-runners branch from a638f15 to 4bfc23a Compare October 25, 2026 16:22

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant