Skip to content

test(ci): Benchmark integration dependency installation - #26720

Draft
nicohrubec wants to merge 1 commit into
developfrom
feat/benchmark-integration-install-timings
Draft

nicohrubec wants to merge 1 commit into
developfrom
feat/benchmark-integration-install-timings

Conversation

@nicohrubec

@nicohrubec nicohrubec commented Nov 21, 2026 •

Copy link
Copy Markdown
Member

What

Measure temporary dependency installation time in the Node, Bun and Deno integration suites.

Why

These installs aren't cached across jobs, but their cost is currently hidden inside test setup. Record per-install timings to identify which suites and shards could benefit from caching or sharing dependencies.

Measured run:

Runtime Temporary installs Summed installer time
Node (five versions) 724 32:37
Bun (three versions) 575 23:20
Deno 59 2:23
SQL Server 1 0:04
Total 1,359 58:24

Bun canary shard 5 ran 137 installs during a 3:02 test step. At least one worker was installing for 2:26 of that step. Installer intervals overlap other work, so these are costs to investigate, not projected cache savings.

Benchmark only: unrelated CI jobs are disabled. Install commands, retries and test coverage within the selected integration jobs are unchanged.

Co-Authored-By: OpenAI Codex <codex@openai.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant