Skip to content

Replace PHP Server with a compatible Rust runtime and safe in-place upgrade #325

Closed

Description

@rmcdaniel

Current delivery — November 9, 2026

Native 3.3.2 is released and Latest. Final cross-repository delivery receipt.

  • Release source/tag: 660217dd1ac62701eb1fc26b08fbbaf825e777d1. Published index: sha256:4aeceb423ee4c8931f00ec2936149ac6b2a75479243b3930f9c6336ccdebf912 in both registries. Exact3.3.2 and rolling3.3/3/latest resolve to that index; exact3.3.0/3.3.1 remain intact.
  • Native: write a run of local activity records with one statement per table #1068 and Native: read workflow descriptions from one bounded coherent snapshot #1075 are completed: bounded ordered local-record batching and one-connection coherent workflow descriptions, including MySQL/MariaDB READ COMMITTED controls. Source/backend/main checks and all CodeQL languages passed. Earlier source/download NONPASSs remain attributed; original WIP refs are preserved.
  • Publication42591612884/a1, both architectures'3backend smokes/provenance, protected corpus42602023810 and four-cell Compose42602031026, default-resolution42600498794 and published PHP42600504863 are accepted. No build, qualifier, cancel or report duty remains live.
  • Subject-only runner#1114 is retained at b7337c1f91c3bc2eea0baaa9d41930220051386f, contained in current signed main 5bde7ed3. The fixed runner branch must remain; it is exactly one subject-only commit ahead of the release source.
  • Sample App#334 has signed main 98e8b49d,36source/30main successful checks, all9published runtime surfaces and all9language combinations. Developer image42610919065 passed7/7; both public registries serve sha256:c6eceb459ad78391ce9b82a45daa62ed665f0ae6ca19f0255802a79a7308acfc, and both embedded tuples match Git. Its completed source topic is absent; local/WIP refs remain.
  • Alias42612524622/a1 and GitHub Release42613125047/a1 are accepted. Release439079426 has the reviewed full notes and correct Latest designation. Native GitHub Releases should include tagged notes and recognize the complete body #1111 remains the source fix for full-note generation/idempotence; this delivery used one guarded body-only note augmentation and did not rerun the old writer.
  • SDK3.11.0 is already published with Prepare Server 2.4.26 and Helm chart 0.1.122 #269 installed acceptance. These internal Server changes need no unchanged SDK release. Schema/protocol1.20/capabilities and documented rollback constraints remain unchanged. No benchmark speedup or Cloud adoption is claimed.

Six Native P0s remain open: #1063(partial), #1074 and #1076(isolated measurement reconciliation of code already present since3.2.0), #1077, #1078 and #1079. sdk-php#341 depends on the accepted #1078 producer contract and a later SDK release. No supported date covers that whole remaining backlog. General owns the next source/measurement slices; Cloud runtime/security work and #1111 retain their separate owning records.

Objective

Replace the PHP/Apache Durable Workflow Server with a faster Rust successor in
this repository. Existing published SDKs, CLI, Waterline and sample applications
must work unchanged. Operators experience a major version upgrade of the same
product, with the same API, behavior, data and operational surfaces.

The PHP Server remains working as a reference throughout development. The
embedded Laravel Workflow package remains a first-class product. This is accepted
implementation work assigned to a dedicated maintainer, not a new architecture
comparison or a claim that Rust is already faster.

Constraints

Repository and delivery

  • No new repositories. Rust lives in durable-workflow/server.
  • Land small, coherent PRs on main frequently. Do not accumulate the rewrite
    on a long-lived branch or break the PHP Server while landing foundations.
  • Keep a running, contributor-readable log in this repository with the current
    plan, significant design decisions, verified outcomes, filed issues, the
    fixture cases they block and the next concrete action.
  • Choose the architecture and established Rust libraries with engineering
    judgment. Explain significant choices briefly and link the proving fixtures.
  • Follow ordinary review, CI, release and branch-cleanup rules.

Contract, parity and embedded mode

  • Published specifications and shared fixtures define observable behavior.
    Neither implementation wins by default. When they disagree, settle the
    contract first, then correct whichever implementation is wrong.
  • Establish a shared fixture corpus, recorder and differential runner that can
    target a server URL. Reuse existing protocol specifications, conformance
    scenarios and benchmark tooling rather than creating a second software factory.
  • Run the shared fixtures against embedded Laravel, PHP Server and Rust Server.
    Workflow package changes also remain tested against a real HTTP Server.
  • Default to parity for existing and new observable capabilities. Define the
    contract and fixtures first, implement a feature in both servers (including
    necessary Workflow package changes), and pass the same fixtures on both.
    A simple, slower PHP implementation is acceptable.
  • Internal scheduling, sharding and pooling mechanics without an observable
    contract need no PHP counterpart.
  • If an observable capability cannot reasonably exist in PHP, advertise an
    explicit capability flag, mark its fixtures Rust-only and record why.
    Do not disguise incomplete parity as an internal optimization.
  • Preserve the existing Avro payload protocol, errors, authentication and
    authorization, namespaces, durable identities and history, worker leases and
    fencing, retries, cancellation, timers, schedules, visibility and recovery.
    Execute the required PHP/Python/Rust worker directions, rather than assuming
    an HTTP schema comparison proves them.

Database isolation and one-way upgrade

  • Support SQLite, MariaDB/MySQL and PostgreSQL using the current database tables
    and stored data. Rust owns its versioned forward migrations.
  • Ordinary development and differential runs use separate isolated databases
    for PHP, Rust and embedded targets. Never run different implementations
    concurrently against one database.
  • The only cross-implementation shared-database exception is the dedicated
    sequential upgrade test: PHP writes and stops, then Rust takes over that
    same database. Multi-node replicas are tested within their own isolated
    deployment, not against another implementation's state.
  • Upgrade existing deployments in place. HTTP export/import remains a way to
    move data between deployments, not the upgrade route.
  • Require a backup before mutation and stop the PHP fleet before takeover.
    Make interruption resume safely or fail without corrupting state.
  • Record a schema marker. All affected PHP startup/worker/bootstrap paths must
    refuse an upgraded database before migration or durable writes can occur.
  • There is no PHP rollback after upgrade and no mixed PHP/Rust fleet.
    Rust migrations need not preserve post-upgrade PHP schema compatibility.
    The PHP reference continues to work against its own non-upgraded database.
  • Inventory stored PHP-serialized values, class names and framework conventions.
    Handle each with a read-compatibility path or documented one-time conversion.
    Do not silently discard data that Rust cannot interpret.
  • Preserve acknowledged work, durable history, pending workflows, timers,
    leases, credentials and external payload references/bytes across takeover.

Operations and performance

  • Preserve existing image names, supported image architectures, DW_*
    configuration, health/readiness, bootstrap, Compose and Helm layouts, metrics,
    diagnostics, graceful shutdown and recovery.
  • Document a migration path for anything that cannot carry over directly,
    such as a PHP authentication-provider class.
  • Record a reproducible PHP baseline before judging Rust. Use exact published
    artifacts, workloads, hardware, resource limits, commands and raw results.
  • Rust must meet or beat PHP throughput, memory and idle long-poll cost.
    Verify timers and lease renewals remain healthy during CPU-heavy load.
    Do not accept apparent gains from lost work, backlog, swapping or an
    unmeasured drain. Repeat promising measurements and recheck baseline drift.
  • Do not change customer pricing, Cloud production or managed rollout as part
    of the Server rewrite. Exact Rust artifacts need their own Cloud qualification.

Work order

  1. Establish the safety net: current contract inventory, shared fixtures,
    recorder, URL-targeted runner, meaningful embedded/HTTP coverage and
    reproducible PHP baseline.
  2. Land the Rust foundations and vertical slices in small reviewed merges,
    keeping PHP operational.
  3. Run the differential suite after every change. Record intentional contract
    decisions and convert every defect into a focused shared regression.
  4. Complete all capabilities and actual SDK/worker directions, database and
    multi-node qualification, performance proof and operational compatibility.
  5. Finish migration tooling, backup-first upgrade tests, operator documentation
    and major-version cutover preparation. Release through the repository's
    existing decision and publication process, then verify published artifacts.

Acceptance

  • Shared fixtures, recorder and URL-targeted differential runner are usable
    by a contributor from the public repositories.
  • PHP Server stays operational and embedded Laravel remains first class.
    Shared contracts pass on embedded, PHP Server and Rust Server.
  • Every required fixture passes with actual published PHP/Python/Rust SDKs
    and every meaningful supported workflow/activity/child direction executed.
    Existing CLI, Waterline and sample apps work unchanged.
  • Multi-node kill/restart tests prove no lost durable work, no duplicate
    committed outcomes and no acceptance of stale worker attempts. External
    effects retain their explicit application-idempotency contract.
  • Conformance and multi-node suites pass on SQLite, MariaDB/MySQL and
    PostgreSQL. Database topology and limits are explicit.
  • Rust meets or beats the recorded PHP baseline for throughput, memory and
    idle long polls. Timers and lease renewals remain healthy under CPU-heavy load.
  • Existing images/configuration/bootstrap/Compose/Helm/health/readiness/
    shutdown/diagnostics remain usable, with documented migrations for exceptions.
  • A backup-first in-place upgrade starts from data written by the last PHP
    release, with pending workflows, timers and leases, and continues under Rust
    on each supported database.
  • Interrupted upgrade resumes or fails safely. PHP reliably refuses the
    upgraded schema. No concurrent mixed fleet or post-upgrade PHP rollback.
  • Stored PHP-specific values and external payloads have tested compatible
    reads or explicit one-time conversions.
  • Operator upgrade/cutover documentation, major-release readiness,
    exact publication identities and downstream verification are complete.
  • The running repository log lets a maintainer see decisions, blockers,
    blocked fixture cases and the next action without private workspace context.

Ownership

A dedicated Rust Server maintainer owns this issue and its scoped implementation,
tests and cutover preparation. Coordinate necessary cross-repository contract
and Workflow changes through linked owning records. Other maintainers should
avoid competing implementation of this rewrite while that assignment is active.

Activity

  1. added
    enhancementNew feature or request
    authority:githubGitHub is the authoritative lifecycle record for this work
    kind:featureA public product capability or experience is requested
    kind:cross-repositoryWork spans more than one public repository
    priority:P1High-priority product or release risk
    status:readyReady for implementation
    repo:serverOwned by the standalone server repository
    completion:evidence-requiredClose only after all explicit acceptance and operational evidence is public
    intake:approvedCurrent issue title and body revision is approved for authority intake
    on Oct 9, 2026
  2. rmcdaniel commented on Oct 9, 2026

    @rmcdaniel
    MemberAuthor

    The first safety-net slice is in #326, with the public running log, capability inventory and frozen published tuple. The default PHP artifact remains unchanged; no Rust runtime or performance improvement is claimed.

    At source 8182ad8b5df8a8266f52e0a368fb3abea53a19e9, three reviewed cases run through actual PHP SDK workers and real embedded Laravel database queue jobs on independent SQLite files: typed echo, an exact int64 beyond JSON number precision, and one external activity. The recorder checks completed work, the complete expected event inventory, history pagination, deadline budgets, registered types, decoded values/types and start/run/activity/attempt relationships. The differential comparison anchors to current fixture hashes and rechecks observations; matching partial recordings and saved pass labels cannot qualify a run. There are 25 focused comparator checks.

    Hosted fixture qualification passed and retains both records and comparison for 90 days. Repository contracts and boundary checks passed; the full PHP feature suite is still running. This is bounded correctness evidence, not a full three-runtime/database or performance qualification.

    Next action after the first merge: establish a current reproducible PHP baseline with the existing capacity workload and commands. The current standard launcher freezes older packages and a Linux 6.8 profile; a versioned current artifact tuple and matching qualification profile are needed before recording comparable measurements. Keep workload/admission/completion/drain rules intact. Also complete the representation audit: Laravel queue payloads serialize PHP job objects, and internal async payloads can contain signed serialized closures inside Avro binary values. Avro-only wire transport does not by itself make those representations Rust-readable. Upgrade fixtures must exercise explicit tested compatibility/conversion or safe preflight refusal, without discarding acknowledged work.

    All unproven #325 acceptance items remain open, including full SDK/consumer directions, all database families, multi-node interruption, Rust throughput/memory/idle long polls, in-place takeover, schema-marker refusal, operator cutover, publication and downstream verification. Rust development will record target-directory size and clean/incremental compile time and use bounded task-owned build state.

  3. rmcdaniel commented on Oct 9, 2026

    @rmcdaniel
    MemberAuthor

    The fixture foundation is merged in #326 at ed49098b3db6b43827c9d90ba9b38f0104f2342d. Three shared cases pass on the pinned published PHP image and embedded Workflow through real SDK worker and Laravel queue execution; all 25 comparator counterexamples pass. Fixture qualification and full feature/source qualification passed at the exact PR head. Merged branch deletion is verified.

    Next is the PHP baseline: the existing capacity 1.9.0 tuple pins Server 2.1.1 and the standard local profile requires a different kernel. I will preserve those historical inputs and add a versioned current-artifact input/profile through the existing capacity commands, retaining their offered-load, completion, full-window and drain rules. Throughput, memory and idle mixed long-poll measurements remain unrecorded; Rust implementation and all remaining #325 gates stay open.

  4. rmcdaniel commented on Oct 9, 2026

    @rmcdaniel
    MemberAuthor

    The pinned PHP measurement profile merged in #327 after all source checks passed. Three 120-second windows at 0.25 offered starts/s each completed and verified all 30 planned workflows with zero pending work or poll/result/history errors. Higher-rate repetitions and the following drift control are running; no maximum-capacity result or Rust improvement is claimed.

    Three mixed-idle repetitions each at 6, 12 and 24 polls completed with clean worker deregistration, no claimed tasks and no runtime OOM/restarts. Outcomes were consistently 6 empty; 8 empty/4 explicit capacity rejections; and 8 empty/16 rejections, respectively. Query waits lasted about five seconds despite requesting ten. All 24-poll bursts produced at least one two-second health/readiness timeout; an Apache worker-limit warning was observed. The failed API headroom observations are retained, rather than treating admission correctness as a complete pass. Changed background workload also requires a matched-condition PHP/Rust resampling before any performance gain claim.

    Draft #328 records these bounded results and a stored-representation audit checkpoint. Avro transport does not remove PHP-specific queue jobs, signed serialized closures, encrypted history cursors or local class execution. Their compatibility/conversion, backup-first migration, schema marker and PHP refusal tests remain explicit open gates.

    Next: finish offered-rate/drift observations, retain their complete limits and failed evidence, remove the reference experiment resources, then implement the first Rust slice without changing the default PHP artifact.

  5. rmcdaniel commented on Oct 9, 2026

    @rmcdaniel
    MemberAuthor

    The PHP development reference is complete, with bounded results in #328. Three 120-second windows at each of 0.25 and 0.5 offered starts/s completed and verified every workflow in-window. At 1/s, only 48–51 of 120 completed in-window before the remainder drained; this does not establish sustained 1/s throughput. The original second high-rate run's configured hourly worker exit invalidated its resource comparison. Its raw result remains retained, together with the replacement's one readiness 503.

    All three 24-poll registration bursts produced ordinary API timeouts. Smaller mixed-poll runs passed admission and API checks; every registration was cleaned up. All 810 offered workflows, including the invalid resource sample and two following drift windows, completed and verified. Final synthetic counts were 846 completed runs including setup, 2530 completed tasks, zero failed jobs and zero idle registrations. Input identities, failures and sampling limits are retained; disposable experiment resources and dependencies are removed.

    The result is diagnostic: changing background workload, admission sampling gaps, incomplete client resource costs and the development host's different capacity topology still require a matched PHP/Rust comparison and full qualification. Stored PHP jobs/closures, cursors and local execution also remain explicit conversion/compatibility gates in the audit. Next: merge the exact-head-qualified report, then add the first Rust slice with clean/incremental build-time and physical disk measurements. PHP remains the published default.

  6. rmcdaniel commented on Oct 9, 2026

    @rmcdaniel
    MemberAuthor

    #329 merged the first unpublished Rust foundation at d684f2ff1a85c1aa49b7febd877139bf2db631ab. All final-head source checks passed, including the PHP feature suite, four Rust codec tests, 15 two-way PHP/Rust codec cases and the real PHP/embedded workflow fixtures. Fixture evidence is retained for 90 days. No Rust HTTP workflow, migration, runtime gain or cutover is qualified yet.

    The build observations keep the tradeoff explicit: native clean builds around 22 seconds/182 MiB; native no-op/comment edits 0.063/0.374 seconds; Kache fresh-target reconstruction 3.462 seconds, with slower cold builds and added cache/target disk. It remains optional. Build/cache/download state, task tool images, Kache sandbox, clean worktree and merged local/remote branch are removed; thin receipts remain.

    Next: add the HTTP/storage slice with honest readiness and safe upgraded-database boundaries. Full malformed-input/resource qualification precedes exposing payload decode at HTTP ingress. The complete capability/client/database/performance/one-way-upgrade gates remain under #325; PHP stays the published default.

  7. rmcdaniel commented on Oct 9, 2026

    @rmcdaniel
    MemberAuthor

    PR #330 merged as d2feae2a54c3630271e1d4e5217740f09031d2d6. It adds an explicitly experimental Rust HTTP/SQLite runtime that starts real workflows, leases workflow/activity tasks, persists typed history and opaque Avro envelopes, fences stale attempts, and commits/replays completion through the unchanged published PHP SDK.

    The three reviewed fixtures match across isolated published PHP, Rust and embedded Laravel targets. The final-head shared Action also passes four codec tests, seven transaction/HTTP tests, 15 two-way codec values and a real SIGKILL/replacement-container check: the persisted activity lease expires, the old attempt is refused, and a fresh SDK worker completes attempt two with one committed result and the original identities/history. The complete PHP feature/source qualification, repository contracts and public-boundary checks pass.

    Bounded compile measurements at two CPUs/2 GiB: a clean test/binary build took 54.65 s, with 521.4 MiB of targets plus 202.6 MiB of downloads; binary-only no-op/comment edit took 0.16/1.51 s. Inputs, exclusions and cache growth are in rust/runtime-build-observations-2026-10-09.md. This is a development observation, not a full-runtime or performance acceptance claim. Disposable resources and the merged worktree/branch have been removed.

    PHP remains the published default; native Rust development databases do not qualify for PHP takeover. Next: enforce PHP refusal before any upgraded-database mutation, then extend the native schema and backup-first sequential migration foundation. MySQL/PostgreSQL, the remaining API/client/capability surface, strict ingress/external payloads, full recovery/CPU-load/performance qualification and published artifacts remain open. #325 stays active.

  8. 891 remaining items

  9. added 15 commits that reference this issue on Nov 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    agent:serverauthority:githubGitHub is the authoritative lifecycle record for this workcompletion:evidence-requiredClose only after all explicit acceptance and operational evidence is publicintake:approvedCurrent issue title and body revision is approved for authority intakekind:cross-repositoryWork spans more than one public repositorykind:featureA public product capability or experience is requestedpriority:P1High-priority product or release riskrepo:serverOwned by the standalone server repositorystatus:readyReady for implementation

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions