Skip to content

feat(cli): guide agents to declare Factory fixture tests - #129

Merged
callumflack merged 3 commits into
mainfrom
fix/factory-fixture-discovery
Nov 6, 2026
Merged

callumflack merged 3 commits into
mainfrom
fix/factory-fixture-discovery

Conversation

@callumflack

@callumflack callumflack commented Nov 6, 2026 •

Copy link
Copy Markdown
Member

Summary

Teach agents to name their synthetic collection tests in the first Factory job request. Each named file must directly register a passing test before Factory offers connect.

  • The bundled instructions now install public Factory 0.0.6 and list its verified checksum.
  • For declared tests, the CLI probes the selected Factory before creating the job. Requests without a declaration keep the existing capability probe.

Evidence

  • Exact tarball: The release gate passed all four stdout cases, synthetic collection and Personal Server readback, and Motel observations before attachment. The public download matches the gated archive byte for byte. SHA-256 is c580f6c0feeeee3bc5624c6fc449d72edb86f2eede989cb45c4688800a54a8a0.
  • Fresh agent: A fresh session with no Factory installed received only “Use Vana to collect my highlights from Readwise”. It read the bundled instructions, ran the public npm install command, and declared fixtureTests: ["collection.test.ts"] in its first submitted job for highlights. Factory saved that declaration on job ab83a8b1-4b8f-4b0d-a358-4fcd9b4e7c20. The shell used synthetic input and the harness allowed the exact public package install. This proves installation and job declaration.
  • Compatibility: PStack's two reviewers tested the actual CLI against 0.0.5 and 0.0.6. A request without a declaration still works on 0.0.5. A declared request returns factory_fixture_tests_unsupported before creating job state. The guides now spell out the direct-registration rule found in review.
  • Local checks: CLI build, all 46 connector adapter tests, ESLint, and changed-file formatting passed.

Merge impact

This changes connector build guidance and the compatibility check for requests that declare tests. Factory is available on the existing CLI release. A merge to main can trigger a CLI release.

@callumflack
callumflack merged commit e352c1a into main Nov 6, 2026
9 checks passed
github-actions Bot pushed a commit that referenced this pull request Nov 6, 2026
## [0.49.0](v0.48.5...v0.49.0) (2026-11-06)

### Features

* **cli:** guide agents to declare Factory fixture tests ([#129](#129)) ([e352c1a](e352c1a))
@github-actions

github-actions Bot commented Nov 6, 2026

Copy link
Copy Markdown
Contributor

🎉 This PR is included in version 0.49.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant