feat(declarative): expose request_url to HttpResponseFilter error_message and predicate

[Anatolii Yatsuk (tolik0)]

What

HttpResponseFilter can now use request_url in its error_message and predicate interpolation, alongside response and headers (and config for error_message).

request_url is the URL of the response: the final URL after any redirects, with the query string, fragment and userinfo (user:password@) removed. The path is kept as-is, so it should not be surfaced for APIs that put a credential in the path. It is an empty string when the response has no URL.

Why

A custom error_message replaces the default "Ignoring response for '' request to ''" log line on IGNORE, so a skip message today cannot say which partition was skipped. Connectors that need this (for example, source-github's stargazers skip after GitHub restricted listing stargazers to collaborators) currently need a CustomErrorHandler subclass just to put the repository in the message. With this change it becomes:

error_message: "Repository `{{ request_url | regex_search('/repos/([^/]+/[^/]+)/') }}`: ..."

The query string is dropped because some APIs authenticate with a query parameter, and an error message can end up in a user-facing failure.

Changes

• http_response_filter.py: new _request_url(response) helper, passed as request_url to both the error_message and predicate evaluations.
• declarative_component_schema.yaml: request_url added to both fields' interpolation_context, new examples, and a documented request_url entry in the interpolation variables.
• declarative_component_schema.py: examples mirrored by hand. The generator needs dagger, and only examples changed.
• Unit tests covering query strings, credentials, ports, fragments, IPv6 hosts, a response with no URL, and the predicate (including a 200 response that must not match the example predicate).

Compatibility

This is additive. Interpolation kwargs are local to these two evaluations, so a config key named request_url is still reached as config['request_url'], and no existing manifest changes behavior.

Testing

• unit_tests/sources/declarative/requesters/error_handlers: 156 passed
• ruff format --check, ruff check and mypy are clean on the changed files

🤖 Generated with Claude Code

[github-actions]

👋 Greetings, Airbyte Team Member!

Here are some helpful tips and reminders for your convenience.

💡 Show Tips and Tricks

Testing This CDK Version

You can test this version of the CDK using the following:

# Run the CLI from this branch:
uvx 'git+https://github.com/airbytehq/airbyte-python-cdk.git@tolik0/http-response-filter-request-url#egg=airbyte-python-cdk[dev]' --help

# Update a connector to use the CDK from this branch ref:
cd airbyte-integrations/connectors/source-example
poe use-cdk-branch tolik0/http-response-filter-request-url

PR Slash Commands

Airbyte Maintainers can execute the following slash commands on your PR:

• /autofix - Fixes most formatting and linting issues
• /poetry-lock - Updates poetry.lock file
• /test - Runs connector tests with the updated CDK
• /prerelease - Triggers a prerelease publish with default arguments
• /poe build - Regenerate git-committed build artifacts, such as the pydantic models which are generated from the manifest JSON schema in YAML.
• /poe <command> - Runs any poe command in the CDK environment

📚 Show Repo Guidance

Helpful Resources

• CDK API Reference

📝 Edit this welcome message.

[github-actions]

PyTest Results (Fast)

5 754 tests  +6   5 723 ✅ +5   11m 55s ⏱️ -15s
    1 suites ±0      31 💤 +1 
    1 files   ±0       0 ❌ ±0 

Results for commit acb3e61. ± Comparison against base commit 2082c2d.

This pull request skips 1 test.

unit_tests.resources.source_pokeapi_w_components_py.integration_tests.test_airbyte_standards.TestSuiteSourcePokeAPI ‑ test_docker_image_spec_backward_compatibility

[github-actions]

PyTest Results (Full)

5 757 tests  +6   5 726 ✅ +5   16m 51s ⏱️ -9s
    1 suites ±0      31 💤 +1 
    1 files   ±0       0 ❌ ±0 

Results for commit acb3e61. ± Comparison against base commit 2082c2d.

This pull request skips 1 test.

unit_tests.resources.source_pokeapi_w_components_py.integration_tests.test_airbyte_standards.TestSuiteSourcePokeAPI ‑ test_docker_image_spec_backward_compatibility

[Anatolii Yatsuk (tolik0)]

/prerelease

Prerelease Job Info

This job triggers the publish workflow with default arguments to create a prerelease.

Prerelease job started... Check job output.

✅ Prerelease workflow triggered successfully.

View the publish workflow run: https://github.com/airbytehq/airbyte-python-cdk/actions/runs/38587689913