🚀 Release 0.6.11

[github-actions]

What's Changed

• runtime: periodically store primary FSMHints of V2 shards by @williamhbaker in runtime: periodically store primary FSMHints of V2 shards flow#3027
• mise build:flowctl for a local flowctl binary by @mdibaiee in mise build:flowctl for a local flowctl binary flow#3031
• go.mod: bump gazette to latest by @williamhbaker in go.mod: bump gazette to latest flow#3033
• data-plane-controller: dns and s3 passthroughs by @qaoj in data-plane-controller: dns and s3 passthroughs flow#3022
• Self-service private-link configuration by @jshearer in Self-service private-link configuration flow#2944
• supabase: scoped refresh tokens so CI writes via PostgREST instead of direct psql by @skord in supabase: scoped refresh tokens so CI writes via PostgREST instead of direct psql flow#3013
• docs: Describe SQL Server replica suport by @willdonnelly in docs: Describe SQL Server replica suport flow#3040
• proto-gazette: regenerate to pick up SUSPEND_KEEP by @williamhbaker in proto-gazette: regenerate to pick up SUSPEND_KEEP flow#3041
• docs: correct custom-column-types backfill behavior for DDL changes by @jwhartley in docs: correct custom-column-types backfill behavior for DDL changes flow#3036
• Refresh token GraphQL operations and token exchange endpoint by @GregorShear in Refresh token GraphQL operations and token exchange endpoint flow#3020
• docs: shopify stream & resource config additions by @Alex-Bair in docs: shopify stream & resource config additions flow#3034
• validation/collection: exclude flow://inferred-schema from the managed-defs redact check by @jshearer in validation/collection: exclude flow://inferred-schema from the managed-defs redact check flow#3046
• docs: update Bigtable connector permissions example by @mwillman-estuary in docs: update Bigtable connector permissions example flow#3045
• docs: disable auto-discover for multi-binding file source captures by @jwhartley in docs: disable auto-discover for multi-binding file source captures flow#3037
• docs: add streams and API pinning details to stripe-native by @nicolaslazo in docs: add streams and API pinning details to stripe-native flow#3055
• data-plane-controller: restart setting by @qaoj in data-plane-controller: restart setting flow#3048
• deploy: route control-plane services through the VPC NAT for a stable egress IP by @skord in deploy: route control-plane services through the VPC NAT for a stable egress IP flow#3044
• docs: document the Exclude Flow Document (no_flow_document) materialization option by @jwhartley in docs: document the Exclude Flow Document (no_flow_document) materialization option flow#3018
• oidc-discovery-server: survive direct VPC egress cold-start on deploy by @skord in oidc-discovery-server: survive direct VPC egress cold-start on deploy flow#3062
• docs: clarify retain_existing_data_on_backfill requires allow_existing_tables_for_new_bindings by @jwhartley in docs: clarify retain_existing_data_on_backfill requires allow_existing_tables_for_new_bindings flow#3049
• data-plane-controller: restart on ansiblehost by @qaoj in data-plane-controller: restart on ansiblehost flow#3066
• flow-web: Bump version to release by @jshearer in flow-web: Bump version to release flow#3068
• ops-catalog: misc updates by @williamhbaker in ops-catalog: misc updates flow#3067
• proto-flow: tolerate unknown JSON fields in connector protocols by @williamhbaker in proto-flow: tolerate unknown JSON fields in connector protocols flow#3059
• flowctl: add raw split-shards to scale out V2 tasks by @williamhbaker in flowctl: add raw split-shards to scale out V2 tasks flow#3021
• supabase: qualify replace_data_plane_releases DELETE for PostgREST by @skord in supabase: qualify replace_data_plane_releases DELETE for PostgREST flow#3076
• docs: kcat recipes for testing a Dekaf topic by @jwhartley in docs: kcat recipes for testing a Dekaf topic flow#3072
• Docs: document per-prefix alert scoping and configurable thresholds by @jwhartley in Docs: document per-prefix alert scoping and configurable thresholds flow#3039
• notifications: trial bucket retention is 20 days, not 30 by @jwhartley in notifications: trial bucket retention is 20 days, not 30 flow#3074
• runtime/container: use ops::decode::Decoder for log lines by @williamhbaker in runtime/container: use ops::decode::Decoder for log lines flow#3091
• data-plane-controller: remove restart flag by @qaoj in data-plane-controller: remove restart flag flow#3087
• runtime-next: durably seed initial connector state as {} to match V1 by @williamhbaker in runtime-next: durably seed initial connector state as {} to match V1 flow#3081
• runtime-next: don't abandon the final capture transaction on connector EOF by @jgraettinger in runtime-next: don't abandon the final capture transaction on connector EOF flow#3090
• Docs: Remove an IP address from GCP allowed list by @jwhartley in Docs: Remove an IP address from GCP allowed list flow#3080
• docs: remove static data plane IP list, reference dashboard by @jwhartley in docs: remove static data plane IP list, reference dashboard flow#3097
• dekaf: improve logging by @williamhbaker in dekaf: improve logging flow#3078
• agent: make startup logging consistent by @williamhbaker in agent: make startup logging consistent flow#3098
• shuffle: make the shuffle disk limit configurable per-task by @jgraettinger in shuffle: make the shuffle disk limit configurable per-task flow#3096
• runtime-next: automatically split journals under sustained append-rate throttling by @dgreer-dev in runtime-next: automatically split journals under sustained append-rate throttling flow#3029
• billing: add tenant billing contact fields and per-tenant controller by @jshearer in billing: add tenant billing contact fields and per-tenant controller flow#2902
• flowctl-go(api test): raise test-shard readiness window from ~3s to ~30s by @jshearer in flowctl-go(api test): raise test-shard readiness window from ~3s to ~30s flow#3101
• runtime: strip the V2 committed-close marker for derivations by @williamhbaker in runtime: strip the V2 committed-close marker for derivations flow#3100
• deps: bump aws-lc-sys and lz4_flex for security advisories by @skord in deps: bump aws-lc-sys and lz4_flex for security advisories flow#2875
• data-plane-controller: fix db timeout by @qaoj in data-plane-controller: fix db timeout flow#3105
• agent-api: survive direct VPC egress cold-start on instance startup by @skord in agent-api: survive direct VPC egress cold-start on instance startup flow#3109
• docs: avoiding backfills during a database failover or host change by @jwhartley in docs: avoiding backfills during a database failover or host change flow#3086
• docs: clarify column-level SELECT grants unsupported for MySQL/MariaDB CDC by @jwhartley in docs: clarify column-level SELECT grants unsupported for MySQL/MariaDB CDC flow#3085
• json: require RFC3339 'T' separator in date-time format validator by @jacobmarble in json: require RFC3339 'T' separator in date-time format validator flow#3116
• control-plane: reserve privileged tenant names by @jwhartley in control-plane: reserve privileged tenant names flow#3083
• agent-api: harden startup and shutdown on Cloud Run by @skord in agent-api: harden startup and shutdown on Cloud Run flow#3114
• Incidental fixes: gazette Append retry, connector-init image, materialize tear-down by @jgraettinger in Incidental fixes: gazette Append retry, connector-init image, materialize tear-down flow#3121
• agent: flag to create new captures as runtime-v2 by @williamhbaker in agent: flag to create new captures as runtime-v2 flow#3107
• runtime-next: add minimum interval for post-txn triggers by @dgreer-dev in runtime-next: add minimum interval for post-txn triggers flow#3110
• flowctl: chunk API requests by url size rather than fixed count by @mdibaiee in flowctl: chunk API requests by url size rather than fixed count flow#3123
• dekaf: use projection_constraints only, no constraints by @mdibaiee in dekaf: use projection_constraints only, no constraints flow#3124
• flowctl: normalize --prefix trailing slash to avoid misleading PermissionDenied by @GregorShear in flowctl: normalize --prefix trailing slash to avoid misleading PermissionDenied flow#3075
• docs: retain_existing_data_on_backfill no longer requires allow_existing_tables_for_new_bindings by @jwhartley in docs: retain_existing_data_on_backfill no longer requires allow_existing_tables_for_new_bindings flow#3125
• Restart Materializations sessions before IAM token expiry by @dgreer-dev in Restart Materializations sessions before IAM token expiry flow#3130
• docs: add "bring your own app" instructions for source-quickbooks by @nicolaslazo in docs: add "bring your own app" instructions for source-quickbooks flow#3135
• flowctl: re-tool preview on the runtime-next stack by @jgraettinger in flowctl: re-tool preview on the runtime-next stack flow#3117
• Adding support for updating the quotas when payment info changes by @bbartman in Adding support for updating the quotas when payment info changes flow#3127
• control-plane-api: add unauthenticated publicDataPlanes GraphQL query by @GregorShear in control-plane-api: add unauthenticated publicDataPlanes GraphQL query flow#3129
• go/bindings: update snapshots for materialize-sqlite ser_policy by @dgreer-dev in go/bindings: update snapshots for materialize-sqlite ser_policy flow#3142
• Revert "flowctl: replace preview with the runtime-next implementation" by @jgraettinger in Revert "flowctl: replace preview with the runtime-next implementation" flow#3141
• local: per-checkout stacks — every checkout runs its own isolated stack by @jgraettinger in local: per-checkout stacks — every checkout runs its own isolated stack flow#3137
• dekaf: log tls handshake eof instead of returning as error by @danielnelson in dekaf: log tls handshake eof instead of returning as error flow#3143
• Updating migrations to better support testing. by @bbartman in Updating migrations to better support testing. flow#3146
• shuffle: raise causal-hint stall timeout to 15m; lower prune horizon to 2GB by @jgraettinger in shuffle: raise causal-hint stall timeout to 15m; lower prune horizon to 2GB flow#3148
• ci: fix Platform Build by packaging Go binaries from per-checkout $GOBIN by @jgraettinger in ci: fix Platform Build by packaging Go binaries from per-checkout $GOBIN flow#3149
• capture+materialize: Support Nonsensitive Field Overlays by @willdonnelly in capture+materialize: Support Nonsensitive Field Overlays flow#3119
• Docs: The Great Description-ing by @aeluce in Docs: The Great Description-ing flow#3057
• runtime: fix recursive read-lock deadlock in capture-v2 buildJoin by @jgraettinger in runtime: fix recursive read-lock deadlock in capture-v2 buildJoin flow#3156
• validation: surface write-schema redact annotations on projections of split-schema collections by @GregorShear in validation: surface write-schema redact annotations on projections of split-schema collections flow#3147
• control-plane-api: retry Stripe customer search on index-lag misses by @jgraettinger in control-plane-api: retry Stripe customer search on index-lag misses flow#3157
• flowctl: multi-shard --fixture for raw preview-next by @mdibaiee in flowctl: multi-shard --fixture for raw preview-next flow#3154
• dekaf: prevent cached TimeoutNoData fetch responses from incorrectly signaling EOF by @jshearer in dekaf: prevent cached TimeoutNoData fetch responses from incorrectly signaling EOF flow#3153
• mise: remove Lima VM host share and other VM tweaks by @jgraettinger in mise: remove Lima VM host share and other VM tweaks flow#3163
• docs: document connecting Azure Private Link to native Azure resources by @jwhartley in docs: document connecting Azure Private Link to native Azure resources flow#3138
• docs: explain why exclusiveCollectionFilter needs few enabled bindings by @jwhartley in docs: explain why exclusiveCollectionFilter needs few enabled bindings flow#3126

New Contributors

• @bbartman made their first contribution in Adding support for updating the quotas when payment info changes flow#3127

Full Changelog: estuary/flow@v0.6.10...v0.6.11

---

Link to release: https://github.com/estuary/flow/releases/tag/v0.6.11
Release created by: @mdibaiee

[jwhartley]

LGTM