Skip to content

[aws] Enable Identity Federation on all agentless policy templates#20302

Open
seanrathier wants to merge 2 commits into
elastic:mainfrom
seanrathier:aws/federated-identity-all-agentless
Open

[aws] Enable Identity Federation on all agentless policy templates#20302
seanrathier wants to merge 2 commits into
elastic:mainfrom
seanrathier:aws/federated-identity-all-agentless

Conversation

@seanrathier

@seanrathier seanrathier commented Jul 22, 2026

Copy link
Copy Markdown
Contributor

Proposed commit message

Remove the hide_in_var_group_options: credential_type: [identity_federation] gates from all 23 agentless inputs and point iac_template_url at the new federated-identity-aws CloudFormation template (elastic/cloudbeat#7422), which unconditionally grants the read-only permissions required by every agentless-enabled AWS integration. Users deploy one stack and paste the Role ARN + External ID back into Kibana regardless of which integrations they select. Bumps the package to 7.1.0.

Background

Part of https://github.com/elastic/ingest-dev/issues/8887.

When var_groups landed in 7.0.0 (#19828), the Identity Federation setup access option was hidden on every agentless input except GuardDuty's API input, because the published CloudFormation template (cloud-connectors-guardduty-9.4.0.yml) only granted GuardDuty permissions.

elastic/cloudbeat#7422 adds federated-identity-aws.yml: a single static template whose read-only role covers all agentless-enabled AWS policy templates (transport, metrics, security findings, and per-service inventory permissions). With that template as the quick-create target, the gates are no longer needed — Identity Federation becomes selectable on awshealth, billing, cloudwatch, config, dynamodb, ebs, ec2, ecs, elb, lambda, rds, s3, sns, sqs, transitgateway, securityhub, inspector, and guardduty.

No Kibana changes are required: the existing var_group iac_template_url → quick-create URL flow handles the new template as-is.

Depends on elastic/cloudbeat#7422 merging and the template being published to s3://elastic-cspm-cft/ before this ships.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

🤖 Generated with Claude Code

@seanrathier
seanrathier requested review from a team as code owners July 22, 2026 20:29
Remove the hide_in_var_group_options credential_type gates from all 23
agentless inputs and point iac_template_url at the new
federated-identity-aws CloudFormation template (cloudbeat#7422), which
unconditionally grants the read-only permissions required by every
agentless-enabled AWS integration. Users deploy one stack and paste the
Role ARN + External ID back into Kibana regardless of which
integrations they select.

Bumps the package to 7.1.0.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@seanrathier
seanrathier force-pushed the aws/federated-identity-all-agentless branch from 89d00a4 to cc6f9da Compare July 22, 2026 20:30
@github-actions

Copy link
Copy Markdown
Contributor

✅ Elastic Docs Style Checker (Vale)

No issues found on modified lines!


The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

@seanrathier
seanrathier marked this pull request as draft July 22, 2026 20:41
@seanrathier
seanrathier marked this pull request as ready for review July 22, 2026 20:41
@andrewkroh andrewkroh added Integration:aws AWS Team:obs-ds-hosted-services Observability Hosted Services team [elastic/obs-ds-hosted-services] labels Jul 23, 2026
Remove hand-rolled SigV4 transforms (X-Amz-Date header, Authorization
header, pagination re-signing) from inspector, securityhub_findings,
securityhub_findings_full_posture, and securityhub_insights httpjson
streams. Add auth.aws block (matching the guardduty pattern from elastic#19828)
so the agent handles AWS auth natively and use_cloud_connectors works.

Revert identity federation enablement on aws.config: the CEL program
implements SigV4 inline and explicitly rejects non-key credentials;
cloud connectors cannot inject temporary creds as template variables,
so the option would silently fail at runtime. Restore
hide_in_var_group_options until the CEL program is rewritten.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

✅ All changelog entries have the correct PR link.

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

💚 Build Succeeded

History

cc @seanrathier

@andrewkroh andrewkroh added the Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] label Jul 24, 2026
@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

@ilyannn

ilyannn commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

@vera-review-bot review

The earlier review attempt on this PR failed with a gateway authentication error during an LLM credential rotation on our side — nothing to do with the changes here. The new credential is in place, so re-triggering the initial review.

Comment posted with 🤖 Cursor/Claude Opus 5 under my supervision.

@vera-review-bot

Copy link
Copy Markdown

⚠️ @seanrathier I couldn't complete the review for commits 9266f85 after several attempts. A maintainer can re-run it with @vera-review-bot review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Integration:aws AWS Team:obs-ds-hosted-services Observability Hosted Services team [elastic/obs-ds-hosted-services] Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants