Skip to content

feat(datadog_agent): support v3 series metrics intake - #26264

Open
arfa79 wants to merge 10 commits into
vectordotdev:masterfrom
arfa79:feat/datadog-agent-v3-series
Open

feat(datadog_agent): support v3 series metrics intake#26264
arfa79 wants to merge 10 commits into
vectordotdev:masterfrom
arfa79:feat/datadog-agent-v3-series

Conversation

@arfa79

@arfa79 arfa79 commented Aug 30, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds support for the Datadog Agent v3 series metrics intake format used by default by Datadog Agent 7.81.0 and newer.

The datadog_agent source now accepts the dictionary-encoded protobuf payload at /api/intake/metrics/v3/series and /api/intake/metrics/v3beta/series, translates it into Vector metrics, and preserves metric names, tags, resources, units, intervals, timestamps, values, and origin metadata.

The Datadog metrics e2e matrix also restores the floating Agent 7 test leg so current Agent versions exercise the v3 path.

References

Closes: #25790

Vector configuration

No new configuration is required. Existing datadog_agent source configurations accept the new intake endpoint automatically.

How did you test this PR?

  • cargo check --lib --no-default-features --features sources-datadog_agent
  • cargo test --lib --no-default-features --features sources-datadog_agent datadog_agent::
  • cargo clippy --lib --no-default-features --features sources-datadog_agent -- -D warnings
  • cargo fmt --all -- --check

Is this a breaking change?

  • Yes
  • No

Does this PR include user facing changes?

  • Yes. Please add a changelog fragment based on our guidelines.
  • No. A maintainer will apply the no-changelog label to this PR.

@arfa79
arfa79 requested a review from a team as a code owner August 30, 2026 12:43
Copilot AI lite review requested due to automatic review settings August 30, 2026 12:43
@github-actions github-actions Bot added the domain: sources Anything related to the Vector's sources label Aug 30, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds Datadog Agent v3 series metrics intake support to the datadog_agent source so Vector can ingest metrics from Agent versions that default to the v3 endpoint, and updates tests to exercise the new path.

Changes:

  • Add Warp routing + decoding for /api/intake/metrics/v3/series and /api/intake/metrics/v3beta/series, translating v3 payloads into Vector metrics.
  • Add unit test coverage for decoding a v3 series payload.
  • Restore the floating Datadog Agent v7 leg in the Datadog metrics E2E test matrix and add the v3 proto to codegen.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
tests/e2e/datadog-metrics/config/test.yaml Unpins the v7 agent matrix leg to exercise current Agent behavior (v3 default).
src/sources/datadog_agent/tests.rs Adds a v3 endpoint constant, a raw-bytes sender helper, and a v3 decode test.
src/sources/datadog_agent/mod.rs Wires in the generated v3 metrics protobuf module.
src/sources/datadog_agent/metrics.rs Adds v3 series route and decoding/translation logic.
proto/vector/dd_metric_v3.proto Introduces the v3 intake proto definition used for decoding.
changelog.d/25790_datadog_agent_v3_series.feature.md Adds a changelog fragment documenting the user-facing feature.
build.rs Adds the v3 proto to the build-time proto compilation inputs.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5330fba0d3

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs
@github-actions github-actions Bot added domain: sinks Anything related to the Vector's sinks domain: core Anything related to core crates i.e. vector-core, core-common, etc labels Aug 31, 2026

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8be2d900a4

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 584d5bcbee

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e2463c4444

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 42d4e8684f

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 068c2391cb

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 4000346324

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs
Comment thread src/sources/datadog_agent/metrics.rs Outdated
Comment thread src/sources/datadog_agent/metrics.rs
@pront

This comment was marked as outdated.

@pront

pront commented Sep 2, 2026

Copy link
Copy Markdown
Member

Hi @arfa79, thank you for this PR. Ignore my previous message.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8402a3b92a

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread src/sources/datadog_agent/metrics.rs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

domain: core Anything related to core crates i.e. vector-core, core-common, etc domain: sinks Anything related to the Vector's sinks domain: sources Anything related to the Vector's sources

Projects

None yet

Development

Successfully merging this pull request may close these issues.

datadog_agent source: support Datadog v3 series metrics intake API

3 participants