Skip to content

search: add counting download bytes by data type - #7030

Open
Abdul-Andha wants to merge 1 commit into
mainfrom
abdul.andha/warmup-data-type
Open

Abdul-Andha wants to merge 1 commit into
mainfrom
abdul.andha/warmup-data-type

Conversation

@Abdul-Andha

Copy link
Copy Markdown
Contributor

Description

  • Track downloaded split bytes by component: term dictionaries, postings, positions, fast fields, field norms, footer, and other.
  • Aggregate the breakdown in leaf resource stats and report it in root resource logs.
  • Count underlying storage reads, excluding cache hits.
    • This will tell us what kind of data was downloaded during warmup. Useful in investigations

How was this PR tested?

  • make fmt, clippy
  • Unit tests
  • Local cluster emit expected counts in root_resource_stats

@Abdul-Andha
Abdul-Andha requested a review from a team as a code owner November 17, 2026 23:37
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 17, 2026 •

Copy link
Copy Markdown
Codex Review Summary: ✅ Completed

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-17T23:39:21.423000Z 1982dcd PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@datadog-official datadog-official Bot added area:search Root and leaf search, caches, sorting, pagination, Lambda offload area:storage S3, GCS, Azure and local storage type:enhancement An improvement to something that exists, or its deprecation or removal labels Nov 17, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:search Root and leaf search, caches, sorting, pagination, Lambda offload area:storage S3, GCS, Azure and local storage type:enhancement An improvement to something that exists, or its deprecation or removal

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant