Skip to content

feat: support list blob scans#7664

Open
Xuanwo wants to merge 3 commits into
mainfrom
xuanwo/list-blob-scan
Open

feat: support list blob scans#7664
Xuanwo wants to merge 3 commits into
mainfrom
xuanwo/list-blob-scan

Conversation

@Xuanwo

@Xuanwo Xuanwo commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

This adds scan-based support for List<Blob> and nested blob leaves such as Struct<List<Blob>>.

Descriptor scans preserve the original Arrow nesting and expose blob leaves as descriptors without loading payload bytes. BlobHandling::AllBinary materializes only blob leaves to binary values while keeping the surrounding List / Struct layout intact.

This keeps the existing one-blob-per-row APIs unchanged and avoids adding a public random-access API for list blob values.

@github-actions github-actions Bot added A-encoding Encoding, IO, file reader/writer enhancement New feature or request labels Jul 7, 2026
@Xuanwo Xuanwo marked this pull request as ready for review July 7, 2026 10:15
@codecov

codecov Bot commented Jul 7, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 80.81395% with 165 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
rust/lance/src/dataset/blob.rs 80.95% 88 Missing and 48 partials ⚠️
rust/lance/src/io/exec/scan.rs 41.66% 21 Missing ⚠️
rust/lance-core/src/datatypes/field.rs 87.03% 6 Missing and 1 partial ⚠️
rust/lance-core/src/datatypes/schema.rs 94.73% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-encoding Encoding, IO, file reader/writer enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant