Skip to content

Flight skip_validation should apply to dictionary batches #10255

Description

@alamb

#10206 adds an unsafe skip-validation option to arrow-flight decoding. However, Flight dictionary messages still use arrow_ipc::reader::read_dictionary, which currently constructs a fresh UnsafeFlag::new() and therefore continues to validate dictionary payloads even when FlightDataDecoder::with_skip_validation has been used.

This means dictionary-encoded Flight streams do not fully benefit from the skip-validation path: dictionary values may still pay validation costs, while later record batches use the skipped validation setting via RecordBatchDecoder::with_skip_validation(...).read_record_batch().

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions