feat: Added IcebergArrowInputSourceReader #19510

Open

Shekharrajak wants to merge 28 commits into

apache:masterfrom

Shekharrajak:feature/iceberg-arrow-reader

Commits on May 24, 2026

deps: add arrow 15.0.2 and iceberg-arrow to pom dependency management
Shekharrajak
committed
feat: add retrieveTable() to IcebergCatalog for direct Table object access
Shekharrajak
committed
feat: add IcebergArrowInputSourceReader using iceberg-arrow vectorized API
Shekharrajak
committed
feat: wire useArrowReader + arrowBatchSize into IcebergInputSource
Shekharrajak
committed
test: add IcebergArrowInputSourceReaderTest; fix IcebergInputSourceTest constructor arity
Shekharrajak
committed
style: fix checkstyle and forbidden-apis violations (imports, argument line breaking, DateTimes.utc, Maps.newHashMapWithExpectedSize)
Shekharrajak
committed
fix: switch arrow-memory-netty to arrow-memory-unsafe to fix CI ArrowAllocation init failure
Shekharrajak
committed
test: add regression for aggregator source column projection (currently failing)
Shekharrajak
committed
fix: drive Iceberg scan projection from ColumnsFilter, mirroring DeltaInputSource
Shekharrajak
committed
test: ColumnsFilter exclusion prunes unused columns at Iceberg scan
Shekharrajak
committed
style: drop redundant comments per AGENTS.md hygiene
Shekharrajak
committed
test: regression for residual FAIL mode bypassed by Arrow path
Shekharrajak
committed
fix: enforce residualFilterMode in Arrow reader path
Shekharrajak
committed
test: regression for parallel ingestion bypassing Arrow reader
Shekharrajak
committed
fix: route splittable contract through Arrow path when useArrowReader=true
Shekharrajak
committed

Commits on May 25, 2026

Commits on May 26, 2026

fix(iceberg-arrow): pin explicit arrow versions in iceberg pom for downstream resolvers
Shekharrajak
committed

Commits on Jun 4, 2026

Commits on Jun 11, 2026