All pull requests

Pull requests

• [SPARK-60358][SQL] Fix Parquet filter pushdown on TIME columns read with a lower precision

  #59606·dongjoon-hyun opened Oct 19, 2026Member·

  ·

• [SPARK-60356][SQL] Support left semi and left anti join pushdown for DSv2

  #59605·hemanthboyina opened Oct 19, 2026Contributor·

  ·

• [SPARK-60357][PYTHON] Return a named record from read_single_udf for every eval type

  #59604·Yicong-Huang opened Oct 19, 2026Contributor·

  ·

• [SPARK-60347][SDP] SCD1 Ignore-null support; Implement target table merge

  #59603·AnishMahto opened Oct 19, 2026Contributor·

  ·

• [SPARK-60355][SQL] Support TIME precision widening in UnwrapCastInBinaryComparison

  #59602·dongjoon-hyun opened Oct 19, 2026Member·

  ·

• [SPARK-60347][SDP] SCD1 Ignore-null support; Refactor SCD1 target merge into strategies

  #59601·AnishMahto opened Oct 19, 2026Contributor·

  ·

• [SPARK-60346][SQL] Keep the precision of TIME(p) in RowEncoder

  #59600·dongjoon-hyun opened Oct 19, 2026Member·

  ·

• [SPARK-60232][SQL][4.1] Fix nested SPJ overwriting inner join pushdown

  #59599·ammarchalifah opened Oct 19, 2026·

  ·

• [SPARK-60343][PYTHON] Fix pythonDataSent to keep counting after 2 GiB per task in pipelined Python UDF mode

  #59597·dongjoon-hyun opened Oct 19, 2026Member·

  ·

• [SPARK-60341][SQL] Support internal metadata columns in changelog reads

  #59596·SanJSp opened Oct 19, 2026Contributor·

  ·

• [SPARK-60342][CORE][WEBUI] Respect UI root in Master UI links

  #59595·dongjoon-hyun opened Oct 19, 2026Member·

  ·
  4

• [SPARK-60336][SS] Preserve repeated arithmetic terms in streaming join watermarks

  #59594·HeartSaVioR opened Oct 19, 2026Contributor·

  ·
  1

• [SPARK-60340][CORE] Avoid System.getenv on every JavaUtils.isTesting call

  #59593·sebastianhillig-db opened Oct 19, 2026Contributor·

  ·
  2

• [SPARK-59816][PYTHON] Transpile str upper, lower, startswith, and endswith

  #59592·guan404ming opened Oct 19, 2026Member·

  ·

• [SPARK-60282][SQL] Fix ASOF JOIN handling of hidden USING columns from its inputs

  #59591·LukaZdravic opened Oct 19, 2026Contributor·

  ·
  15

• [SQL] Support ARRAY<DOUBLE> input in vector_avg

  #59590·urosstan-db opened Oct 19, 2026Contributor·

  ·

• [SPARK-58485] [SQL] Broadcast hash joins with scalar subquery as join key

  #59589·VindhyaG opened Oct 19, 2026Contributor·

  ·

• [SPARK-60328][SQL][TESTS] Clear test jar from every artifact bucket in HiveDDLSuite SPARK-34261 test

  #59587·jzhuge opened Oct 19, 2026Member·

  ·
  12

• [SPARK-60331][PYTHON] Improve type annotation for vector operations and factories

  #59586·bearomorphism opened Oct 18, 2026·

  ·

• [SPARK-60327][PYTHON] ML and MLlib Vector cleanups

  #59585·bearomorphism opened Oct 18, 2026·

  ·

• [SPARK-60326][SQL] Pass the ORC SearchArgument to the reader directly

  #59584·SEPURI-SAI-KRISHNA opened Oct 18, 2026Contributor·

  ·
  3

• [SPARK-60324][SQL] Normalize -0.0 and NaN in floating-point dynamic partition values

  #59583·SEPURI-SAI-KRISHNA opened Oct 18, 2026Contributor·

  ·
  6

• [SPARK-60325][SQL] Re-enable Arrow columnar input to Python UDFs, holding only vectors that are not reused

  #59582·viirya opened Oct 18, 2026Member·

  ·

• [SPARK-60306][SQL] Release consumed columnar batches in non-codegen ColumnarToRow and Arrow Python UDFs

  #59581·viirya opened Oct 18, 2026Member·

  ·
  23

• [SPARK-60188][PYTHON] Warn on unknown transpiler names in pyTranspilers

  #59580·guan404ming opened Oct 17, 2026Member·

  ·
  2