Skip to content

GH-51100: [C++][Format] Deprecate IPC tensor/sparse tensor messages - #51102

Open
pitrou wants to merge 3 commits into
apache:mainfrom
pitrou:tensor-ipc-deprecate
Open

GH-51100: [C++][Format] Deprecate IPC tensor/sparse tensor messages#51102
pitrou wants to merge 3 commits into
apache:mainfrom
pitrou:tensor-ipc-deprecate

Conversation

@pitrou

@pitrou pitrou commented Aug 31, 2026

Copy link
Copy Markdown
Member

Rationale for this change

Deprecate Tensor and SparseTensor messages in the IPC specification.

Deprecate C++ APIs for reading and writing Tensor and SparseTensor IPC messages.

Deprecating IPC support for Tensor and SparseTensor was decided in https://lists.apache.org/thread/w7nvhjyks3p3smw5kq4ylv0nkwxq2s2q

Are these changes tested?

By existing CI tests.

Are there any user-facing changes?

No.

@github-actions

Copy link
Copy Markdown

⚠️ GitHub issue #51100 has been automatically assigned in GitHub to PR creator.

@pitrou

pitrou commented Aug 31, 2026

Copy link
Copy Markdown
Member Author

Let's keep this PR draft until final consensus is reached on the ML.

@rok

rok commented Aug 31, 2026

Copy link
Copy Markdown
Member

@pitrou I'm very much on board with the sparse tensors. I so wonder about tensors, are we sure this is not being used? I'm ok to add a deprecation and wait for a release to see if we hear back. But my expectation is there would be some users out there.

@pitrou

pitrou commented Aug 31, 2026

Copy link
Copy Markdown
Member Author

I'm ok to add a deprecation and wait for a release to see if we hear back. But my expectation is there would be some users out there.

Hopefully the deprecation will have them chime in? But my attempt at code-searching this on GH did not lead to many recent relevant results.

@rok

rok commented Aug 31, 2026

Copy link
Copy Markdown
Member

I'm ok to add a deprecation and wait for a release to see if we hear back. But my expectation is there would be some users out there.

Hopefully the deprecation will have them chime in? But my attempt at code-searching this on GH did not lead to many recent relevant results.

Agreed. I'll take a look myself and report back.

@rok

rok commented Sep 1, 2026

Copy link
Copy Markdown
Member

I've checked and found some projects using Tensor (1, 2, 3, ..), but I think they can all easily switch to tensor array. I agree with deprecating Tensor.

@pitrou
pitrou force-pushed the tensor-ipc-deprecate branch from d787c88 to efcd686 Compare September 9, 2026 14:40
@pitrou pitrou changed the title GH-51100: [C++] Deprecate IPC tensor/sparse tensor messages GH-51100: [C++][Format] Deprecate IPC tensor/sparse tensor messages Sep 9, 2026
@pitrou
pitrou marked this pull request as ready for review September 9, 2026 14:59
@pitrou
pitrou requested a review from kou as a code owner September 9, 2026 14:59
@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

@wgtmac @CurtHagenlocher @lidavidm Would you like to take a look?

@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit preview-docs

@rok

rok commented Sep 9, 2026

Copy link
Copy Markdown
Member

Should this also cover pyarrow.ipc.read_tensor, write_tensor, and get_tensor_size?

@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

We can tackle Python in a separate PR, IMHO.

@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

(I'm not sure what's with the "Release and Merge Script" CI jobs? @kou )

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown

Revision: a15a298

Submitted crossbow builds: ursacomputing/crossbow @ actions-19c98b222c

Task Status
preview-docs GitHub Actions

@github-actions github-actions Bot added awaiting committer review Awaiting committer review awaiting merge Awaiting merge and removed awaiting review Awaiting review awaiting committer review Awaiting committer review labels Sep 9, 2026
Comment thread docs/source/format/Other.rst
@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit preview-docs

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown

Revision: 9037076

Submitted crossbow builds: ursacomputing/crossbow @ actions-9ae2c160cd

Task Status
preview-docs GitHub Actions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants