Skip to content

feat: add batch append API#58

Merged
beinan merged 3 commits into
lance-format:mainfrom
dcfocus:codex/add-many-api
Jun 9, 2026
Merged

feat: add batch append API#58
beinan merged 3 commits into
lance-format:mainfrom
dcfocus:codex/add-many-api

Conversation

@dcfocus

@dcfocus dcfocus commented Jun 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add Context.add_many(...) for appending multiple Python records in one storage operation.
  • Reuse the existing Rust ContextStore.add(&[ContextRecord]) batch path from the PyO3 binding.
  • Validate and normalize per-record fields in the public Python wrapper.
  • Add integration and wrapper tests plus a README example for source chunk ingestion.

Closes #54

Testing

  • python3 -m py_compile python/python/lance_context/api.py python/tests/test_search.py python/tests/test_add_many.py
  • git diff --check
  • ./.codex/skills/ci-pr-helper/scripts/run_ci_checks.sh failed locally: cargo not found; install Rust to run Rust checks.
  • Full cargo, ruff, and pytest checks were not run because those tools are not installed in this shell.

@dcfocus dcfocus marked this pull request as ready for review June 9, 2026 04:41
@dcfocus dcfocus force-pushed the codex/add-many-api branch from 045e213 to 0f37930 Compare June 9, 2026 05:38
@beinan beinan merged commit 7c94f67 into lance-format:main Jun 9, 2026
3 checks passed
@dcfocus dcfocus deleted the codex/add-many-api branch June 27, 2026 19:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add batch write API for atomic multi-record appends

2 participants