Vector APPROXIMATE search fails with -4016 Internal error when the filter column has a prefix-length index

[hnwyllmm]

Task Description

GitHub issue: #867
Vector APPROXIMATE search fails with -4016 Internal error when the filter column has a prefix-length index.

Solution Description

In the case of a prefix-length index, a filter containing a regular column (the grp field from the issue) was incorrectly pushed down directly to the prefix index table. This column does not exist in the prefix index table, causing the plan generated by code generation to attempt to access a non-existent column during execution.

The solution is to remove the push-down filter when the column being pushed down to the index table does not exist. (In this specific scenario, the idx_grp index will use a range scan instead of pushing down a filter to filter the data.)

Passed Regressions

Upgrade Compatibility

Other Information

• DIMA-2026060900116643089

Release Note

[hnwyllmm]

The mapping Dima issue is fixing the vector search and prefix index pre-filter problem.