Commit 3d88c99
authored
fix(search): column bulk operations search not returning results at scale (#27216)
* fix(search): column bulk operations search not returning results at scale
When searching by column name pattern (e.g., "MAT") in column bulk
operations, the composite aggregation returned ALL column names from
matching documents, then post-filtered in Java. With 20000+ columns,
the first composite page of 25 names rarely contained matches, so
users saw 0 results.
Switch to terms aggregation with `include` regex when a search pattern
is set. This filters at the ES/OS aggregation level — only matching
column names produce buckets. Two-phase approach: (1) lightweight
names query to get all matching names + accurate total, (2) targeted
data query with top_hits for the current page only.
* test(search): add integration tests for column pattern search regex against ES1 parent a2a0c8e commit 3d88c99
5 files changed
Lines changed: 1495 additions & 289 deletions
File tree
- openmetadata-integration-tests/src/test/java/org/openmetadata/it/tests
- openmetadata-service/src
- main/java/org/openmetadata/service/search
- elasticsearch
- opensearch
- test/java/org/openmetadata/service/search
0 commit comments