Disable bootstrap precombine - #1

Open

a49a wants to merge 2284 commits into

DTStack:masterfrom

a49a:disable-bootstrap-precombine

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 22, 2022

[HUDI-4628] Hudi-flink support GLOBAL_BLOOM，GLOBAL_SIMPLE，BUCKET index type (#6406)

authored and
yuzhaojing
committed
6d37d06
[HUDI-4814] Schedules new clustering plan based on latest clustering instant (#6574)

authored and
yuzhaojing
committed
f13ec25
[HUDI-4817] Delete markers after full-record bootstrap operation (#6667)

yihua
authored and
yuzhaojing
committed
16328a8
[HUDI-4691] Cleaning up duplicated classes in Spark 3.3 module (#6550)

Alexey Kudinkin
authored and
yuzhaojing
committed
e16d63b
[HUDI-4752] Add dedup support for MOR table in cli (#6608)

xicm
authored and
yuzhaojing
committed
95ac58e
[HUDI-4837] Stop sleeping where it is not necessary after the success (#6270)

authored and
yuzhaojing
committed
0afc581
[HUDI-4843] Delete the useless timer in BaseRollbackActionExecutor (#6671)

authored and
yuzhaojing
committed
d614242
[HUDI-4780] hoodie.logfile.max.size It does not take effect, causing the log file to be too large (#6602)

loukey-lj
authored and
yuzhaojing
committed
34c6ce9
[HUDI-4844] Skip partition value resolving when the field does not exists for MergeOnReadInputFormat#getReader (#6678)

danny0405
authored and
yuzhaojing
committed
394ebb3
[MINOR] Fix the Spark job status description for metadata-only bootstrap operation (#6666)

yihua
authored and
yuzhaojing
committed
59c85a4
[HUDI-3403] Ensure keygen props are set for bootstrap (#6645)

codope
authored and
yuzhaojing
committed
17a23da
[HUDI-4193] Upgrade Protobuf to 3.21.5 (#5784)

slachiewicz
authored and
yuzhaojing
committed
73d8758
[HUDI-4785] Fix partition discovery in bootstrap operation (#6673)

authored and
yuzhaojing
committed
ebdb9f4
[HUDI-4706] Fix InternalSchemaChangeApplier#applyAddChange error to add nest type (#6486)

wzx140
authored and
yuzhaojing
committed
ec62884
[HUDI-4851] Fixing CSI not handling `InSet` operator properly (#6685)

Alexey Kudinkin
authored and
yuzhaojing
committed
b7687d9
[HUDI-4796] MetricsReporter stop bug (#6619)

the-other-tim-brown
authored and
yuzhaojing
committed
c758a96
[HUDI-3861] update tblp 'path' when rename table (#5320)

KnightChess
authored and
yuzhaojing
committed
8e3c365
[HUDI-4853] Get field by name for OverwriteNonDefaultsWithLatestAvroPayload to avoid schema mismatch (#6689)

danny0405
authored and
yuzhaojing
committed
be67657
[HUDI-4813] Fix infer keygen not work in sparksql side issue (#6634)

authored and
yuzhaojing
committed
ba77748
[HUDI-4856] Missing option for HoodieCatalogFactory (#6693)

danny0405
authored and
yuzhaojing
committed
f7a6637
[HUDI-4864] Fix AWSDmsAvroPayload#combineAndGetUpdateValue when using MOR snapshot query after delete operations with test (#6688)

authored and
yuzhaojing
committed
702e40c
[HUDI-4841] Fix sort idempotency issue (#6669)

voonhous
authored and
yuzhaojing
committed
9b886d1
[HUDI-4865] Optimize HoodieAvroUtils#isMetadataField to use O(1) complexity (#6702)

danny0405
authored and
yuzhaojing
committed
6572693
[HUDI-4736] Fix inflight clean action preventing clean service to continue when multiple cleans are not allowed (#6536)

yihua
authored and
yuzhaojing
committed
7db20e9
[HUDI-4842] Support compaction strategy based on delta log file num (#6670)

authored and
yuzhaojing
committed
8b21bb7
[HUDI-4282] Repair IOException in CHDFS when check block corrupted in HoodieLogFileReader (#6031)

authored and
yuzhaojing
committed
a084dd6
[HUDI-4757] Create pyspark examples (#6672)

Jon Vexler
authored and
yuzhaojing
committed
c11537b
[HUDI-3959] Rename class name for spark rdd reader (#5409)

authored and
yuzhaojing
committed
fd0a953
[HUDI-4828] Fix the extraction of record keys which may be cut out (#6650)

authored and
yuzhaojing
committed
3db232e
[HUDI-4873] Report number of messages to be processed via metrics (#6271)

authored and
yuzhaojing
committed
094ed24
[HUDI-4424] Add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ… (#6144)

fengjian428
authored and
yuzhaojing
committed
93e94eb

Commits on Sep 29, 2022

Fix errors from cherry-picking
yuzhaojing
committed
fe9cbbc
Create release branch for version 0.12.1.
yuzhaojing
committed
53a3dae
[HUDI-4870] Improve compaction config description (#6706)

yihua
authored and
yuzhaojing
committed
e524a62
[HUDI-4808] Fix HoodieSimpleBucketIndex not consider bucket num in lo… (#6630)

authored and
yuzhaojing
committed
0bd1c53
[HUDI-4485] Bump spring shell to 2.1.1 in CLI (#6489)

paul8263
authored and
yuzhaojing
committed
62e1192
[minor] following 3304, some code refactoring (#6713)

danny0405
authored and
yuzhaojing
committed
5a8fab6
[HUDI-4832] Fix drop partition meta sync (#6662)

codope
authored and
yuzhaojing
committed
34ff529
[HUDI-4810] Fix log4j imports to use bridge API (#6710)

authored and
yuzhaojing
committed
e67b6f5
[HUDI-4877] Fix org.apache.hudi.index.bucket.TestHoodieSimpleBucketIndex#testTagLocation not work correct issue (#6717)

authored and
yuzhaojing
committed
19b63fb
[HUDI-4326] add updateTableSerDeInfo for HiveSyncTool (#5920)

authored and
yuzhaojing
committed
ffeb7eb
[MINOR] fix indent to make build pass (#6721)

YannByron
authored and
yuzhaojing
committed
4e92eb8
[HUDI-4326] Fix hive sync serde properties (#6722)

xushiyan
authored and
yuzhaojing
committed
464d992
[HUDI-4875] Fix NoSuchTableException when dropping temporary view after applied HoodieSparkSessionExtension in Spark 3.2 (#6709)

dohongdayi
authored and
yuzhaojing
committed
4f616f7
[DOCS] Improve the quick start guide for Kafka Connect Sink (#6708)

yihua
authored and
yuzhaojing
committed
8c7dca2
[HUDI-4729] Fix file group pending compaction cannot be queried when query _ro table (#6516)

authored and
yuzhaojing
committed
218240e
[HUDI-3983] Fix ClassNotFoundException when using hudi-spark-bundle to write table with hbase index (#6715)

xicm
authored and
yuzhaojing
committed
4cc2692
[HUDI-4758] Add validations to java spark examples (#6615)

Jon Vexler
authored and
yuzhaojing
committed
274325a
[HUDI-4792] Batch clean files to delete (#6580)

authored and
yuzhaojing
committed
5271f0f
[HUDI-4363] Support Clustering row writer to improve performance (#6046)

boneanxs
authored and
yuzhaojing
committed
da71afd
[HUDI-4851] Fixing handling of `UTF8String` w/in `InSet` operator (#6739)

authored and
yuzhaojing
committed
7facad1
[HUDI-3901] Correct the description of hoodie.index.type (#6749)

yihua
authored and
yuzhaojing
committed
fad706c
[MINOR] Add .mvn directory to gitignore (#6746)

authored and
yuzhaojing
committed
bdaef29
[HUDI-4901] Add avro.version to Flink profiles (#6757)

CTTY
authored and
yuzhaojing
committed
e87a367
[HUDI-4559] Support hiveSync command based on Call Produce Command (#6322)

XuQianJin-Stars
authored and
yuzhaojing
committed
21a3bff
[HUDI-4883] Supporting delete savepoint for MOR (#6744)

nsivabalan
authored and
yuzhaojing
committed
a91b03f
[HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add columns to the end of a schema (#5031)

wangxianghu
authored and
yuzhaojing
committed
a25c26d
Revert "[HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add columns to the end of a schema (#5031)" (#6768)

wangxianghu
authored and
yuzhaojing
committed
9d31073
[HUDI-3523] Introduce AddPrimitiveColumnSchemaPostProcessor to support add new primitive column to the end of a schema (#6769)

wangxianghu
authored and
yuzhaojing
committed
f144874
[HUDI-4903] Fix TestHoodieLogFormat`s minor typo (#6762)

wulei0302
authored and
yuzhaojing
committed
fcdd849
[MINOR] Drastically reducing concurrency level (to avoid CI flakiness) (#6754)

Alexey Kudinkin
authored and
yuzhaojing
committed
57fa1e7
Update HoodieIndex.java

wongxingjun
authored and
yuzhaojing
committed
e370c55
[HUDI-4906] Fix the local tests for hudi-flink (#6763)

danny0405
authored and
yuzhaojing
committed
870ef0c
[HUDI-4899] Fixing compatibility w/ Spark 3.2.2 (#6755)

Alexey Kudinkin
authored and
yuzhaojing
committed
bead716
[HUDI-4892] Fix hudi-spark3-bundle (#6735)

yihua
authored and
yuzhaojing
committed
23d7058
[MINOR] Fix a few typos in HoodieIndex (#6784)

authored and
yuzhaojing
committed
7283523
[HUDI-4412] Fix multi writer INSERT_OVERWRITE NPE bug (#6130)

liujinhui1994
authored and
yuzhaojing
committed
bd93c84
[MINOR] retain avro's namespace (#6783)

YannByron
authored and
yuzhaojing
committed
6a647c5
[MINOR] Simple logging fix in LockManager (#6765)

authored and
yuzhaojing
committed
c122ff6
[HUDI-4433] hudi-cli repair deduplicate not working with non-partitioned dataset (#6349)

authored and
yuzhaojing
committed
1eb3010
[RFC-51][HUDI-3478] Update RFC: CDC support (#6256)

xushiyan
authored and
yuzhaojing
committed
1a4356f
[HUDI-4915] improve avro serializer/deserializer (#6788)

YannByron
authored and
yuzhaojing
committed
830e35c
[HUDI-4830] Fix testNoGlobalConfFileConfigured when add hudi-defaults.conf in default dir (#6652)

Zouxxyy
authored and
yuzhaojing
committed
19b74ea
[HUDI-4760] Fixing repeated trigger of data file creations w/ clustering (#6561)

nsivabalan
authored and
yuzhaojing
committed
d75f5ae
[HUDI-4584] Cleaning up Spark utilities (#6351)

Alexey Kudinkin
authored and
yuzhaojing
committed
88c1ca2
fix test
yuzhaojing
committed
ebf4120
[HUDI-4914] Managed memory weight should be set when sort clustering is enabled (#6792)

SteNicholas
authored and
yuzhaojing
committed
77fa389
[HUDI-4910] Fix unknown variable or type "Cast" (#6778)

KnightChess
authored and
yuzhaojing
committed
472c782
[HUDI-4918] Fix bugs about when trying to show the non -existing key from env, NullPointException occurs. (#6794)

Forus0322
authored and
yuzhaojing
committed
903dd3b
[HUDI-4718] Add Kerberos kinit command support. (#6719)

paul8263
authored and
yuzhaojing
committed
f6c9b51
[HUDI-4902] Set default partitioner for SIMPLE BUCKET index (#6759)

xicm
authored and
yuzhaojing
committed
0b819e6
[MINOR] Update PR template with documentation update (#6748)

yihua
authored and
yuzhaojing
committed
69b90f6
[HUDI-4907] Prevent single commit multi instant issue (#6766)

authored and
yuzhaojing
committed
ed7e6c9
[HUDI-4923] Fix flaky TestHoodieReadClient.testReadFilterExistAfterBulkInsertPrepped (#6801)

authored and
yuzhaojing
committed
33666c8
[HUDI-4848] Fixing repair deprecated partition tool (#6731)

nsivabalan
authored and
yuzhaojing
committed
1c12e84
[HUDI-4913] Fix HoodieSnapshotExporter for writing to a different S3 bucket or FS (#6785)

yihua
authored and
yuzhaojing
committed
31ba568
[HUDI-4453] Fix schema to include partition columns in bootstrap operation (#6676)

yihua
authored and
yuzhaojing
committed
0239652
[HUDI-2780] Fix the issue of Mor log skipping complete blocks when reading data (#4015)

authored and
yuzhaojing
committed
5ed94cd
[HUDI-4924] Auto-tune dedup parallelism (#6802)

yihua
authored and
yuzhaojing
committed
c439855
[HUDI-4687] Avoid setAccessible which breaks strong encapsulation (#6657)

codope
authored and
yuzhaojing
committed
8295329
[MINOR] fixing validate async operations to poll completed clean instances (#6814)

nsivabalan
authored and
yuzhaojing
committed
856c1f5
[HUDI-4734] Deltastreamer table config change validation (#6753)

authored and
yuzhaojing
committed
ab30021
[HUDI-4934] Revert batch clean files (#6813)

nsivabalan
authored and
yuzhaojing
committed
b36c1db

Commits on Sep 30, 2022

Revert "[HUDI-4915] improve avro serializer/deserializer (#6788)"
yuzhaojing
committed
0ae83cb
[HUDI-4722] Added locking metrics for Hudi (#6502)

jsbali
authored and
yuzhaojing
committed
2e0e8ab
[HUDI-4936] Fix `as.of.instant` not recognized as hoodie config (#5616)

authored and
yuzhaojing
committed
0f1130d
[HUDI-4861] Relaxing `MERGE INTO` constraints to permit limited casting operations w/in matched-on conditions (#6820)

Alexey Kudinkin
authored and
yuzhaojing
committed
790c4a2
[HUDI-4885] Adding org.apache.avro to hudi-hive-sync bundle (#6729)

nsivabalan
authored and
yuzhaojing
committed
26bbcec
[HUDI-4951] Fix incorrect use of Long.getLong() (#6828)

shenshengli
authored and
yuzhaojing
committed
c8a5283
[MINOR] Use base path URI in ITTestDataStreamWrite (#6826)

codope
authored and
yuzhaojing
committed
eff2056
[HUDI-4308] READ_OPTIMIZED read mode will temporary loss of data when compaction (#6664)

authored and
yuzhaojing
committed
d83df6f
[HUDI-4237] Fixing empty partition-values being sync'd to HMS (#6821)

authored and
yuzhaojing
committed
6fee77b
[HUDI-4925] Should Force to use ExpressionPayload in MergeIntoTableCommand (#6355)

authored and
yuzhaojing
committed
c48534d

Commits on Oct 1, 2022

[HUDI-4957] Shade JOL in bundles to fix NoClassDefFoundError:GraphLayout (#6839)

codope
authored and
yuzhaojing
committed
7f73dcd

Commits on Oct 4, 2022

[HOTFIX] Fix source release validate script
yuzhaojing
committed
290fc65

Commits on Oct 5, 2022

[MINOR] Fix deploy script for flink 1.15
yuzhaojing
committed
ee08024

Commits on Oct 6, 2022

[MINOR] Update release version to reflect published version 0.12.1
yuzhaojing
committed
28cb191

Commits on Oct 9, 2022

[HUDI-4992] Fixing invalid min/max record key stats in Parquet metadata (#6883)

Alexey Kudinkin
authored and
yuzhaojing
committed
5110562
Bumping release candidate number 2
yuzhaojing
committed
baeff43

Commits on Oct 17, 2022

[MINOR] Update release version to reflect published version 0.12.1
yuzhaojing
committed
a5978cd

Commits on Dec 14, 2022

[HUDI-4966] Add a partition extractor to handle partition values with slashes (#6851)

yihua
authored and
Alexey Kudinkin
committed
9ca38c4
[MINOR] Fix testUpdateRejectForClustering (#6852)

Zouxxyy
authored and
Alexey Kudinkin
committed
e7df7ab
[HOTFIX] Fix source release validate script (#6865)

xushiyan
authored and
Alexey Kudinkin
committed
14d2578
[HUDI-4980] Calculate avg record size using commit only (#6864)

xushiyan
authored and
Alexey Kudinkin
committed
039c2e4
[MINOR] Fix deploy script for flink 1.15 (#6872)

xushiyan
authored and
Alexey Kudinkin
committed
76ef1da
[HUDI-4972] Fixes to make unit tests work on m1 mac (#6751)

Jon Vexler
authored and
Alexey Kudinkin
committed
2e06842
[HUDI-2786] Docker demo on mac aarch64 (#6859)

Jon Vexler
authored and
Alexey Kudinkin
committed
e63224d
[HUDI-4971] Fix shading kryo-shaded with reusing configs (#6873)

xushiyan
authored and
Alexey Kudinkin
committed
96c8b0b
Relocate apache http package (#6874)

parisni
authored and
Alexey Kudinkin
committed
74b0f48
[HUDI-4975] Fix datahub bundle dependency (#6896)

xushiyan
authored and
Alexey Kudinkin
committed
1202fbb
[HUDI-4993] Make DataPlatform name and Dataset env configurable in DatahubSyncTool (#6885)

pramodbiligiri
authored and
Alexey Kudinkin
committed
7dbb171
[HUDI-4754] Add compliance check in github actions (#6575)

Jon Vexler
authored and
Alexey Kudinkin
committed
3aec340
[HUDI-4994] Fix bug that prevents re-ingestion of soft-deleted Datahub entities (#6886)

pramodbiligiri
authored and
Alexey Kudinkin
committed
4c4a708
[HUDI-4952] Fixing reading from metadata table when there are no inflight commits (#6836)

nsivabalan
authored and
Alexey Kudinkin
committed
ba6a3ce
[HUDI-5006] Use the same wrapper for timestamp type metadata for parquet and log files (#6918)

danny0405
authored and
Alexey Kudinkin
committed
a2e0914
[HUDI-5016] Flink clustering does not reserve commit metadata (#6929)

danny0405
authored and
Alexey Kudinkin
committed
098d34d
[HUDI-3900] Fixing hdfs setup and tear down in tests to avoid flakiness (#6912)

nsivabalan
authored and
Alexey Kudinkin
committed
97d2114
[HUDI-5002] Remove deprecated API usage in SparkHoodieHBaseIndex#generateStatement (#6909)

authored and
Alexey Kudinkin
committed
5f2fef0
[HUDI-5010] Fix flink hive catalog external config not work (#6923)

wxplovecc
authored and
Alexey Kudinkin
committed
4eb638b
[HUDI-5033] Fix Broken Link In MultipleSparkJobExecutionStrategy (#6951)

authored and
Alexey Kudinkin
committed
1f3a47e
[HUDI-5037] Upgrade org.apache.thrift:libthrift to 0.14.0 (#6941)

vvsd
authored and
Alexey Kudinkin
committed
bd6e96b
[HUDI-5003] Fix the type of InLineFileSystem`startOffset to long (#6916)

wulei0302
authored and
Alexey Kudinkin
committed
b2d5332
[HUDI-4855] Add missing table configs for bootstrap in Deltastreamer (#6694)

yihua
authored and
Alexey Kudinkin
committed
5e933f0
[MINOR] Increase maxParameters size in scalastyle (#6987)

Zouxxyy
authored and
Alexey Kudinkin
committed
39d9b44
[MINOR] Test case for hoodie.merge.allow.duplicate.on.inserts (#6949)

Zouxxyy
authored and
Alexey Kudinkin
committed
3cb7fe6
[HUDI-4982] Add validation job for spark bundles in GitHub Actions (#6954)

xushiyan
authored and
Alexey Kudinkin
committed
5c11e4a
[HUDI-5041] Fix lock metric register confict error (#6968)

authored and
Alexey Kudinkin
committed
c038e76
[HUDI-4998] Infer partition extractor class first from meta sync partition fields (#6899)

xicm
authored and
Alexey Kudinkin
committed
bd60454
[HUDI-4997] Use jackson-v2 import instead of jackson-v1 (#6893)

authored and
Alexey Kudinkin
committed
4e276ce
[HUDI-4995] Relocate httpcomponents (#6906)

xushiyan
authored and
Alexey Kudinkin
committed
643f906
[HUDI-4960] Upgrade jetty version for timeline server (#6844)

authored and
Alexey Kudinkin
committed
1aafffb
[HUDI-5046] Support all the hive sync options for flink sql (#6985)

danny0405
authored and
Alexey Kudinkin
committed
c5a973a
[HUDI-5063] Enabling run time stats to be serialized with commit metadata (#7006)

nsivabalan
authored and
Alexey Kudinkin
committed
2c28d80
[HUDI-5070] Adding lock provider to testCleaner tests since async cleaning is invoked (#7023)

nsivabalan
authored and
Alexey Kudinkin
committed
1cd54dc
[HUDI-5070] Move flaky cleaner tests to separate class (#7034)

xushiyan
authored and
Alexey Kudinkin
committed
103dd10
[HUDI-4971] Remove direct use of kryo from `SerDeUtils` (#7014)

xushiyan
and
Alexey Kudinkin
committed
9ad09a3
[HUDI-5081] Tests clean up in hudi-utilities (#7033)

the-other-tim-brown
authored and
Alexey Kudinkin
committed
fbeb0dd
[HUDI-5027] Replace hardcoded hbase config keys with constant variables (#6946)

slfan1989
authored and
Alexey Kudinkin
committed
2b4df8e
[HUDI-5061] bulk insert operation don't throw other exception except IOE Exception (#7001)

authored and
Alexey Kudinkin
committed
185f07e
[MINOR] Skip loading last completed txn for single writer (#6660)

authored and
Alexey Kudinkin
committed
0abbc50
[HUDI-4281] Using hudi to build a large number of tables in spark on hive causes OOM (#5903)

zhangrenhua
authored and
Alexey Kudinkin
committed
aab5dcd
[HUDI-5042] Fix clustering schedule problem in flink when enable schedule clustering and disable async clustering (#6976)

authored and
Alexey Kudinkin
committed
487b42e
[HUDI-5038] Increase default num_instants to fetch for incremental source (#6955)

yihua
authored and
Alexey Kudinkin
committed
b32e813
[HUDI-4959] Fixing Avro's `Utf8` serialization in Kryo (#7024)

alexeykudinkin
authored and
Alexey Kudinkin
committed
c4d98ad
[HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions (#7005)

authored and
Alexey Kudinkin
committed
debc92e
[HUDI-5085]When a flink job has multiple sink tables, the index loading status is abnormal (#7051)

yangxiao0320
authored and
Alexey Kudinkin
committed
faf57e1
[HUDI-5058] Fix flink catalog read spark table error : primary key col can not be nullable (#7009)

waywtdcc
authored and
Alexey Kudinkin
committed
5f52597
[HUDI-5087] Fix incorrect merging sequence for Column Stats Record in `HoodieMetadataPayload` (#7053)

Zhangshunyu
and
Alexey Kudinkin
committed
76fe2bb
[HUDI-4946] fix merge into with no preCombineField having dup row by only insert (#6824)

KnightChess
authored and
Alexey Kudinkin
committed
610258f
[HUDI-3287] Remove hudi-spark dependencies from hudi-kafka-connect-bundle (#6079)

codope
authored and
Alexey Kudinkin
committed
213215b
[HUDI-4716] Avoid parquet-hadoop-bundle in hudi-hadoop-mr (#6930)

xushiyan
authored and
Alexey Kudinkin
committed
b447828
[HUDI-5083]Fixed a bug when schema evolution (#7045)

shenshengli
authored and
Alexey Kudinkin
committed
e3e95dc
[HUDI-5102] source operator(monitor and reader) support user uid (#7085)

authored and
Alexey Kudinkin
committed
a6c153a
[MINOR] Fix typos in Spark client related classes (#7083)

lvhu-goodluck
authored and
Alexey Kudinkin
committed
390f25d
[HUDI-4741] hotfix to avoid partial failover cause restored subtask timeout (#6796)

authored and
Alexey Kudinkin
committed
d03efef
[MINOR] use default maven version since it already fix the warnings recently (#6863)

authored and
Alexey Kudinkin
committed
d411a51
Revert "[HUDI-4741] hotfix to avoid partial failover cause restored subtask timeout (#6796)" (#7090)

danny0405
authored and
Alexey Kudinkin
committed
da337b4
[MINOR] Fix doc of org.apache.hudi.sink.meta.CkpMetadata#bootstrap (#7048)

authored and
Alexey Kudinkin
committed
fab8a4f
[HUDI-4799] improve analyzer exception tip when cannot resolve expression (#6625)

KnightChess
authored and
Alexey Kudinkin
committed
6bde533
[HUDI-5096] Upgrade jcommander to 1.78 (#7068)

authored and
Alexey Kudinkin
committed
11baea6
[MINOR] Fix OverwriteWithLatestAvroPayload full class name (#7096)

albericgenius
authored and
Alexey Kudinkin
committed
d36808c
[HUDI-5074] Warn if table for metastore sync has capitals in it (#7077)

jonvex
authored and
Alexey Kudinkin
committed
867043e
[HUDI-5124] Fix HoodieInternalRowFileWriter#canWrite error return tag. (#7107)

authored and
Alexey Kudinkin
committed
7f53b7a
[MINOR] update commons-codec:commons-codec 1.4 to 1.13 (#6959)

lxxawfl
authored and
Alexey Kudinkin
committed
a42888d
[HUDI-5065] Call close on SparkRDDWriteClient in HoodieCleaner (#7101)

jonvex
authored and
Alexey Kudinkin
committed
a5e67b2
[HUDI-4624] Implement Closable for S3EventsSource (#7086)

jonvex
authored and
Alexey Kudinkin
committed
0a693b3
[HUDI-5045] Adding support to configure index type with integ tests (#6982)

authored and
Alexey Kudinkin
committed
5f41a97
[HUDI-5076] Fixing non serializable path used in engineContext with metadata table intialization (#7036)

nsivabalan
authored and
Alexey Kudinkin
committed
f8bad72
[HUDI-4880] Fix corrupted parquet file issue left over by cancelled compaction task (#6733)

TengHuo
authored and
Alexey Kudinkin
committed
9524fa8
[HUDI-5147] Flink data skipping doesn't work when HepPlanner calls copy()… (#7113)

trushev
authored and
Alexey Kudinkin
committed
3d22a19
[MINOR] Fixing broken test (#7123)

nsivabalan
authored and
Alexey Kudinkin
committed
a51d52c
[HUDI-5126] Delete duplicate configuration items PAYLOAD_CLASS_NAME (#7103)

windWheel
authored and
Alexey Kudinkin
committed
6ea28ee
[HUDI-4989] Fixing deltastreamer init failures (#6862)

nsivabalan
authored and
Alexey Kudinkin
committed
924e150
[MINOR] Fix flaky test in ITTestHoodieDataSource (#7134)

trushev
authored and
Alexey Kudinkin
committed
ac2d7d3
[HUDI-5088]Fix bug:Failed to synchronize the hive metadata of the Flink table (#7056)

waywtdcc
authored and
Alexey Kudinkin
committed
06ac819
[HUDI-5066] Support flink hoodie source metaclient cache (#7017)

chenshzh
authored and
Alexey Kudinkin
committed
80d67f7
[HUDI-5132] Add hadoop-mr bundle validation (#7157)

xushiyan
authored and
Alexey Kudinkin
committed
15b37e5
[HUDI-2673] Add kafka connect bundle to validation test (#7131)

xushiyan
authored and
Alexey Kudinkin
committed
c40fc8d
[HUDI-5025] Rollback failed with log file not found when rollOver in rollback process (#6939)

wxplovecc
authored and
Alexey Kudinkin
committed
6e398ae
[HUDI-4526] Improve spillableMapBasePath when disk directory is full (#6284)

XuQianJin-Stars
authored and
Alexey Kudinkin
committed
4cd1722
[HUDI-5111] Improve integration test coverage (#7092)

authored and
Alexey Kudinkin
committed
09119fb
[MINOR] Performance improvement of flink ITs with reused miniCluster (#7151)

trushev
authored and
Alexey Kudinkin
committed
99c5a27
[HUDI-5176] Fix incremental source to consider inflight commits before completed commits (#7160)

yihua
authored and
Alexey Kudinkin
committed
4d9f20e
[MINOR] Balance CI jobs (#6838)

xushiyan
authored and
Alexey Kudinkin
committed
aa9265c
[HUDI-5185] Fix CLI run compaction failing with --hoodieConfigs (#7168)

xicm
authored and
Alexey Kudinkin
committed
411a768
[HUDI-5191] Fix compatibility with avro 1.10 (#7175)

Zouxxyy
authored and
Alexey Kudinkin
committed
bbdb77e
[HUDI-5206] RowColumnReader should not return null value for certain null child columns (#7194)

SteNicholas
authored and
Alexey Kudinkin
committed
bb73020
[HUDI-5227] Bump Javalin to 4.6.7 and Jetty to 9.4.48 (#7211)

authored and
Alexey Kudinkin
committed
a55f70f
Use as.of.instant for IncrementalRelation (#6921)

boneanxs
authored and
Alexey Kudinkin
committed
edb30dd
[HUDI-5203] Handle null fields in debezium avro payloads (#7193)

xushiyan
authored and
Alexey Kudinkin
committed
a8ed77a
[HUDI-5233] Fix bug when InternalSchemaUtils.collectTypeChangedCols returns all columns (#7228)

trushev
authored and
Alexey Kudinkin
committed
735e061
[HUDI-5070] Move flaky cleaner tests to separate class (#7251)

xushiyan
authored and
Alexey Kudinkin
committed
330a027
[HUDI-5247] Clean up java client tests (#7250)

xushiyan
authored and
Alexey Kudinkin
committed
01f043a
[HUDI-5244] Fix bugs in schema evolution client with lost operation field and not found schema (#7248)

trushev
authored and
Alexey Kudinkin
committed
b000072
[MINOR] Fix `TestSchemaEvolutionClient` compilation (#7256)

xushiyan
authored and
Alexey Kudinkin
committed
8eebd66
[HUDI-5157] Support dropping all meta fields from source hudi table with hudi incr source (#7132)

nsivabalan
authored and
Alexey Kudinkin
committed
f7927ed
[HUDI-5260] Fix insert into sql command with strict sql insert mode (#7269)

kazdy
authored and
Alexey Kudinkin
committed
d4ec501
[HUDI-5277] Close HoodieWriteClient before exiting RunClusteringProcedure (#7300)

stream2000
authored and
Alexey Kudinkin
committed
5230a11
[HUDI-5242] Do not fail Meta sync in Deltastreamer when inline table service fails (#7243)

jonvex
authored and
Alexey Kudinkin
committed
a78cb09
[HUDI-5253] HoodieMergeOnReadTableInputFormat could have duplicate records issue if it contains delta files while still splittable (#7264)

boneanxs
authored and
Alexey Kudinkin
committed
4ccee72
[HUDI-5151] Fix bug with broken flink data skipping caused by ClassNotFoundException of InLineFileSystem (#7124)

trushev
authored and
Alexey Kudinkin
committed
64a359b
[HUDI-5344] Fix CVE - upgrade protobuf-java to 3.18.2 (#6957)

bitmasks
authored and
Alexey Kudinkin
committed
ab80838
[HUDI-5163] Fix failure handling with spark datasource write (#7140)

nsivabalan
authored and
Alexey Kudinkin
committed
e3c9562
[HUDI-5344] Fix CVE - upgrade protobuf-java (#6960)

authored and
Alexey Kudinkin
committed
8b294b0
[HUDI-5345] Avoid fs.exists calls for metadata table in HFileBootstrapIndex (#7404)

yihua
authored and
Alexey Kudinkin
committed
ee60a6a
[HUDI-5291] Fixing NPE in MOR column stats accounting (#7349)

alexeykudinkin
authored and
Alexey Kudinkin
committed
6fa7ff9
[HUDI-5346][HUDI-5320] Fixing Create Table as Select (CTAS) performance gaps (#7370)

alexeykudinkin
authored and
Alexey Kudinkin
committed
0e17e18
[HUDI-5350] Fix oom cause compaction event lost problem (#7408)

authored and
Alexey Kudinkin
committed
1a2ffdd
[HUDI-5358] Fix flaky tests in TestCleanerInsertAndCleanByCommits (#7420)

yihua
authored and
Alexey Kudinkin
committed
5d4f59c
[HUDI-5342] Add new bulk insert sort modes repartitioning data by partition path (#7402)

yihua
authored and
Alexey Kudinkin
committed
fb552ae
[HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert (#7396)

yihua
authored and
Alexey Kudinkin
committed
bbde3a9
[HUDI-5336] Fixing parsing of log files while building file groups (#7393)

nsivabalan
authored and
Alexey Kudinkin
committed
01ba650
[HUDI-5372] Fix NPE caused by alter table add column. (#7236)

scxwhite
authored and
Alexey Kudinkin
committed
5e31223
[MINOR] Fix Out of Bounds Exception for DayBasedCompactionStrategy (#7360)

vamshigv
authored and
Alexey Kudinkin
committed
8f5723b
[HUDI-5353] Close file readers (#7412)

codope
authored and
Alexey Kudinkin
committed
106d216
[HUDI-5078] Fixing isTableService for replace commits (#7037)

nsivabalan
authored and
Alexey Kudinkin
committed
1743d05
[HUDI-5296] Allow disable schema on read after enabling (#7421)

nsivabalan
authored and
Alexey Kudinkin
committed
8bc9fa5
[HUDI-5348] Cache file slices in HoodieBackedTableMetadata (#7436)

yihua
authored and
Alexey Kudinkin
committed
4fd25ca
Avoiding costly lookups into the schema cache in `SqlTypedRecord`
Alexey Kudinkin
committed
292630b
Fixing schemas used for bootstrap reader
Alexey Kudinkin
committed
ee8c9df

Commits on Dec 15, 2022

[HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex (#7450)
nsivabalan
authored
738f673
[HUDI-5187] Remove the preCondition check of BucketAssigner assign state (#7170)

danny0405
authored and
nsivabalan
committed
d9a4d21
[HUDI-5221] Make the decision for flink sql bucket index case-insensitive (#7207)

danny0405
authored and
nsivabalan
committed
6d5ea00
[HUDI-5223] Partial failover for flink (#7208)

danny0405
authored and
nsivabalan
committed
0542f56
[HUDI-4871][HUDI-4411] Upgrade to spark 3.3.1 & 3.2.2 (#7155)

xushiyan
authored and
Alexey Kudinkin
committed
6fa192a
[HUDI-5097] Fix partition reading without partition fields table config (#7069)
xushiyan
authored
492f7d7

Commits on Dec 16, 2022

Cherry pick for HUDI-5007 and HUDI-5228 (#7471)

danny0405
and
voonhous
authored
fe86a83
[HUDI-5290] Remove the lock in HoodieFlinkWriteClient#writeTableMetadata (#7320) (#7462)

nsivabalan
and
just-JL
authored
1f0b2dd
[HUDI-5366] Closing metadata writer from within writeClient (0.12.2) (#7464)

nsivabalan
and
codope
authored
b50dc32
[HUDI-3661] Flink async compaction is not thread safe when use watermark (#7399) (#7465)
danny0405
authored
1061de2
[HUDI-5104] Add feature flag to disable HoodieFileIndex and fall back to HoodieROTablePathFilter (#7088)
yihua
committed
d971f3e
[HUDI-5251] Split GitHub actions CI by spark and flink (#7265)

xushiyan
authored and
nsivabalan
committed
3fb6d33
[HUDI-5357] Optimize deployment of release artifacts (#7419)

xushiyan
authored and
nsivabalan
committed
0a53080

Commits on Dec 17, 2022

[HUDI-5403] Turn off metadata-table-based file listing in BaseHoodieTableFileIndex (#7488)

authored and
nsivabalan
committed
31959f9
[HUDI-5409] Avoid file index and use fs view cache in COW input format (#7493)

codope
authored and
nsivabalan
committed
3a4ffaf
Fixing build failures
nsivabalan
committed
de51917
Bumping mvn version to 0.12.2-1
satishkotha
committed
94db72e

Commits on Dec 21, 2022

[HUDI-5357] Fix release build commands (#7501)

xushiyan
authored and
satishkotha
committed
975eb91

Commits on Dec 24, 2022

[MINOR] Update release version to reflect published version 0.12.2
satishkotha
committed
aea5bb6

Commits on Feb 16, 2023

Disable precombine field in bootstrap
a49a
committed
205996f