Details
-
Task
-
Resolution: Fixed
-
Major - P3
-
5.0.0-rc0
-
None
-
Fully Compatible
-
v5.0
-
Sharding EMEA 2021-05-31, Sharding EMEA 2021-06-14
Description
Since cluster writes can't be unit tested, some DDL utilities had been written using catalog client calls that can be very inefficient. Considering that also batched requests are unit-testable (when using the ConfigServerFixture - as in ddl util tests), some performance improvements can be applied.
Performance problems:
- The updateTags function uses the catalog client to update tags in an extremely inefficient way.
- The deletion of chunks / tags can hit the catalog client timeout in case of a lot of documents to delete.
Action points:
- Replace updateTags logic with a simple batch update.
- Replace the above mentioned delete calls with batched deletes.