From f159c493810a8b8422587bda620bebf09532d7a5 Mon Sep 17 00:00:00 2001 From: Jiri Pechanec Date: Mon, 4 Dec 2023 12:57:00 +0100 Subject: [PATCH] [release] Changelog for 2.5.0.Beta1 --- _data/releases/2.5/2.5.0.Beta1.yml | 6 ++ releases/2.5/release-notes.asciidoc | 100 ++++++++++++++++++++++++++++ 2 files changed, 106 insertions(+) create mode 100644 _data/releases/2.5/2.5.0.Beta1.yml diff --git a/_data/releases/2.5/2.5.0.Beta1.yml b/_data/releases/2.5/2.5.0.Beta1.yml new file mode 100644 index 00000000000..58410ada0b8 --- /dev/null +++ b/_data/releases/2.5/2.5.0.Beta1.yml @@ -0,0 +1,6 @@ +date: 2023-12-04 +version: "2.5.0.Beta1" +stable: false +summary: GTID support for MariaDB; Native RabbitMQ Streams sink; Partitioning for EventHubs sink; Addiitonal notifications for initial snapshot; Service account for Operator CRD; MongoDB performance and metrics improvements; Streaming from PostgreSQL 16 stand-bys; Support for high-precision source timestamps +# announcement_url: + diff --git a/releases/2.5/release-notes.asciidoc b/releases/2.5/release-notes.asciidoc index bf279f1acd7..22740a65b41 100644 --- a/releases/2.5/release-notes.asciidoc +++ b/releases/2.5/release-notes.asciidoc @@ -15,6 +15,106 @@ Release numbers follow http://semver.org[Semantic Versioning]. toc::[] +[[release-2.5.0-beta1]] +== *Release 2.5.0.Beta1* _(December 4th 2023)_ + +See the https://issues.redhat.com/secure/ReleaseNote.jspa?projectId=12317320&version=12416250[complete list of issues]. + +=== Kafka compatibility + +This release has been built against Kafka Connect 3.6.0 and has been tested with version 3.6.0 of the Kafka brokers. +See the https://kafka.apache.org/documentation/#upgrade[Kafka documentation] for compatibility with other versions of Kafka brokers. + + +=== Upgrading + +Before upgrading any connector, be sure to check the backward-incompatible changes that have been made since the release you were using. + +When you decide to upgrade one of these connectors to 2.5.0.Beta1 from any earlier versions, +first check the migration notes for the version you're using. +Gracefully stop the running connector, remove the old plugin files, install the 2.5.0.Beta1 plugin files, and restart the connector using the same configuration. +Upon restart, the 2.5.0.Beta1 connectors will continue where the previous connector left off. +As one might expect, all change events previously written to Kafka by the old connector will not be modified. + +If you are using our container images, then please do not forget to pull them fresh from https://quay.io/organization/debezium[Quay.io]. + + +=== Breaking changes + +MongoDB no longer allows doing collection snapshot on a specific shard in sharded deployment. +This was never intended and supported feature and was removed as a step in complete replica set streaming mode removal (https://issues.redhat.com/browse/DBZ-7139[DBZ-7139]). + +`ComputePartition` SMT was deprecated and replaced with significantly improved `PartitionRouting` SMT. +The original SMT is now completely removed (https://issues.redhat.com/browse/DBZ-7141[DBZ-7141]). + +JDBC Sink connector was storing default values in database columns when `null` value was streamed and such value existed. +This was incorrect behaviour and is now fixed (https://issues.redhat.com/browse/DBZ-7191[DBZ-7191]). + + + +=== New features + +* Support for mariadb GTID https://issues.redhat.com/browse/DBZ-1482[DBZ-1482] +* Include only certain columns in JDBC sink connector https://issues.redhat.com/browse/DBZ-6636[DBZ-6636] +* Support native RabbitMQ Streams https://issues.redhat.com/browse/DBZ-6703[DBZ-6703] +* Add support for partitioning with Azure EventHubs https://issues.redhat.com/browse/DBZ-6723[DBZ-6723] +* Enhance Notification information and more notifications for Initial Snapshots https://issues.redhat.com/browse/DBZ-6878[DBZ-6878] +* Add handling for CDB and non-CDB / PDB in Oracle REST Extension tests https://issues.redhat.com/browse/DBZ-7091[DBZ-7091] +* Check schema length when create value to find missed DDL by SQL_BIN_LOG=OFF https://issues.redhat.com/browse/DBZ-7093[DBZ-7093] +* Add service account parameter to DebeziumServer CRD https://issues.redhat.com/browse/DBZ-7111[DBZ-7111] +* Inactivity pause in MongoDB connector should be configurable https://issues.redhat.com/browse/DBZ-7146[DBZ-7146] +* Oracle Infinispan event processor speed-up using in memory cache https://issues.redhat.com/browse/DBZ-7153[DBZ-7153] +* Add last event process time, number of events, number of heartbeat events metrics to MongoDb connector https://issues.redhat.com/browse/DBZ-7162[DBZ-7162] +* LogMiner ISPN event buffer recent transaction optimization https://issues.redhat.com/browse/DBZ-7169[DBZ-7169] +* Support logical decoding from Postgres 16 stand-bys https://issues.redhat.com/browse/DBZ-7181[DBZ-7181] +* Support MySQL 8 high resolution replication timestamps from GTID events https://issues.redhat.com/browse/DBZ-7183[DBZ-7183] +* Use buffer queue when reading MongoDB change stream events https://issues.redhat.com/browse/DBZ-7184[DBZ-7184] +* Cleanup event processing loop in streaming event source of MongoDB connector https://issues.redhat.com/browse/DBZ-7186[DBZ-7186] +* Oracle Infinispan - implement support for abandoned transactions https://issues.redhat.com/browse/DBZ-7192[DBZ-7192] +* Add ability to avoid throwing an exception for missing additional fields https://issues.redhat.com/browse/DBZ-7197[DBZ-7197] +* XStream attach should be retriable https://issues.redhat.com/browse/DBZ-7207[DBZ-7207] + + +=== Fixes + +* Test Avro adjustment for MongoDb connector and ExtractNewDocumentState SMT https://issues.redhat.com/browse/DBZ-6809[DBZ-6809] +* The DefaultDeleteHandlingStrategy couldn't add the rewrite "__deleted" field to a non-struct value https://issues.redhat.com/browse/DBZ-7066[DBZ-7066] +* Debezium server has no default for offset.flush.interval.ms https://issues.redhat.com/browse/DBZ-7099[DBZ-7099] +* Failed to authenticate to the MySQL database after snapshot https://issues.redhat.com/browse/DBZ-7132[DBZ-7132] +* Failure reading CURRENT_TIMESTAMP on Informix 12.10 https://issues.redhat.com/browse/DBZ-7137[DBZ-7137] +* Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UNION) https://issues.redhat.com/browse/DBZ-7140[DBZ-7140] +* outbox.EventRouter SMT throws NullPointerException when there is a whitespace in fields.additional.placement value https://issues.redhat.com/browse/DBZ-7142[DBZ-7142] +* Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UPDATE) https://issues.redhat.com/browse/DBZ-7152[DBZ-7152] +* JsonSerialisation is unable to process changes from sharded collections with composite sharding key https://issues.redhat.com/browse/DBZ-7157[DBZ-7157] +* Log sequence check should treat each redo thread independently https://issues.redhat.com/browse/DBZ-7158[DBZ-7158] +* Fix DebeziumMySqlConnectorResource not using the new MySQL adatper structure to support different MySQL flavors https://issues.redhat.com/browse/DBZ-7179[DBZ-7179] +* Parsing MySQL indexes for JSON field fails, when casting is used with types double and float https://issues.redhat.com/browse/DBZ-7189[DBZ-7189] +* Unchanged toasted array columns are substituted with unavailable.value.placeholder, even when REPLICA IDENTITY FULL is configured. https://issues.redhat.com/browse/DBZ-7193[DBZ-7193] +* MongoDB streaming pauses for Blocking Snapshot only when there is no event https://issues.redhat.com/browse/DBZ-7206[DBZ-7206] +* NPE on AbstractInfinispanLogMinerEventProcessor.logCacheStats https://issues.redhat.com/browse/DBZ-7211[DBZ-7211] + + +=== Other changes + +* Generate sundrio fluent builders for operator model https://issues.redhat.com/browse/DBZ-6550[DBZ-6550] +* Convert operator source into multi module project https://issues.redhat.com/browse/DBZ-6551[DBZ-6551] +* Implement "validate filters" endpoint in connector-specific Connect REST extensions https://issues.redhat.com/browse/DBZ-6762[DBZ-6762] +* Implement IT tests against Cloud Spanner emulator in main repo. https://issues.redhat.com/browse/DBZ-6906[DBZ-6906] +* Implement strategy pattern for MariaDB and MySQL differences https://issues.redhat.com/browse/DBZ-7083[DBZ-7083] +* Run MySQL CI builds in parallel https://issues.redhat.com/browse/DBZ-7135[DBZ-7135] +* Add matrix strategy to workflows https://issues.redhat.com/browse/DBZ-7154[DBZ-7154] +* Add Unit Tests for ServiceAccountDependent Class in Debezium Operator Repository https://issues.redhat.com/browse/DBZ-7155[DBZ-7155] +* Fail fast during deserialization if a value is not a CloudEvent https://issues.redhat.com/browse/DBZ-7159[DBZ-7159] +* Correctly calculate Max LSN https://issues.redhat.com/browse/DBZ-7175[DBZ-7175] +* Upgrade to Infinispan 14.0.20 https://issues.redhat.com/browse/DBZ-7187[DBZ-7187] +* Upgrade Outbox Extension to Quarkus 3.5.3 https://issues.redhat.com/browse/DBZ-7188[DBZ-7188] +* Enable ability to stream changes against Oracle 23c for LogMiner https://issues.redhat.com/browse/DBZ-7194[DBZ-7194] +* Add modify range_partitions to modify_table_partition rule in parsing PL/SQL https://issues.redhat.com/browse/DBZ-7196[DBZ-7196] +* Handle Drop Tablespace in PL/SQL https://issues.redhat.com/browse/DBZ-7208[DBZ-7208] +* Upgrade logback to 1.2.12 https://issues.redhat.com/browse/DBZ-7209[DBZ-7209] + + + [[release-2.5.0-alpha2]] == *Release 2.5.0.Alpha2* _(November 10th 2023)_