Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[release] Changelog for 2.5.0.Beta1 #977

Merged
merged 1 commit into from
Dec 4, 2023
Merged

[release] Changelog for 2.5.0.Beta1 #977

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions _data/releases/2.5/2.5.0.Beta1.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
date: 2023-12-04
version: "2.5.0.Beta1"
stable: false
summary: GTID support for MariaDB; Native RabbitMQ Streams sink; Partitioning for EventHubs sink; Addiitonal notifications for initial snapshot; Service account for Operator CRD; MongoDB performance and metrics improvements; Streaming from PostgreSQL 16 stand-bys; Support for high-precision source timestamps
# announcement_url:

100 changes: 100 additions & 0 deletions releases/2.5/release-notes.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,106 @@ Release numbers follow http://semver.org[Semantic Versioning].

toc::[]

[[release-2.5.0-beta1]]
== *Release 2.5.0.Beta1* _(December 4th 2023)_

See the https://issues.redhat.com/secure/ReleaseNote.jspa?projectId=12317320&version=12416250[complete list of issues].

=== Kafka compatibility

This release has been built against Kafka Connect 3.6.0 and has been tested with version 3.6.0 of the Kafka brokers.
See the https://kafka.apache.org/documentation/#upgrade[Kafka documentation] for compatibility with other versions of Kafka brokers.


=== Upgrading

Before upgrading any connector, be sure to check the backward-incompatible changes that have been made since the release you were using.

When you decide to upgrade one of these connectors to 2.5.0.Beta1 from any earlier versions,
first check the migration notes for the version you're using.
Gracefully stop the running connector, remove the old plugin files, install the 2.5.0.Beta1 plugin files, and restart the connector using the same configuration.
Upon restart, the 2.5.0.Beta1 connectors will continue where the previous connector left off.
As one might expect, all change events previously written to Kafka by the old connector will not be modified.

If you are using our container images, then please do not forget to pull them fresh from https://quay.io/organization/debezium[Quay.io].


=== Breaking changes

MongoDB no longer allows doing collection snapshot on a specific shard in sharded deployment.
This was never intended and supported feature and was removed as a step in complete replica set streaming mode removal (https://issues.redhat.com/browse/DBZ-7139[DBZ-7139]).

`ComputePartition` SMT was deprecated and replaced with significantly improved `PartitionRouting` SMT.
The original SMT is now completely removed (https://issues.redhat.com/browse/DBZ-7141[DBZ-7141]).

JDBC Sink connector was storing default values in database columns when `null` value was streamed and such value existed.
This was incorrect behaviour and is now fixed (https://issues.redhat.com/browse/DBZ-7191[DBZ-7191]).



=== New features

* Support for mariadb GTID https://issues.redhat.com/browse/DBZ-1482[DBZ-1482]
* Include only certain columns in JDBC sink connector https://issues.redhat.com/browse/DBZ-6636[DBZ-6636]
* Support native RabbitMQ Streams https://issues.redhat.com/browse/DBZ-6703[DBZ-6703]
* Add support for partitioning with Azure EventHubs https://issues.redhat.com/browse/DBZ-6723[DBZ-6723]
* Enhance Notification information and more notifications for Initial Snapshots https://issues.redhat.com/browse/DBZ-6878[DBZ-6878]
* Add handling for CDB and non-CDB / PDB in Oracle REST Extension tests https://issues.redhat.com/browse/DBZ-7091[DBZ-7091]
* Check schema length when create value to find missed DDL by SQL_BIN_LOG=OFF https://issues.redhat.com/browse/DBZ-7093[DBZ-7093]
* Add service account parameter to DebeziumServer CRD https://issues.redhat.com/browse/DBZ-7111[DBZ-7111]
* Inactivity pause in MongoDB connector should be configurable https://issues.redhat.com/browse/DBZ-7146[DBZ-7146]
* Oracle Infinispan event processor speed-up using in memory cache https://issues.redhat.com/browse/DBZ-7153[DBZ-7153]
* Add last event process time, number of events, number of heartbeat events metrics to MongoDb connector https://issues.redhat.com/browse/DBZ-7162[DBZ-7162]
* LogMiner ISPN event buffer recent transaction optimization https://issues.redhat.com/browse/DBZ-7169[DBZ-7169]
* Support logical decoding from Postgres 16 stand-bys https://issues.redhat.com/browse/DBZ-7181[DBZ-7181]
* Support MySQL 8 high resolution replication timestamps from GTID events https://issues.redhat.com/browse/DBZ-7183[DBZ-7183]
* Use buffer queue when reading MongoDB change stream events https://issues.redhat.com/browse/DBZ-7184[DBZ-7184]
* Cleanup event processing loop in streaming event source of MongoDB connector https://issues.redhat.com/browse/DBZ-7186[DBZ-7186]
* Oracle Infinispan - implement support for abandoned transactions https://issues.redhat.com/browse/DBZ-7192[DBZ-7192]
* Add ability to avoid throwing an exception for missing additional fields https://issues.redhat.com/browse/DBZ-7197[DBZ-7197]
* XStream attach should be retriable https://issues.redhat.com/browse/DBZ-7207[DBZ-7207]


=== Fixes

* Test Avro adjustment for MongoDb connector and ExtractNewDocumentState SMT https://issues.redhat.com/browse/DBZ-6809[DBZ-6809]
* The DefaultDeleteHandlingStrategy couldn't add the rewrite "__deleted" field to a non-struct value https://issues.redhat.com/browse/DBZ-7066[DBZ-7066]
* Debezium server has no default for offset.flush.interval.ms https://issues.redhat.com/browse/DBZ-7099[DBZ-7099]
* Failed to authenticate to the MySQL database after snapshot https://issues.redhat.com/browse/DBZ-7132[DBZ-7132]
* Failure reading CURRENT_TIMESTAMP on Informix 12.10 https://issues.redhat.com/browse/DBZ-7137[DBZ-7137]
* Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UNION) https://issues.redhat.com/browse/DBZ-7140[DBZ-7140]
* outbox.EventRouter SMT throws NullPointerException when there is a whitespace in fields.additional.placement value https://issues.redhat.com/browse/DBZ-7142[DBZ-7142]
* Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UPDATE) https://issues.redhat.com/browse/DBZ-7152[DBZ-7152]
* JsonSerialisation is unable to process changes from sharded collections with composite sharding key https://issues.redhat.com/browse/DBZ-7157[DBZ-7157]
* Log sequence check should treat each redo thread independently https://issues.redhat.com/browse/DBZ-7158[DBZ-7158]
* Fix DebeziumMySqlConnectorResource not using the new MySQL adatper structure to support different MySQL flavors https://issues.redhat.com/browse/DBZ-7179[DBZ-7179]
* Parsing MySQL indexes for JSON field fails, when casting is used with types double and float https://issues.redhat.com/browse/DBZ-7189[DBZ-7189]
* Unchanged toasted array columns are substituted with unavailable.value.placeholder, even when REPLICA IDENTITY FULL is configured. https://issues.redhat.com/browse/DBZ-7193[DBZ-7193]
* MongoDB streaming pauses for Blocking Snapshot only when there is no event https://issues.redhat.com/browse/DBZ-7206[DBZ-7206]
* NPE on AbstractInfinispanLogMinerEventProcessor.logCacheStats https://issues.redhat.com/browse/DBZ-7211[DBZ-7211]


=== Other changes

* Generate sundrio fluent builders for operator model https://issues.redhat.com/browse/DBZ-6550[DBZ-6550]
* Convert operator source into multi module project https://issues.redhat.com/browse/DBZ-6551[DBZ-6551]
* Implement "validate filters" endpoint in connector-specific Connect REST extensions https://issues.redhat.com/browse/DBZ-6762[DBZ-6762]
* Implement IT tests against Cloud Spanner emulator in main repo. https://issues.redhat.com/browse/DBZ-6906[DBZ-6906]
* Implement strategy pattern for MariaDB and MySQL differences https://issues.redhat.com/browse/DBZ-7083[DBZ-7083]
* Run MySQL CI builds in parallel https://issues.redhat.com/browse/DBZ-7135[DBZ-7135]
* Add matrix strategy to workflows https://issues.redhat.com/browse/DBZ-7154[DBZ-7154]
* Add Unit Tests for ServiceAccountDependent Class in Debezium Operator Repository https://issues.redhat.com/browse/DBZ-7155[DBZ-7155]
* Fail fast during deserialization if a value is not a CloudEvent https://issues.redhat.com/browse/DBZ-7159[DBZ-7159]
* Correctly calculate Max LSN https://issues.redhat.com/browse/DBZ-7175[DBZ-7175]
* Upgrade to Infinispan 14.0.20 https://issues.redhat.com/browse/DBZ-7187[DBZ-7187]
* Upgrade Outbox Extension to Quarkus 3.5.3 https://issues.redhat.com/browse/DBZ-7188[DBZ-7188]
* Enable ability to stream changes against Oracle 23c for LogMiner https://issues.redhat.com/browse/DBZ-7194[DBZ-7194]
* Add modify range_partitions to modify_table_partition rule in parsing PL/SQL https://issues.redhat.com/browse/DBZ-7196[DBZ-7196]
* Handle Drop Tablespace in PL/SQL https://issues.redhat.com/browse/DBZ-7208[DBZ-7208]
* Upgrade logback to 1.2.12 https://issues.redhat.com/browse/DBZ-7209[DBZ-7209]



[[release-2.5.0-alpha2]]
== *Release 2.5.0.Alpha2* _(November 10th 2023)_

Expand Down
Loading