Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [dinky1.2.0] Oracle synchronization data query to paimon Lake reported an error #4075

Open
2 of 3 tasks
lexoning opened this issue Dec 20, 2024 · 3 comments · Fixed by #4152
Open
2 of 3 tasks
Labels
Bug Something isn't working

Comments

@lexoning
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Snipaste_2024-12-20_14-47-04 Snipaste_2024-12-20_14-45-55 Oracle synchronization data query to paimon Lake reported an error

What you expected to happen

Oracle sync data to Lake paimon can be queried

How to reproduce

flinkcdc3.1, flink17, paimon0.9 synchronize Oracle data to paimon data lake, but data cannot be queried using dinky

Anything else

oracle ddl :CREATE TABLE "READ_BG"."AOP_PERFORMANCE_TEST"
( "ID" NUMBER(9,0) NOT NULL ENABLE,
"YEAR_D" NUMBER(4,0),
"BG" VARCHAR2(100),
"CENTER" VARCHAR2(100),
"ONE_DEPARTMENT" VARCHAR2(100),
"DEPARTMENT" VARCHAR2(100),
"COST_CENTER" VARCHAR2(100),
"USER_NAME" VARCHAR2(100),
"USER_CODE" VARCHAR2(100),
"USER_TYPE" NUMBER(1,0),
"IS_CLOSE" NUMBER(1,0),
"CREATE_USER" NUMBER(5,0),
"UPDATE_USER" NUMBER(5,0),
"CREATE_DATE" DATE,
"UPDATE_DATE" DATE,
"CREATE_USER_NAME" VARCHAR2(20),
PRIMARY KEY ("ID")
USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255
STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1
BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
TABLESPACE "CUX_DATA" ENABLE,
SUPPLEMENTAL LOG DATA (ALL) COLUMNS
)

Version

1.2.0

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@lexoning lexoning added Bug Something isn't working Waiting for reply Waiting for reply labels Dec 20, 2024
@lexoning lexoning changed the title [Bug] [Module Name] Bug title [Bug] [dinky1.2.0] Oracle synchronization data query to paimon Lake reported an error Dec 20, 2024
@medivh511
Copy link

medivh511 commented Dec 30, 2024

建议使用dbz的cdc方式到kafka, 再使用paimon cdc的方式到paimon, oracle cdc的方式在flink cdc是非常不全面和不稳定的,这和oracle的一些特殊性有关,要么用最新版本的dbz,要么使用收费的ogg.
dinky不会在oracle上面有太多的改动,以前尝试过,但都不理想,针对oracle cdc,dinky有专门的微信oracle cdc群,基本上做oracle cdc都不会采用dinky的固有方式,dinky这边负责cdc的人也建议尽量不采用dinky oracle cdc的方式,因为flink cdc问题太多

@lexoning
Copy link
Author

lexoning commented Jan 9, 2025

dbz cdc的方式怎么使用的呢,有没具体文档哈,还有就是我实时更新的数据能体现在湖里吗

@medivh511
Copy link

medivh511 commented Jan 10, 2025

dbz cdc的方式怎么使用的呢,有没具体文档哈,还有就是我实时更新的数据能体现在湖里吗

你可以让文末加你进Oracle CDC群

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working
Projects
None yet
3 participants