-
Notifications
You must be signed in to change notification settings - Fork 220
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Transformer中使用上下文绑定参数 #342
Labels
enhancement
New feature or request
Milestone
Comments
baisui1981
added a commit
that referenced
this issue
Aug 3, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Aug 3, 2024
baisui1981
added a commit
that referenced
this issue
Aug 11, 2024
baisui1981
added a commit
to qlangtech/DataX
that referenced
this issue
Aug 11, 2024
baisui1981
added a commit
that referenced
this issue
Aug 11, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Aug 12, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Aug 13, 2024
baisui1981
added a commit
that referenced
this issue
Aug 13, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Aug 13, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
问题
在MySQL 同步到目标库 starrock或者doris 库中时,MySQL中采用分库策略存储海量数据,在MySQL库中有一张A表需要同步到下游Doris库中,由于A表的主键采用自增bigint为主键,导致多个分库中的表的主键汇聚到同一个doris表时,存在主键冲突的问题。
解决策略
在执行数据通道的上下文张绑定上,向下文相关参数,例如:$dbName,$tableName 可供用户选择,结合concat transformer算子将 A表Id于上线文参数连接生成新的主键替换原有Id,这样就不会有冲突了
微信:H2M1
The text was updated successfully, but these errors were encountered: