Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support local transaction on Sharding-Proxy #1238

Closed
terrymanu opened this issue Sep 6, 2018 · 3 comments
Closed

Support local transaction on Sharding-Proxy #1238

terrymanu opened this issue Sep 6, 2018 · 3 comments
Labels
type: new feature
Milestone
3.1.0.M1

Comments

@terrymanu
Copy link
Member

No description provided.

@terrymanu terrymanu mentioned this issue Sep 6, 2018
Closed
6 tasks
@cherrylzhao
Copy link
Member

currently sharding-proxy have integrated with XA, and our local transaction is quite same with XA.
both of them need to hold the routed sharing connection untill commit command is triggered.
and performance improvement for local transaction is limit, so we decide to close this issue.

@terrymanu terrymanu reopened this Nov 6, 2018
@cherrylzhao
Copy link
Member

consider about refactor sharing-proxy, making local transaction connection binding with specified channel, in order to get all associate connections in commit phase.

@cherrylzhao
Copy link
Member

cherrylzhao commented Nov 15, 2018 •
edited
Loading

  • refactor backendConnection
    • add LocalTransaction manager
    • split getConnection by transaction
    • make channel handle request one by one for none-transaction mode
    • make schema binding with backend connection
    • make connection id binding with backend connection
  • refactor proxy transaction model
    • add BackendTransactionManager to handle transaction by type
    • refactor ComQueryPacket
  • optimize performance and tolerance.
    • make connection automatically close when partition error happened.
    • resolve get connections dead lock for routing multi shards.
  • add datasource map switch feature
  • add setTransaType by SQL within proxy
    • refactor backendHandlerFactory
    • introduce sctl:set transaction_type=XX for proxy

terrymanu added a commit that referenced this issue Nov 23, 2018
@terrymanu
Merge pull request #1507 from cherrylzhao/dev-new
ec67a02 
#1238 Support Proxy local transaction
terrymanu added a commit that referenced this issue Nov 24, 2018
@terrymanu
Merge pull request #1510 from cherrylzhao/dev-new
e36c977 
#1238 Release connection while channel have not transaction.
terrymanu added a commit that referenced this issue Nov 24, 2018
@terrymanu
revise for #1238
2f26c89
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Change cachedConnections to HashMultimap
2e95d21
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add init BackendConnectionTest.
453c79e
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add cached layer while getConnections.
850d806
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add init case for BackendConnectionTest
7967d80
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add Mock object for BackendConnectionTest.
f67d676
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Fill BackendConnectionTest.assertGetConnectionCacheIsEmpty.
1e0be82
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Fill BackendConnectionTest.assertGetConnectionSizeLessTha…
7018c26 
…nCache.
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Fill BackendConnectionTest.assertGetConnectionSizeGreater…
ca16638 
…ThanCache.
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Remove assertGetConnectionSizeIsOne, should verify in Bac…
514efe5 
…kendDataSourceTest.
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Fill BackendConnectionTest.assertMultiThreadGetConnection.
a331666
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Refactor assertMultiThreadGetConnection.
fc6a263
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Make BackendConnection initialize when ChannelHandler was…
f5b6c9b 
… build.
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 CommandExecutor get backendConnection from channel handler.
56d8bb9
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revise BackendTransactionManagerTest.
5c88374
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add assertGetConnectionWithMethodInvocation.
4b00a06
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Rename assertAutoCloseConnection => assertAutoCloseConnec…
7d44502 
…tionWithException.
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add MockThrowException in assertAutoCloseConnectionWithEx…
edaa3c5 
…ception
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add BackendConnectionTest.assertAutoCloseConnection
839753b
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revise assertAutoCloseConnectionWithException.
e73ceb3
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revise assertAutoCloseConnectionWithException.
4be643b
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 for checkstyle.
e4fa2a4
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Open transaction type config.
cd1a99f
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revise test error.
245026c
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revise transaction config in server.yaml
f57f668
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Release connection when create a new transaction.
a4d92b5
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Force rollback connection while do Close
0aae7c1
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add foreClose flag
ee75b2e
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Add forceRollback flag.
5d84739
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revise releaseConnections.
42136e3
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 for checkstyle.
0251643
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Make cachedConnections ascend order.
7b0607b
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Revert config file.
c8a1392
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@cherrylzhao @maxiaoguang64
apache#1238 Release connection while channel have not transaction.
80885be
maxiaoguang64 pushed a commit to maxiaoguang64/incubator-shardingsphere that referenced this issue Nov 25, 2018
@terrymanu @maxiaoguang64
revise for apache#1238
1cee5ea
terrymanu added a commit that referenced this issue Nov 26, 2018
@terrymanu
Merge pull request #1516 from cherrylzhao/dev-new
69240ff 
for #1238 optimize backendConnection for OLAP performance.
terrymanu added a commit that referenced this issue Nov 28, 2018
@terrymanu
Merge pull request #1530 from cherrylzhao/dev-new
0055795 
for #1238 optimize proxy backendConnection
terrymanu added a commit that referenced this issue Dec 1, 2018
@terrymanu
Merge pull request #1539 from cherrylzhao/dev
b0cb371 
for #1238 Refactor transaction type and schema switch logic.
terrymanu added a commit that referenced this issue Dec 3, 2018
@terrymanu
Merge pull request #1540 from cherrylzhao/dev
b2bd30c 
for #1238 Make connectionId binding with backendConnection
terrymanu added a commit that referenced this issue Dec 8, 2018
@terrymanu
Merge pull request #1586 from cherrylzhao/dev
af8c7bd 
for #1238 Add transaction type switch feature & SCTL for Proxy
terrymanu added a commit that referenced this issue Dec 12, 2018
@terrymanu
Merge pull request #1604 from cherrylzhao/dev
64a39a0 
for #1363 and #1238 Resolve performance test problem.
@terrymanu terrymanu added this to the 3.1.0.M1 milestone Dec 13, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type: new feature
Projects
None yet
Milestone
3.1.0.M1
Development

No branches or pull requests
2 participants
@terrymanu @cherrylzhao