Commits

Commits on May 9, 2023

[hotfix][refactor] Reuse existing method in SortMergeResultPartition
wsry
committedMay 9, 2023

Commits on Mar 11, 2023

[FLINK-31386][network] Fix the potential deadlock issue of blocking shuffle
wsry
committedMar 11, 2023

Commits on Sep 15, 2022

[FLINK-29299][network] Fix the network memory size calculation issue in fine-grained resource mode
wsry
committedSep 15, 2022

Commits on Aug 9, 2022

[FLINK-28380][runtime] Produce one intermediate dataset for multiple consumer job vertices consuming the same data
wsry
committedAug 9, 2022

Commits on Aug 8, 2022

Commits on Aug 4, 2022

Revert "[FLINK-28373][network] Read a full buffer of data per file IO read request for sort-shuffle"
wsry
committedAug 4, 2022

Commits on Feb 15, 2022

[FLINK-25640][docs] Enhance the document for blocking shuffle

wsry
authored and
gaoyunhaii
committedFeb 15, 2022

Commits on Feb 12, 2022

[FLINK-25796][network] Avoid record copy for result partition of sort-shuffle if there are enough buffers for better performance
wsry
committedFeb 12, 2022

Commits on Feb 9, 2022

[FLINK-25960][network] Distribute the data read buffers more fairly among result partitions for sort-shuffle

wsry
authored and
gaoyunhaii
committedFeb 9, 2022

Commits on Jan 27, 2022

Commits on Jan 18, 2022

Commits on Jan 13, 2022

[FLINK-25407][network] Fix the issues caused by FLINK-24035

wsry
authored and
pnowojski
committedJan 13, 2022
[hotfix] Rename some methods of NetworkBufferPool and add more comments for better readability

wsry
authored and
pnowojski
committedJan 13, 2022

Commits on Sep 1, 2021

[FLINK-24035][network][refactor] Move the blocking allocation of one floating buffer logic from the constructor of LocalBufferPool to SingleInputGate#setupChannels()

wsry
authored and
pnowojski
committedSep 1, 2021

Commits on Aug 31, 2021

[FLINK-24035][network] Guarantee that the LocalBufferPool is initialized with one buffer

wsry
authored and
pnowojski
committedAug 31, 2021

Commits on Aug 30, 2021

[hotfix][refactor] Remove BufferListener#NotificationResult to simplify the code

wsry
authored and
pnowojski
committedAug 30, 2021
[FLINK-23466][network] Fix the bug that buffer listeners may not be notified when recycling buffers

wsry
authored and
pnowojski
committedAug 30, 2021
[hotfix] Print the test parameters for UnalignedCheckpointTestBase to help debugging when the case is stuck

wsry
authored and
pnowojski
committedAug 30, 2021

Commits on Aug 20, 2021

[FLINK-23724][network] Fix the network buffer leak when ResultPartition is released (apache#16844 )
wsry
committedAug 20, 2021

Commits on Aug 5, 2021

[FLINK-22675][runtime] Add lifecycle methods to ShuffleMaster

wsry
authored and
zhuzhurk
committedAug 5, 2021
[FLINK-23249][runtime] Introduce ShuffleMasterContext to ShuffleMaster

wsry
authored and
zhuzhurk
committedAug 5, 2021
[FLINK-22674][runtime] Provide JobID when applying for shuffle resources by ShuffleMaster#registerPartitionWithProducer

wsry
authored and
zhuzhurk
committedAug 5, 2021
[FLINK-23214][runtime] Make ShuffleMaster a cluster level shared service

wsry
authored and
zhuzhurk
committedAug 5, 2021

Commits on Jul 12, 2021

[FLINK-16641][network] (Part#6) Enable to set network buffers per channel to 0

wsry
authored and
pnowojski
committedJul 12, 2021
[FLINK-16641][network] (Part#5) Send empty buffers to the downstream tasks to release the allocated credits if the exclusive credit is 0

wsry
authored and
pnowojski
committedJul 12, 2021
[FLINK-16641][network] (Part#4) Release all allocated floating buffers of RemoteInputChannel on receiving any channel blocking event if the exclusive credit is 0

wsry
authored and
pnowojski
committedJul 12, 2021
[FLINK-16641][network] (Part#3) Support to announce the upstream backlog to the downstream tasks

wsry
authored and
pnowojski
committedJul 12, 2021
[FLINK-16641][network] (Part#2) Distinguish data buffer and event buffer for BoundedBlockingSubpartitionDirectTransferReader

wsry
authored and
pnowojski
committedJul 12, 2021
[FLINK-16641][network] (Part#1) Introduce a new network message BacklogAnnouncement which can bring the upstream buffer backlog to the downstream

wsry
authored and
pnowojski
committedJul 12, 2021