Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix-6273] Flush the potential duplicated message when add messages to a batch. #6326

Merged
merged 1 commit into from
Feb 14, 2020

Conversation

codelipenghui
Copy link
Contributor

Fixes #6273

Motivation

The main reason for #6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.

Modifications

Describe the modifications you've done.

Verifying this change

Improve the exists unit test to cover the change.

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API: (no)
  • The schema: (no)
  • The default values of configurations: (no)
  • The wire protocol: (no)
  • The rest endpoints: (no)
  • The admin cli options: (no)
  • Anything that affects deployment: (no)

Documentation

  • Does this pull request introduce a new feature? (no)

…ial duplicated messages and non-duplicated messages into a batch.
@codelipenghui codelipenghui added type/bug The PR fixed a bug or issue reported a bug area/client release/2.5.1 labels Feb 14, 2020
@codelipenghui codelipenghui added this to the 2.6.0 milestone Feb 14, 2020
@codelipenghui codelipenghui self-assigned this Feb 14, 2020
@codelipenghui codelipenghui merged commit b898f49 into apache:master Feb 14, 2020
@codelipenghui codelipenghui deleted the issue-6273 branch February 14, 2020 08:06
tuteng pushed a commit to AmateurEvents/pulsar that referenced this pull request Feb 23, 2020
…ial duplicated messages and non-duplicated messages into a batch. (apache#6326)

Fixes apache#6273

Motivation
The main reason for apache#6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.
tuteng pushed a commit to AmateurEvents/pulsar that referenced this pull request Mar 21, 2020
…ial duplicated messages and non-duplicated messages into a batch. (apache#6326)

Fixes apache#6273

Motivation
The main reason for apache#6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.

(cherry picked from commit b898f49)
tuteng pushed a commit that referenced this pull request Apr 6, 2020
…ial duplicated messages and non-duplicated messages into a batch. (#6326)

Fixes #6273

Motivation
The main reason for #6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.

(cherry picked from commit b898f49)
tuteng pushed a commit that referenced this pull request Apr 13, 2020
…ial duplicated messages and non-duplicated messages into a batch. (#6326)

Fixes #6273

Motivation
The main reason for #6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.

(cherry picked from commit b898f49)
jiazhai pushed a commit to jiazhai/pulsar that referenced this pull request May 18, 2020
…ial duplicated messages and non-duplicated messages into a batch. (apache#6326)

Fixes apache#6273

Motivation
The main reason for apache#6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.
(cherry picked from commit b898f49)
huangdx0726 pushed a commit to huangdx0726/pulsar that referenced this pull request Aug 24, 2020
…ial duplicated messages and non-duplicated messages into a batch. (apache#6326)

Fixes apache#6273

Motivation
The main reason for apache#6273 is combining potential duplicated messages and non-duplicated messages into a batch. So need to flush the potential duplicated message first and then add the non-duplicated messages to a batch.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/client release/2.5.1 type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Deduplication fails when the batch message contains duplicate message and valid message
3 participants