Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IncrementalWebSession processor should bulk webevents in a monthly index #534

Open
jerome73 opened this issue Feb 11, 2020 · 0 comments
Open

Comments

@jerome73
Copy link
Contributor

Expected behavior and actual behavior.

The IncrementalWebSession processor should putbulk webevents in the ES index suffixed by the month ('yyyy.MM') instead of the day date ('yyyy.MM.dd') of the h2ktimestamp.
Therefore it could target one or a set of months depending on the h2ktimestamp of the collection of records processed.

Problem:
Today the IncrementalWebSession processor putbulks webevents in an ES index suffixed by the day date 'yyyy.MM.dd'. Pb may be in case of a rewind, happening at the beginning of a month it is possible to regenerate indexes (using day date) over the last month period of time.

Steps to reproduce the problem.

Specifications like the version of the project, operating system, or hardware.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant