Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CTI 1.11 Addendum #1502

Merged
merged 7 commits into from
Jul 6, 2021
Merged

CTI 1.11 Addendum #1502

merged 7 commits into from
Jul 6, 2021

Conversation

rylnd
Copy link
Contributor

@rylnd rylnd commented Jul 1, 2021

@ebeahan I think this is ready for review, just a few questions:

  1. How/where should the RFC docs be updated to reflect these changes (for posterity, not the definitions themselves)
  2. A critical omission from the enrichments RFC is that the indicator fields are not present under threat.enrichments! How do I go about defining threat.enrichments.indicator.* as coming from threat.indicator.* ?

rylnd added 4 commits July 1, 2021 13:26
* Subfields (as.*, geo.*) pertaining to indicators are removed from
  `threat.enrichments`; they will live under `threat.indicator` instead
* `threat.enrichments` is now just a nested list of `indicator` and
  `matched` subfields

While requiring a few more mappings, this greatly simplifies the logic
and complexity of enrichment itself.
The notable absence here is the `event.*` fieldset, whose purpose will
momentarily be replaced by `indicator.reference` and
`indicator.provider`.
Since we no longer copy event.* during enrichment, these fields need to
live under threat.indicator if we want them in an enrichment (which we
do).
threat.indicator.dataset and threat.indicator.module are not specified
in this RFC. This data should already exist on the indicator document as
event.dataset and event.module. As they are not needed for the purposes of
enrichment, they do not need to be present under threat.indicator.
@rylnd rylnd added the 1.11.0 label Jul 1, 2021
@rylnd rylnd self-assigned this Jul 1, 2021
@ebeahan ebeahan added the RFC label Jul 1, 2021
rylnd added 2 commits July 1, 2021 16:38
The current ECS tooling does not allow us to do the following:

    - name: threat.indicator
      reusable:
        expected:
          - at: threat.enrichments
            as: indicator

to convey the fact that threat.enrichments.indicator is the
threat.indicator fields nested under threat.enrichments.indicator.

Instead, we need to:

1. define the reused fields twice, under threat.indicator AND
   threat.enrichments.indicator (this commit)
2. Copy the new threat.indicator.* fields as new
   threat.enrichments.indicator.* fields (next commit)
The current ECS tooling does not allow us to do the following:

    - name: threat.indicator
      reusable:
        expected:
          - at: threat.enrichments
            as: indicator

to convey the fact that threat.enrichments.indicator is the
threat.indicator fields nested under threat.enrichments.indicator.

Instead, we need to:

1. define the reused fields twice, under threat.indicator AND
   threat.enrichments.indicator (last commit)
2. Copy the new threat.indicator.* fields as new
   threat.enrichments.indicator.* fields (this commit)
@rylnd rylnd requested a review from devonakerr July 1, 2021 23:02
@ebeahan ebeahan self-requested a review July 6, 2021 16:22
Copy link
Member

@ebeahan ebeahan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Thanks, @rylnd @peasead!

Copy link

@devonakerr devonakerr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apologies for the delay in reviewing, LGTM.

@ebeahan ebeahan removed the 1.11.0 label Jul 6, 2021
@ebeahan ebeahan merged commit abe5f94 into elastic:master Jul 6, 2021
@rylnd rylnd deleted the cti_addendum branch July 7, 2021 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants