Skip to content
/ EDR-Telemetry Public
forked from tsale/EDR-Telemetry

This project aims to compare and evaluate the telemetry of various EDR products.

0 stars 158 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

j91321/EDR-Telemetry

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

69 Commits
.github
.github
 
 
Tools
Tools
 
 
.gitignore
.gitignore
 
 
EDR_telem.json
EDR_telem.json
 
 
README.md
README.md
 
 

Repository files navigation

EDR Telemetry

This repo provides a list of telemetry features from EDR products and other endpoint agents such as Sysmon broken down by category. The main motivation behind this project is to enable security practitioners to compare and evaluate the telemetry potential from those tools while encouraging EDR vendors to be more transparent about the telemetry features they do provide to their users and customers.

Besides compliance, investigations and forensics benefits, rich log telemetry empowers cyber defense teams to develop custom hunting, detection and analytics capabilities tailored to their needs.

Read details about this project in the initial release blog post here.

Telemetry Definition

There are many types of telemetry when it comes to Security Instrumentation. Here we focus on agents or sensors generating telemetry in the form of log data, regardless of the format (json, key-value, csv), as long as the data is automatically generated and transmitted or streamed in near real-time.

FAQ & Contributions

Please check our FAQ page to know more and feel free to get in contact in case you cannot find an answer there.

In case you ware willing to contribute, please check the Contributions page.

Disclaimer
The telemetry of the EDR products below could improve with time. The last_updated field is the last time the data sources have been updated. This might NOT always be up to date with the current telemetry capabilities of each product.

Telemetry Comparison Table

Disclaimer
The data below do not represent the capability of each of the EDR products to detect or prevent a threat. This is ONLY a comparison regarding the available telemetry for each product. Some products, such as Elastic EDR, make additional telemetry available in free or paid modules. Add-on modules, as well as signals, will not be taken into consideration for this project. Please read more about this on our FAQ page here.

EDR Evaluation and Scoring Script

This script evaluates and scores Endpoint Detection and Response (EDR) Solutions based on their capabilities. It reads data from the main JSON file (EDR_telem.json), which contains information about various EDRs and their features. The script then calculates a score for each EDR based on the presence and absence of certain features, as well as the category of the feature.

Scoring Logic

  • Each feature and category is assigned a weight.
  • The weights represent the importance of the feature or category. For example, a feature with a weight of 1 is considered more important than a feature with a weight of 0.5.
  • The compare.py script multiplies the weight of each feature by the weight of its category, adding this product to the EDR's total score.
  • If a feature is absent, its weight is considered 0.

This scoring algorithm allows us to quantitatively compare different EDRs based on their capabilities. The higher the score, the more capable the EDR is. The weights can be adjusted as needed to reflect changes in the importance of different features or categories.

For more details, you can refer to the Pull Request #61.

EDR Scores

No. EDRS Score
1 CrowdStrike 37.45
2 MDE 34.8
3 Harfanglab 32.22
4 Cortex XDR 31.42
5 LimaCharlie 31.2
6 Trellix 30.6
7 Elastic 28.02
8 ESET Inspect 26.4
9 Sentinel One 25.9
10 Cybereason 25.65
11 Symantec SES Complete 24.3
12 Sysmon 23.2
13 WatchGuard 20.9
14 Carbon Black 20.37
15 Trend Micro 20.3
16 Qualys 13.5

EDR Telemetry Table

Below is information about the EDR table, including all values for each EDR and a description for each attribute.

CSV Values JSON Values Description
✅ Yes Implemented
❌ No Not Implemented
⚠️ Partially Partially Implemented
❓ Pending Pending Response
🪵 Via EventLogs Via Windows EventLogs
🎚️ Via EnablingTelemetry Additional telemetry that can be enabled easily as part of the EDR product but is not on by default.

Last Updated: Monday June 03 2024
Google SpreadSheet Table: Link
References to Documentation for each EDR product: Link

Telemetry Feature Category Sub-Category Carbon Black Cortex XDR CrowdStrike Cybereason ESET Inspect Elastic Harfanglab LimaCharlie MDE Qualys Sentinel One Symantec SES Complete Sysmon Trellix Trend Micro WatchGuard
Process Activity Process Creation ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
**** Process Termination ⚠️ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❌ ✅ ✅ ❌ 🎚️ ❌
**** Process Access ✅ ✅ ✅ ✅ ⚠️ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌
**** Image/Library Loaded ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
**** Remote Thread Creation ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ❌ ✅ ✅ ✅ ✅
**** Process Tampering Activity ⚠️ ⚠️ ✅ ❓ ❌ ✅ ✅ ✅ ✅ ❌ ⚠️ ✅ ✅ ✅ ✅ ❌
File Manipulation File Creation ✅ ✅ ✅ ✅ ⚠️ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ⚠️
**** File Opened ✅ ❌ ⚠️ ❌ ❌ ✅ ✅ ⚠️ ❌ ❌ ❌ ✅ ❌ ✅ ⚠️ ⚠️
**** File Deletion ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ❌
**** File Modification ✅ ✅ ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ❌ ✅ ✅ ❌
**** File Renaming ✅ ✅ ✅ ✅ ✅ ✅ ✅ ⚠️ ✅ ✅ ✅ ✅ ❌ ✅ ❌ ⚠️
User Account Activity Local Account Creation ❌ 🪵 ✅ ❌ ✅ 🪵 🪵 🪵 ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌
**** Local Account Modification ❌ 🪵 ⚠️ ❌ ✅ 🪵 🪵 🪵 ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌
**** Local Account Deletion ❌ 🪵 ✅ ❌ ✅ 🪵 🪵 🪵 ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌
**** Account Login 🪵 ✅ ✅ ✅ ✅ ✅ ✅ ⚠️ ✅ ❌ ✅ ✅ ❌ ✅ 🪵 ✅
**** Account Logoff 🪵 ✅ ✅ ✅ ✅ ✅ ✅ 🪵 ❌ ❌ ❌ ✅ ❌ ✅ 🪵 ✅
Network Activity TCP Connection ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🎚️ ✅ ✅ ✅ ✅
**** UDP Connection ✅ ✅ ✅ ✅ ❌ ✅ 🪵 ✅ ✅ ✅ ❌ 🎚️ ✅ ✅ ✅ ✅
**** URL ❌ ❌ ✅ ❌ ✅ ⚠️ ✅ ⚠️ ✅ ✅ 🎚️ ⚠️ ❌ ✅ ❌ ⚠️
**** DNS Query ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ❌ ✅ ✅ ✅ ✅
**** File Downloaded ❌ ❌ ✅ ⚠️ ⚠️ ❌ ❌ ⚠️ ✅ ❌ ❌ ❌ ❌ ❌ ✅ ✅
Hash Algorithms MD5 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
**** SHA ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌
**** IMPHASH ❌ ❌ ❌ ❌ ❌ ⚠️ ✅ ❌ ❌ ❌ ❌ ❌ ✅ ❌ ❌ ❌
Registry Activity Key/Value Creation ✅ ✅ ⚠️ ⚠️ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
**** Key/Value Modification ✅ ✅ ⚠️ ⚠️ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ✅ ✅ ✅
**** Key/Value Deletion ✅ ✅ ❌ ⚠️ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Schedule Task Activity Scheduled Task Creation ❌ 🪵 ✅ ✅ ❌ 🪵 🪵 🪵 ✅ ❌ ✅ ❌ ❌ ❌ 🪵 ❌
**** Scheduled Task Modification ❌ 🪵 ✅ ✅ ❌ 🪵 🪵 🪵 ✅ ❌ ✅ ❌ ❌ ✅ ❌ ❌
**** Scheduled Task Deletion ❌ 🪵 ✅ ❌ ❌ 🪵 🪵 🪵 ✅ ❌ ✅ ❌ ❌ ❌ ❌ ❌
Service Activity Service Creation ⚠️ 🪵 ✅ ✅ ❌ 🪵 🪵 ✅ 🪵 ❌ ❌ ❌ ❌ ❌ ❌ ⚠️
**** Service Modification ❌ 🪵 ⚠️ ❌ ❌ 🪵 🪵 ✅ ❌ ❌ ❌ ❌ ❌ ✅ ❌ ⚠️
**** Service Deletion ❌ ❌ ❌ ❌ ❌ 🪵 ❌ ❓ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌
Driver/Module Activity Driver Loaded ❌ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ❌ ✅ ❌ ❌ ❌
**** Driver Modification ❌ ❌ ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌
**** Driver Unloaded ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌
Device Operations Virtual Disk Mount ❌ ⚠️ ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ✅
**** USB Device Unmount ❌ ⚠️ ✅ ✅ ❌ ❌ ❌ ⚠️ ✅ ❌ ❌ 🎚️ ❌ ❌ ❌ ✅
**** USB Device Mount ⚠️ ⚠️ ✅ ✅ ❌ ❌ ❌ ⚠️ ✅ ❌ 🎚️ 🎚️ ❌ ❌ ❌ ✅
Other Relevant Events Group Policy Modification ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ✅ ❌ ❌ ❌ ❌ ❌ ❌ ❌
Named Pipe Activity Pipe Creation ⚠️ ❌ ✅ ❌ ✅ ❌ ✅ ✅ ✅ ❌ 🎚️ ❌ ✅ ❌ ❌ ❌
**** Pipe Connection ❌ ❌ ✅ ❌ ❌ ❌ ✅ ✅ ✅ ❌ 🎚️ ❌ ✅ ✅ ❌ ❌
EDR SysOps Agent Start ❌ ⚠️ ✅ ✅ ❌ ❌ ✅ ✅ 🪵 ✅ ✅ 🎚️ ✅ ❓ ❌ ❌
**** Agent Stop ❌ ✅ ✅ ✅ ❌ ✅ ✅ ✅ 🪵 ✅ ✅ 🎚️ ✅ ❓ ❌ ❌
**** Agent Install ❌ ✅ ❌ ✅ ✅ ❌ ✅ ✅ 🪵 ✅ ✅ 🎚️ ❌ ✅ ❌ ✅
**** Agent Uninstall ❌ ✅ ✅ ✅ ✅ ✅ ❌ ❌ ❌ ❌ ✅ 🎚️ ❌ ✅ ❌ ✅
**** Agent Keep-Alive ❌ ✅ ✅ ✅ ✅ ❌ ✅ ✅ 🪵 ✅ ✅ 🎚️ ❌ ❓ ❌ ❌
**** Agent Errors ❌ ✅ ✅ ❌ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🎚️ ✅ ❓ ❌ ❌
WMI Activity WmiEventConsumerToFilter ❌ 🎚️ ✅ ✅ ✅ ❌ ✅ ❌ ✅ ❌ ❌ ⚠️ ✅ ✅ 🪵 ✅
**** WmiEventConsumer ❌ 🎚️ ✅ ✅ ✅ ❌ ✅ ❌ ✅ ❌ ❌ ⚠️ ✅ ✅ 🪵 ✅
**** WmiEventFilter ❌ 🎚️ ✅ ✅ ✅ ❌ ✅ ❌ ✅ ❌ ❌ ⚠️ ✅ ✅ 🪵 ✅
BIT JOBS Activity BIT JOBS Activity ❌ 🎚️ ✅ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ❌ ✅ ❌ ❌
PowerShell Activity Script-Block Activity ✅ 🪵 ✅ ❌ ✅ ❌ ✅ 🪵 ✅ ❌ ✅ ✅ ❌ ✅ ❌ ❌

Current Primary Maintainers

Kostas - @kostastsale

About

This project aims to compare and evaluate the telemetry of various EDR products.

Resources

Readme
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Python 54.9%
  • PowerShell 45.1%