โ ๏ธ DETECTION DECAY IS REAL
Detection Maintenance & Rule Health
Static detections decay. Adversaries change tooling, log sources get modified by IT without notifying SOC, and field names shift after platform updates. Track rule health, identify broken rules, and maintain effective coverage.
312
Healthy Rules
47
Stale (>90 days)
12
Likely Broken
๐ก Industry Insight
A detection that worked 6 months ago might be silently failing today because the index structure changed. Any detection engineering framework needs to account for ongoing validation, not just initial deployment. Most SOC teams track the number of rules deployed but not which MITRE techniques remain completely unmonitored. You can have 400 rules and still have blind spots across initial access or lateral movement if everything clusters around endpoint telemetry.
๐ Rule Health Dashboard
HEALTHY
Rules Firing Correctly
312
Rules that have triggered in the last 30 days and passed validation tests.
โ 8 from last month
STALE
Stale Rules (>90 days)
47
Rules that haven't fired in 90+ days. May indicate broken logic or changed adversary TTPs.
โ Need validation
BROKEN
Likely Broken Rules
12
Rules with schema errors, missing fields, or failed test executions.
โ Fix immediately
UNTESTED
Never Validated
23
Rules deployed without purple team validation or test data.
โ Schedule testing
๐ Rules Requiring Attention
โ ๏ธ Rules with Issues (12)
| Rule Name | Status | Last Tested | Issue Type | Action |
|---|---|---|---|---|
|
Credential Dumping via LSASS Access
RULE-0042 โข T1003.001
|
Broken | 142 days ago | Field Renamed Schema v2โv3 | |
|
Suspicious PowerShell Execution
RULE-0089 โข T1059.001
|
Broken | 98 days ago | Log Source Missing | |
|
Lateral Movement via WMI
RULE-0156 โข T1047
|
Stale | 187 days ago | TargetHost โ RemoteHost | |
|
DCSync Attack Detection
RULE-0201 โข T1003.006
|
Stale | 203 days ago | Timeout Issues | |
|
Kerberoasting Attempt
RULE-0078 โข T1558.003
|
Untested | Never | No Validation |
โก Common Detection Decay Factors
Field Name Changes
Platform updates rename fields without warning. A KQL query using
TargetUserName silently fails when Sentinel renames it to TargetAccount.// Before: TargetUserName
// After: Account.Name (nested JSON)
// After: Account.Name (nested JSON)
Log Source Modifications
IT enables a new EDR agent that changes event structure, or disables a log source during "optimization" without notifying SOC.
Sysmon Config v12โv14: ProcessCreate fields changed
Adversary TTP Evolution
Attackers adapt tooling to evade known signatures. LSASS dumping moved from Mimikatz to comsvcs.dll to direct syscalls.
2020: mimikatz.exe | 2024: nanodump, MalSecLogon
Index Schema Changes
SIEM platform upgrades change index structures. Splunk CIM updates, Sentinel table migrations, Elastic index templates.
SecurityEvent โ WindowsEvent (Sentinel 2024)
Performance Degradation
Rule worked when log volume was 10GB/day. Now at 100GB/day, it times out or gets deprioritized by the query scheduler.
Query timeout: 30s exceeded | Skipped 47 times
Broken Enrichments
Rule relies on threat intel feed or lookup table that expired, changed format, or was deprecated.
TI feed subscription expired 2024-01-15
โ
Detection Maintenance Checklist
๐ Ongoing Validation Activities
Weekly: Rule Firing Audit
Query SIEM for rules that haven't fired in 7+ days. Cross-reference against expected baseline alerts. Flag silent rules for investigation.
Monthly: Purple Team Validation
Execute atomic red team tests for critical detection rules. Validate that alerts fire with correct severity and context. Document any gaps.
Monthly: Log Source Inventory
Confirm all expected log sources are ingesting. Check for volume anomalies (sudden drops may indicate broken collection). Verify retention policies.
Quarterly: Schema Change Review
Review platform release notes for field changes. Update rules affected by CIM/schema migrations. Test after any SIEM upgrade.
Quarterly: Coverage Gap Analysis
Map rules to MITRE ATT&CK. Identify tactics with <40% coverage. Prioritize gaps based on threat landscape (especially initial access, lateral movement).
Post-Incident: Rule Effectiveness Review
After every real incident: Did the rule fire? If not, why? Was it a gap, a broken rule, or an evasion? Update rules based on lessons learned.
Continuous: Change Management Integration
Integrate with IT change management. Get notified when: EDR agents updated, log configs changed, new apps deployed, network segments modified.
๐ Quick Actions
Coverage Matrix
Visualize MITRE ATT&CK coverage and identify blind spots across tactics.
Query Translator
Convert rules between SPL, KQL, and Sigma to port to new platforms.
Use Case Library
Browse 226 detection use cases with ready-to-use queries.
Sigma Rules
Community Sigma rules that work across all SIEM platforms.