โ† Back to SIEM
โš ๏ธ DETECTION DECAY IS REAL

Detection Maintenance & Rule Health

Static detections decay. Adversaries change tooling, log sources get modified by IT without notifying SOC, and field names shift after platform updates. Track rule health, identify broken rules, and maintain effective coverage.

312
Healthy Rules
47
Stale (>90 days)
12
Likely Broken
๐Ÿ’ก Industry Insight
A detection that worked 6 months ago might be silently failing today because the index structure changed. Any detection engineering framework needs to account for ongoing validation, not just initial deployment. Most SOC teams track the number of rules deployed but not which MITRE techniques remain completely unmonitored. You can have 400 rules and still have blind spots across initial access or lateral movement if everything clusters around endpoint telemetry.
๐Ÿ“Š Rule Health Dashboard
โœ… HEALTHY
Rules Firing Correctly
312
Rules that have triggered in the last 30 days and passed validation tests.
โ†‘ 8 from last month
โฐ STALE
Stale Rules (>90 days)
47
Rules that haven't fired in 90+ days. May indicate broken logic or changed adversary TTPs.
โ†“ Need validation
๐Ÿšจ BROKEN
Likely Broken Rules
12
Rules with schema errors, missing fields, or failed test executions.
โ†“ Fix immediately
๐Ÿงช UNTESTED
Never Validated
23
Rules deployed without purple team validation or test data.
โ†’ Schedule testing
๐Ÿ” Rules Requiring Attention
โš ๏ธ Rules with Issues (12)
Rule Name Status Last Tested Issue Type Action
Credential Dumping via LSASS Access
RULE-0042 โ€ข T1003.001
Broken 142 days ago Field Renamed Schema v2โ†’v3
Suspicious PowerShell Execution
RULE-0089 โ€ข T1059.001
Broken 98 days ago Log Source Missing
Lateral Movement via WMI
RULE-0156 โ€ข T1047
Stale 187 days ago TargetHost โ†’ RemoteHost
DCSync Attack Detection
RULE-0201 โ€ข T1003.006
Stale 203 days ago Timeout Issues
Kerberoasting Attempt
RULE-0078 โ€ข T1558.003
Untested Never No Validation
โšก Common Detection Decay Factors
๐Ÿ“ Field Name Changes
Platform updates rename fields without warning. A KQL query using TargetUserName silently fails when Sentinel renames it to TargetAccount.
// Before: TargetUserName
// After: Account.Name (nested JSON)
๐Ÿ”„ Log Source Modifications
IT enables a new EDR agent that changes event structure, or disables a log source during "optimization" without notifying SOC.
Sysmon Config v12โ†’v14: ProcessCreate fields changed
๐ŸŽญ Adversary TTP Evolution
Attackers adapt tooling to evade known signatures. LSASS dumping moved from Mimikatz to comsvcs.dll to direct syscalls.
2020: mimikatz.exe | 2024: nanodump, MalSecLogon
๐Ÿ“Š Index Schema Changes
SIEM platform upgrades change index structures. Splunk CIM updates, Sentinel table migrations, Elastic index templates.
SecurityEvent โ†’ WindowsEvent (Sentinel 2024)
โฑ๏ธ Performance Degradation
Rule worked when log volume was 10GB/day. Now at 100GB/day, it times out or gets deprioritized by the query scheduler.
Query timeout: 30s exceeded | Skipped 47 times
๐Ÿ”— Broken Enrichments
Rule relies on threat intel feed or lookup table that expired, changed format, or was deprecated.
TI feed subscription expired 2024-01-15
โœ… Detection Maintenance Checklist
๐Ÿ”„ Ongoing Validation Activities
Weekly: Rule Firing Audit
Query SIEM for rules that haven't fired in 7+ days. Cross-reference against expected baseline alerts. Flag silent rules for investigation.
Weekly
Monthly: Purple Team Validation
Execute atomic red team tests for critical detection rules. Validate that alerts fire with correct severity and context. Document any gaps.
Monthly
Monthly: Log Source Inventory
Confirm all expected log sources are ingesting. Check for volume anomalies (sudden drops may indicate broken collection). Verify retention policies.
Monthly
Quarterly: Schema Change Review
Review platform release notes for field changes. Update rules affected by CIM/schema migrations. Test after any SIEM upgrade.
Quarterly
Quarterly: Coverage Gap Analysis
Map rules to MITRE ATT&CK. Identify tactics with <40% coverage. Prioritize gaps based on threat landscape (especially initial access, lateral movement).
Quarterly
Post-Incident: Rule Effectiveness Review
After every real incident: Did the rule fire? If not, why? Was it a gap, a broken rule, or an evasion? Update rules based on lessons learned.
Per Incident
Continuous: Change Management Integration
Integrate with IT change management. Get notified when: EDR agents updated, log configs changed, new apps deployed, network segments modified.
Continuous
๐Ÿš€ Quick Actions
๐Ÿ“Š
Coverage Matrix
Visualize MITRE ATT&CK coverage and identify blind spots across tactics.
๐Ÿ”„
Query Translator
Convert rules between SPL, KQL, and Sigma to port to new platforms.
๐Ÿ“š
Use Case Library
Browse 226 detection use cases with ready-to-use queries.
ฮฃ
Sigma Rules
Community Sigma rules that work across all SIEM platforms.