Regulator Policy
The policy module executes periodically to query the 10x Prometheus backend for event types exhibiting the highest volume rates, storing the results in a lookup file locally or on Github.
Instances of the Edge regulator app running alongside log forwarders can fetch and use the lookup to filter 'noisy' events from shipping to log analyzers (e.g., Splunk, Elastic).
Workflow
The policy regulator executes the following periodic process:
graph LR
A["<div style='font-size: 14px;'>⏰ Scheduler</div><div style='font-size: 10px; text-align: center;'>Periodic Job</div>"] --> B["<div style='font-size: 14px;'>📊 Query</div><div style='font-size: 10px; text-align: center;'>Prometheus</div>"]
B --> C["<div style='font-size: 14px;'>🔧 Build Policy</div><div style='font-size: 10px; text-align: center;'>Lookup Table</div>"]
C --> D["<div style='font-size: 14px;'>📤 Push</div><div style='font-size: 10px; text-align: center;'>to GitHub</div>"]
D --> E["<div style='font-size: 14px;'>📥 Pull</div><div style='font-size: 10px; text-align: center;'>Edge Regulators</div>"]
E --> F["<div style='font-size: 14px;'>🚫 Filter</div><div style='font-size: 10px; text-align: center;'>Collected Events</div>"]
classDef schedule fill:#7c3aed88,stroke:#6d28d9,color:#ffffff,stroke-width:2px,rx:8,ry:8
classDef query fill:#9333ea88,stroke:#7c3aed,color:#ffffff,stroke-width:2px,rx:8,ry:8
classDef filter fill:#2563eb88,stroke:#1d4ed8,color:#ffffff,stroke-width:2px,rx:8,ry:8
classDef Push fill:#059669,stroke:#047857,color:#ffffff,stroke-width:2px,rx:8,ry:8
classDef pull fill:#dc2626,stroke:#b91c1c,color:#ffffff,stroke-width:2px,rx:8,ry:8
classDef regulate fill:#ea580c88,stroke:#c2410c,color:#ffffff,stroke-width:2px,rx:8,ry:8
class A schedule
class B query
class C filter
class D Push
class E pull
class F regulate⏰ Periodic Invocation: Scheduled job triggers policy generation at configured intervals
📊 Prometheus Query: Retrieves cost metrics using range queries for event pattern analysis
🔧 Policy Building: Creates lookup table from high-cost event patterns exceeding thresholds
📤 GitHub Push: Commits policy lookup file to centralized repository for distribution (optional)
📥 Edge Regulator Pull: Distributed regulators fetch updated policies from GitHub/Server
🚫 Event Filtering: Downstream edge regulators apply policies to regulate events before shipping