Staff Software Engineer, Reliability – Alert Platform

About the role

Command|Alert, the signal‑processing core of Command|Link’s SaaS platform, transforms raw security, monitoring and telemetry data into trustworthy alerts. As a Staff Software Engineer, Reliability you will own the end‑to‑end reliability of the alerting pipeline and guide its architecture at Fortune‑1000 scale.

Key responsibilities

• Own the reliability of the alerting pipeline end‑to‑end, from OpenSearch evaluation through Kafka delivery and downstream notification, ensuring idempotency and load resilience.
• Define and monitor SLOs/SLIs for availability, latency and delivery guarantees, using error budgets to balance reliability work with new features.
• Lead incident response for critical production issues, conduct blameless post‑mortems and implement systemic fixes and automation.
• Build observability, automation and capacity‑planning processes to support growth in ingestion volume and customer count.
• Set the architecture for rule‑based thresholds, ML anomaly scoring and correlation logic that feed LLM‑driven investigation and remediation.
• Mentor engineers across teams and communicate technical direction to non‑engineering stakeholders.

Required profile

• Strong SRE mindset with experience in defining SLOs, error budgets and blameless incident response.
• Ability to reason across security tooling, monitoring telemetry, syslog and L2‑L4 network protocols.
• Proven track record of building highly reliable, high‑throughput pipelines at scale.
• Excellent communication and mentorship skills.

Required skills

• OpenSearch
• Kafka
• OpenTelemetry
• SLOs / SLIs
• Error budgets
• Incident response and post‑mortem analysis
• Observability and automation tooling
• Capacity planning
• Rule‑based threshold evaluation
• Machine‑learning anomaly detection
• Correlation logic for telemetry
• Understanding of L2‑L4 network protocols
• Syslog