Design and build highly scalable, reliable data pipelines for STRATCOM's mission-critical systems. This role combines data engineering expertise with real-time streaming and pipeline optimization to support national defense operations.
What you'll do
- Design, build, and maintain scalable ETL/ELT pipelines extracting and loading data from multiple sources into data warehouses, data lakes, and storage systems
- Develop and deploy real-time data streaming solutions using Apache Kafka, Flink, or Spark Streaming with low-latency processing
- Optimize and automate data workflows to ensure reliability and handle increasing data volumes
- Develop data models and schema designs for accurate, accessible, and high-performance analytics and reporting
- Implement data validation, monitoring, and error-handling mechanisms to ensure data quality and integrity
- Monitor, troubleshoot, and resolve performance bottlenecks in data systems and data access patterns
- Mentor junior data engineers and foster best practices in data engineering and collaborative teamwork
Mission
This role supports STRATCOM (U.S. Strategic Command) operating within a Sensitive Compartmented Information Facility (SCIF). The position enables adaptive innovation in data infrastructure to support the nation's most important strategic missions through advanced technology integration.
Required skills
- ETL/ELT pipeline design
- Data warehouse management
- Apache Kafka
- Apache Spark
- Data validation
- SQL
- Data quality monitoring
- Schema design