Data Engineer supporting secure data pipelines and ETL workflows for SOUTHCOM at the Miami HQ. Design and maintain analytics-ready datasets using Databricks, Spark, and Palantir Foundry in a classified environment.
What you'll do
- Develop and maintain secure data pipelines and ETL/ELT workflows using Databricks, Spark, Palantir Foundry, or Maven Smart Systems
- Process structured and unstructured data to produce analytics-ready datasets for mission stakeholders
- Implement data validation, modeling, and quality practices to ensure data integrity
- Collaborate with data scientists, engineers, and mission stakeholders to translate requirements into technical solutions
- Manage version control, testing, and documentation following Agile development practices
- Support operations within a SCIF (Sensitive Compartmented Information Facility) environment
Mission
This role directly supports U.S. Southern Command (SOUTHCOM) headquarters operations in Doral, FL. The position enables data-driven mission capabilities by processing structured and unstructured data to support command-level decision-making and operational analytics.
Required skills
- Python
- SQL
- ETL/ELT pipelines
- Spark or PySpark
- Databricks
- Data modeling
- Data validation
- Version control
- Agile development