Build and maintain secure data pipelines and analytics-ready datasets for DoD missions using modern data platforms. This role bridges data engineering and mission impact, supporting critical national security operations from the Pentagon.
What you'll do
- Develop and maintain secure ETL/ELT workflows that transform structured and unstructured data into analytics-ready datasets
- Design and implement data pipelines using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms
- Collaborate with data scientists, engineers, and mission stakeholders to define data requirements and validate output quality
- Apply data modeling, validation, and quality assurance practices to ensure pipeline reliability and compliance
- Implement version control, automated testing, and documentation standards aligned with Agile development practices
- Support classified data operations within SCIFs and DoD environments
Mission
Agile Defense supports DoD's most important missions through adaptive innovation. This position directly supports Pentagon operations and likely Combatant Command initiatives, requiring work in secure classified environments (SCIFs) and familiarity with DoD data infrastructure.
Required skills
- Python
- SQL
- ETL/ELT pipelines
- Data modeling
- Spark or PySpark
- Databricks
- Data validation
- Version control