Build and maintain secure data pipelines and analytics platforms supporting critical DoD missions at Scott AFB. This role is for an experienced data engineer who can process structured and unstructured data at scale while working in classified environments.
Mission
This position supports Agile Defense's work with the U.S. Air Force at Scott Air Force Base, enabling adaptive innovation for the nation's defense priorities. The role involves close collaboration with data scientists, engineers, and mission stakeholders across Combatant Command operations.
About this role
About Agile Defense
At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.
Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.
Job Title: Data Engineer
Location: O'Fallon (St. Louis), IL: Scott AFB
Clearance Level:This position requires candidates to be U.S. citizens and to possess, at minimum, an active Secret security clearance. Roles under this requisition may require higher-level clearances, including TS/SCI, which candidates must be able to obtain and maintain based on project assignment.
Job Description
Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets. Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.
Required Skills
- Bachelor’s degree in computer science, data science, engineering, information systems, mathematics, or a related technical field. Equivalent combinations of education, technical certification, and relevant professional experience may be considered.
- 3+ years of relevant data engineering, software development, data analytics, or enterprise-platform experience.
- Experience with Python and SQL familiarity with data validation, data modeling, and data-quality practices; familiarity with Spark, PySpark, Databricks, or comparable technologies
- Experience supporting ETL/ELT pipelines and data transformations
- Understanding of version control, testing, documentation, and Agile development
- Ability to collaborate with technical and nontechnical stakeholders
- Active US government security clearance
Preferred Skills
- Experience with Palantir Foundry, Maven Smart Systems, or War Data Platform
- Exposure to Docker, CI/CD, MLflow, APIs, or Terraform
- Familiarity with AWS or Azure
- Familiarity with DoD data environments and classified networks
- Prior Combatant Command support
- Solid Python and SQL skills with familiarity in JavaScript/TypeScript
Working Conditions
Must be able to work onsite in a SCIF
Required skills
- Python
- SQL
- ETL/ELT pipelines
- Data modeling
- Spark or PySpark
- Databricks
- Data validation
- Version control