Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our team at Scott Air Force Base, supporting the Defense Information Systems Agency (DISA). The successful candidate will play a crucial role in designing, developing, and maintaining data infrastructure and pipelines to support the federation of structured and unstructured data across the DISA enterprise. This position requires a deep understanding of data engineering principles, strong analytical skills, and the ability to work collaboratively in a fast-paced environment. Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics requirements within the DISA enterprise.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver high-quality data solutions.
- Implement data models, schemas, and database structures to ensure efficient data storage and retrieval.
- Optimize and tune data processing workflows for performance and scalability.
- Develop and maintain documentation for data engineering processes, workflows, and systems.
- Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to operations.
- Support the integration of test Use Cases
Qualifications:
- Bachelor's degree in computer science, Information Technology, Engineering, or a related field or equivalent experience.
- Minimum of 8 years of experience in data engineering, data warehousing, or a related field.
- Possess an active DoD Secret Clearance or equivalent
- Proficiency in programming languages such as Python, Java, or Scala.
- Proficiency with SQL and database technologies (e.g., PostgreSQL, MySQL, Oracle).
- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (e.g., AWS, Azure, Google Cloud).
- Familiarity with data visualization tools (e.g., Kibana) and data analytics frameworks.
- Knowledge of data governance, data quality, and data security best practices.
- Excellent problem-solving skills and the ability to work independently and as part of a team.
- Strong communication and interpersonal skills, with the ability to convey complex technical concepts to non-technical stakeholders.