Management Controls is looking for a high-impact and versatile Junior Data Engineer to join our team. Role can be Houston based but also have the ability work remotely from any mainland USA location. The candidate must be collaborative by nature-willing to lead, execute, optimize, problem solve and adjust both work product and processes-based on feedback and input from multiple stakeholders. As a Junior Data Engineer, you will assist in building scalable data and analytics models and architecture from event formation to ingestion to reporting. You will evaluate the implementation of robust systems used by not only the Management Controls team but our customers and their vendors globally. You will help shape the vision of the end-to-end data pipeline architecture while following industry best practices. Duties and responsibilities
- Design, develop, and implement data pipelines and ETL processes using Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics (or comparable technologies)
- Automate manual processes, optimize data delivery, re-design infrastructure for greater scalability, etc...
- Ensure data quality through data governance and code development best practices
- Assist in design and development of data models and schemas
- Work cross-functionally with stakeholders (Consulting, Infrastructure, Product, etc.) to support their data infrastructure requirements
Requirements Required
- Bachelor's degree or higher in a quantitative/technical field (i.e. Computer Science, Statistics, Engineering) or equivalent experience
- Hands on knowledge with a scripting language (Python, etc...)
- Hands on knowledge with SQL to write complex, optimized queries
- Demonstrated experience in working with APIs, data modelling, ETL/ELT, and data warehousing
- Strong problem solving, troubleshooting, and communication skills
- A positive attitude, open mind, and a desire to collaborate with and learn from multi-disciplinary teams
- Interest in and ability to adapt and learn emerging technologies
Preferred
- Experience in Apache Spark or other distributed processing systems would be strongly preferred
- Experience in AWS or Azure cloud services
- Microsoft Azure/Fabric Certifications