The Data Engineer will play a pivotal role in operationalizing data and analytics initiatives. Primary responsibilities include building, managing and optimizing data processing pipelines, and then moving these pipelines into production for key data and analytics consumers. The Data Engineer must stay compliant with data governance and data security requirements while creating, improving and operationalizing the data processing pipelines. This role will work closely with key stakeholders and technology and subject matter experts to plan and deliver optimal data solutions. Specific Accountabilities
- Experience supporting and working with cross-functional teams in a dynamic business environment
- Ability to translate data needs into detailed functional and technical designs for development, testing and implementation
- Design, build and manage data processing pipelines using Google Cloud Platform (GCP) services and integrate with multiple data sources
- Participate in ensuring compliance and governance during data use
- Drive automation through effective metadata management
- Experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management
- Experience in working with large, heterogeneous datasets
- Keep up to date with technology and apply new knowledge