Title : Dataflow Consultant
Location: Remote
Duration Long Term
- Develop and maintain data pipelines using Dataflow to support real-time and batch processing.
- Design, implement, and optimize code in Java to enhance data processing capabilities and system performance.
- Integrate, transform, and manage data using Informatica tools to ensure data quality and consistency.
- Collaborate with cross-functional teams to gather requirements, develop solutions, and support data-driven decision-making.
- Troubleshoot and resolve performance issues across the data pipeline and integration processes.
- Ensure best practices in data security and governance are followed throughout the data architecture.
- Document technical solutions, processes, and procedures for effective knowledge transfer and future maintenance.
Qualifications:
- Bachelors degree in Computer Science, Information Technology, or related field (or equivalent experience).
- 5+ years of experience with Dataflow for designing scalable data processing pipelines.
- Proficiency in Java for application development and data handling.
- Experience with Informatica for data integration, ETL processes, and data management.
- Strong problem-solving skills with the ability to optimize complex data workflows.
- Knowledge of cloud platforms (e.g., Google Cloud, AWS, or Azure) is a plus.
- Excellent communication skills to collaborate with team members and stakeholders effectively.
Preferred experience in building data analytics solutions using Google Cloud Platform services such as Google BigQuery, Cloud Storage, Dataflow, DataProc, Pub/Sub, Cloud Composer, or DataPrep