Job Overview: We are seeking an experienced Data Platform Architect to lead the design and implementation of scalable data solutions. The ideal candidate will have a strong background in data architecture, data integration, and data processing frameworks, with expertise in Databricks and a passion for optimizing diverse workloads. Key Responsibilities:
- Design the data architecture for the proposed platform, focusing on scalability, performance, and support for advanced analytics and data science workloads.
- Ensure the platform supports multi-cloud operations, data sharing, and integration with various data sources, including on-premises and cloud environments.
- Collaborate with Cloud Architects and Engineers to implement data governance, financial governance, and compliance features.
- Optimize the platform for handling diverse workloads, relational operations, and multi-model data processing.
- Design and model data architecture tailored to organizational needs, leveraging Databricks and other relevant technologies.
- Develop and implement data ingestion frameworks, ensuring efficient and scalable data pipelines.
- Architect and maintain data Lakehouse storage solutions, emphasizing best practices for data modeling and schema design.
- Create and optimize data processing frameworks to support diverse workloads and data sources.
- Provide client-facing support, ensuring clear communication and understanding of technical solutions.
- Lead efforts in data sharing and integration across various platforms, connecting structured and unstructured data sources.
- Collaborate with stakeholders to document enterprise rollout strategies, data security blueprints, and architectural standards.
Qualifications:
- Master's Degree in Computer Science, a technical field, or a related business field.
- Equivalent training/certifications/experience will be considered.
- 8+ years of experience in relevant technology roles, with a focus on data architecture.
- 5+ years in an advanced role, demonstrating leadership in guiding teams directly or indirectly.
- 5+ years of experience in architecting and maintaining big data platform architectures utilizing AWS Data & Analytics Services
- 2+ years of experience in Databricks implementations
- Strong expertise in designing and supporting complex application architectures, including integration of disparate data sources.
- Experience in documenting enterprise rollout strategies and developing data security blueprints.
- Excellent communication skills