Location: Pittsburgh,PA, USA
At least two years of experience building and leading highly complex, technical engineering teams.
Strong hands-on experience in Databricks
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Experience managing distributed teams preferred.
Comfortable working with ambiguity and multiple stakeholders.
Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
Expertise on Azure Cloud platform
Good SQL knowledge
Knowledge on orchestrating workloads on cloud
Ability to set and lead the technical vision while balancing business drivers
Strong experience with PySpark, Python programming
Proficiency with APIs, containerization and orchestration is a plus
Experience handling large and complex sets of data from various sources and databases
Solid grasp of database engineering and design principles.
Experience with Unity Catalog.
Familiarity with CI/CD methods desired