Title: Lead Data Engineer Location: Must be near King of Prussia, PA (hybrid schedule) Duration: 6 months plus These are the keys for this role :
- Life Sciences (Pharma, Biotech etc.)
- Python is a must.
- Snowflake Platform is a must.
- Exposure to digital data (social, web activity, etc.) is helpful.
- Ownership is a must and has been lacking in the resources who have been unsuccessful**
- Should want to handle lead responsibilities and help to manage on and offshore resources.
Role: Sr. Data Engineer Job Description
- Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems
- Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance
- Work in tandem with our engineering team to identify and implement the most optimal solutions
- Ensure platform performance, uptime, and scale, maintaining high standards for code quality and thoughtful design
- Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures
- Able to manage deliverables in fast paced environments
Areas of Expertise
- At least 8-10 years of experience designing and development of data solutions in enterprise environment
- At least 5+ years' experience on Snowflake Platform
- Strong hands-on SQL and Python development
- Experience with designing and development data warehouses in Snowflake
- minimum of three years' experience in developing production-ready data ingestion and processing pipelines using Spark, Scala
- Strong hands-on experience with Orchestration Tools e.g. Airflow, Informatica, Automic
- Good understanding on Metadata and data lineage
- Hands on knowledge on SQL Analytical functions
- Strong knowledge and hands-on experience in Shell scripting, Java Scripting
- Able to demonstrate experience with software engineering practices including CI/CD, Automated testing, and Performance Engineering.
- Good understanding and exposure to Git, Confluence and Jira
- Good problem solving and troubleshooting skills.
- Team player, collaborative approach, and excellent communication skills