Job Title: Data Engineer with Azure Databricks and Python Location: Branchville, NJ [ (Day one Onsite) Essential Skill - Must Have Databricks Python Azure, Good to have Azure Data Factory
Job Description: Requirements - Candidate must be proficient in Databricks with minimum 4 yrs development experience
- Understands where to obtain information needed to make the appropriate decisions
- Demonstrates ability to break down a problem to manageable pieces and implement effective timely solutions
- Identifies the problem versus the symptoms
- Manages problems that require involvement of others to solve
- Reaches sound decisions quickly
- Develops solutions to meet business needs that reflect a clear understanding of the
- objectives practices and procedures of the corporation department and business unit
Roles Responsibilities - Provides innovative and cost effective solution using databricks
- Optimizes the use of all available resources
- Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit
- Learn adapt quickly to new Technologies as per the business need
- Develop a team of Operations Excellence building tools and capabilities that the
- Development teams leverage to maintain high levels of performance scalability security and availability
Skills - The Candidate must have 8 yrs of experience in ETL with atleast 4 yrs experience in databricks
- Hands on experience on Azure
- Experience on Python scripting
- Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses
- Strong experience with relational databases and data access methods especially SQL Knowledge of Azure architecture and design