Location: Alameda,CA, USA
Title: Data Engineer
Location: San Francisco, CA (1-2 Days onsite/Week)
Duration: 12+ Month Contract
Key Responsibilities:
• Design and implement scalable data pipelines using Databricks and Spark.
• Develop and maintain data processing applications in Scala and Python.
• Integrate and manage data streams using Kafka.
• Build and maintain microservices using Spring Boot.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Optimize and troubleshoot data workflows to ensure high performance and reliability.
• Ensure data quality and integrity across various data sources.
Required Skills and Qualifications:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Proficiency in Databricks, Spark, Scala, Kafka, Python, and Spring Boot.
• Strong understanding of microservices architecture.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork abilities.