Job Title: Java Developer with Scala/Spark Job Location: Broadway New York, NY 10036 This is 3 days onsite per week, Look for local candidates first but can search outsiders too. Job Type: Contract Job Duration: Long Term. Mandatory Skills: Core java, Spark, Scala, Kafka We are seeking a highly skilled and motivated Java Spark Scala Developer to join our dynamic team. As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data processing application. Key Responsibilities:
- Develop and maintain data processing applications using Spark and Scala.
- Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
- Implement test-driven deployment practices to enhance the reliability of application.
- Deploy artifacts from lower to higher environment ensuring smooth transition
- Troubleshoot and debug Spark performance issues to ensure optimal data processing.
- Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time
- Provide essential support for production batches, addressing issues and providing fix to meet critical business needs Skills/Competencies:
- Strong knowledge of Scala programming language
- Excellent problem-solving and analytical skills.
- Proficiency in Spark, including the development and optimization of Spark applications.
- Ability to troubleshoot and debug performance issues in Spark.
- Understanding of design patterns and data structure for efficient data processing
- Familiarity with database concepts and SQL * Java and Snowflake (Good to have).
- Experience with test-driven deployment practices (Good to have).
- Familiarity with Python (Good to have).
- Knowledge of Databricks (Good to have).
- Understanding of DevOps practices (Good to have).