datafuelX is a leading analytics and technology provider, specializing in multi-currency, cross-platform optimization for the television industry. The company was created to help sellers and buyers extract greater value from their data and transform advertising by enabling media, agencies, and brands to engineer better outcomes. With its full-service SaaS platform, M3, datafuelX is constantly innovating to drive improved revenue management for publishers, more precise results for advertisers, and a satisfying viewing experience for consumers. Our commitment to excellence is reflected in every facet of our operations, from our cutting-edge products to our dynamic team culture. At datafuelX, we pride ourselves on our track record of success and innovation. Recognized as one of Business Insider's Top 16 Hottest Startups, we continue to lead the industry by pushing boundaries and setting new standards of excellence. datafuelX is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data engineering, with extensive experience in building scalable and reliable enterprise data warehouse and analytics platforms within the media industry. As a key member of our team, you will play a pivotal role in helping us build and optimize our data infrastructure, driving innovation, and delivering value to our clients. You may be in our NYC office or remotely as your US-based location demands. Qualifications:
- Three or more years of experience with Nielsen and/or other alternative measurement providers in the media industry.
- Five or more years of top performance building highly scalable and reliable enterprise data warehouse & analytics platforms.
- Experience building and optimizing big data pipelines, architectures, and data sets.
- Hands-on experience in Snowflake & Databricks 'Big Data' technologies and Delta/Parquet data formats.
- Experience with workflow management and automation tools like Airflow.
- At least 2 years of hands-on experience with Cloud platforms like GCP & AWS.
- Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources.
- Strong programming skills in Python, Spark, and SQL.
- Minimum 5 years of experience in developing, deploying, and supporting large-scale distributed data processing systems.
- Bachelor's degree or equivalent work experience (minimum 5 years) in Computer Science or related field.
- Experience collaborating with Software Engineers using Agile methodologies to build web applications that access, visualize, and sometimes update big data stores in a hybrid OLAP and OLTP environment.
- Experience working in an operational environment with time-sensitive customer commitments.
- Ability to set up & implement Continuous Integration and Deployment infrastructure.
- Experience in Tableau or any reporting tool is preferred
Responsibilities:
- Design, implement, and optimize large-scale data warehouse production infrastructure.
- Collect, analyze, and synthesize complex information from disparate sources and load it into the warehouse using SQL, Python, or similar tools.
- Develop and optimize ETL/ELT processes for real-time and offline data processing.
- Collaborate with product owners, architects, and data science teams to transform data, optimize data pipelines, and productionize machine learning models.
- Build and support data marts and data models.
- Integrate data from a variety of sources, ensuring adherence to data quality and accessibility standards.
- Orchestrate and manage data pipelines using Airflow.
- Detect and respond to anomalies in data and data flows.
- Implement data governance and enforce data-at-rest security policies to safeguard the company's data assets in the cloud.
- Mentor and guide junior engineers in best practices and methodologies.
- Stay up-to-date with emerging technologies and industry trends to ensure our data engineering practices remain cutting-edge.
Our culture is defined by collaboration, curiosity, and a relentless pursuit of excellence. We foster an environment where creativity thrives, where every voice is heard, and where teamwork is celebrated. By fostering a culture of continuous learning and growth, we empower our team members to push the limits of what's possible, driving innovation and delivering impactful results. Our culture manifests itself not simply in broad statements but in how we invest in our team. It includes benefits like:
- Volunteer Time Off Program
- Education Investment
- Home-Office Stipend
- Employee stock ownership
- Paid paternity/family leave
- Twelve paid holidays plus your birthday
From our diverse portfolio of dynamic products to our team of industry experts, datafuelX is committed to shaping the future of media intelligence. Join us on this exciting journey, where your talents will be valued, your ideas will be amplified, and your contributions will shape the media landscape. At datafuelX, we are committed to fostering a diverse, equitable, and inclusive workplace where everyone feels valued, respected, and empowered to bring their authentic selves to work. We believe that diversity fuels innovation and drives success, and we are dedicated to cultivating an environment that celebrates the unique perspectives, backgrounds, and experiences of our team members. We embrace diversity in all its forms and are proud to be an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. Thank you for considering datafuelX as your next career destination! For more information, please visit our website at www.datafuelX.com