Location: New York,NY, USA
**Senior Software Engineer - Cloud Data Warehouse**
**Engineering | New York, NY | Full Time**
Job Description ****Senior Software Engineer - Cloud Data Warehouse****
**ListenFirst Media**
At ListenFirst, we make our clients smarter by providing an unparalleled pictureof their brand, competitors, and overall market performance on Social Media. Our vision is to deliver comprehensive Social Analytics to give business leaders the advantage of all relevant data in one place through a SaaS platform coupled with expert industry knowledge and support. We lead with innovative technology and world-class support to anticipate the needs and exceed expectations of our clients.
We are growing our team and looking for smart, talented, ambitious, and creative people, interested in tackling challenging problems at scale for the biggest brands in the world.
**About the Opportunity:**
Our Engineering team is looking for a Senior Software Engineer focused on Cloud Data Warehouse and Analytics. As a Social Analytics provider, data is our lifeblood and the data warehouse is the bedrock of our platform. Data Engineers at ListenFirst ingest, normalize, enrich, classify, transform, index, and analyze vast amounts of structured, semi-structured, and unstructured data at scale. Data Engineers develop solutions that process Social Media data cost effectively, reliably, securely, timely, and continuously, enabling complex multi-dimensional time series analytics across the entire social sphere for the world's leading brands.
The ideal candidate is passionate about the data warehousing subject area and understands the science and art of aggregating, structuring, and joining massive amounts of data from disparate sources.
**Responsibilities:**
In this role, you will be a key member of the team responsible for the full life cycle of data in motion and data at rest at ListenFirst . You will be responsible for the design, development, evolution, operation, and maintenance of our cloud based data warehouse architecture. This includes:
* Design, and support the data models and database schemas for new and evolving sources of data supporting multi-dimensional time-series analytics
* Evolution of streaming and batch data processing ETL/ELT pipelines
* Integrate, create, and support analytic services and BI tools for internal use and integration with the core product
* Monitor, troubleshoot, and optimize queries and other performance issues on the data warehouse servers.
* Responsibilities extend to other data storage and indexing systems (including data lake, forward & reverse content indexes, knowledge bases, application OLTP databases, and other operational data stores)
* Follow the design principles and best practices defined by the team for software development, data warehousing techniques and architecture.
* Lead data governance, shepherd the data collection, retention, accuracy, consistency, security, availability, source instrumentation, and application of core business metrics
* Collaborate with, educate, and support data related activities with all stakeholders including other engineers, data scientists, data analysts, product teams, client services, sales, and executives.
**Requirements:**
* 5+ years of data warehousing ETL, reporting, and administration
* 7+ years of software development with a modern scripting language like Ruby or Python
* Expertise in the design and construction of data warehouses, ideally in Snowflake, Redshift, Vertica, or analogous architectures
* Well versed in relational modeling and star schema modeling
* Excellence in SQL with in-depth experience writing and optimizing complex queries.
* Understand data discovery, data profiling, and source to target mapping methodologies, with hands-on experience in custom ETL design, implementation and maintenance
* Experience with multiple relational database platforms, such as PostgreSQL, Oracle, MySQL, etc.
* Strong experience in database development, programming, performance tuning, and administration
* Proficiency in Linux with shell scripting experience
* Exceptional communication skills
* Baccalaureate degree preferably in computer science or other analytic subject area; masters or doctorate degree holders are also encouraged to apply.
**Bonus Points:**
* Experience with Amazon Web Services storage services: RDS, RedShift, DynamoDB, S3, and Glacier
* Experience using ETL/ELT tools and technologies
* Experience with distributed big data storage, streaming and batch analysis technologies
* Experience in working with unstructured data, parsers, text indexes
* Familiarity and hands on experience with efficient serialization & file storage formats such as Parquet, Avro, Thrift, Orc, Protobuf, etc
* Working knowledge of networking, IT infrastructure and enterprise security would also be useful.