Job role: Junior Data Scientist
Duration: 6-month contract
Location: Monday-Thursday in-office, in Brooklyn, NY Friday remote
Current State: - Currently they are partnering with an engineering firm, Agilitech, to provide monthly engineering hours.
- Looking to bring more in-house engineering expertise to complement existing efforts.
- Data Analytics and Insights report directly to the Chief Digital Officer.
- Focus areas include Advanced Analytics, Insights, Business Intelligence (BI), and Data Science.
- The data warehouse has grown significantly, and the team is scaling to build more reports and support expansion.
Technology Stack: - AWS: Most data resides in S3 buckets, with EventBridge handling processing and Postgres RDS as the primary database.
- Data comes from external sources (e.g., Ticketmaster, Salesforce) and is ingested into S3, processed via EventBridge, and stored in Postgres with DBT for transformation.
- Recently signed a contract with Snowflake for migration efforts.
- Need to optimize RDS, which is nearing capacity, and implement best practices for query optimization.
- Heavy ETL work using AWS Glue Jobs, Snowflake exposure, and RDS.
- Focus on building end-to-end pipelines, regression testing, and implementing effective ETL frameworks.
Team Dynamics: - A young and aspiring team, with many BI Analysts eager to grow into more technical roles.