AB Testing & Optimization Manager / Experimentation Manager
: Job Details :

Job Title: AB Testing & Optimization Manager / Experimentation Manager

Department: Marketing Team

Division: BritBox

Work pattern: Hybrid

Location: New York, NY

Reports to: Sr. Manager, Testing & Customer Insights Analyst

About Us

Welcome to BritBox, the go-to streaming destination for the best of British entertainment.

Born of the BBC, we bring authentic British stories to audiences all around the world. Since our launch in 2017, our fans have fueled our growth to seven markets, including North America, Australia, and the Nordics. We're a small but mighty streamer that punches above its weight—we're on every major distribution platform and even among the bright lights of Times Square! And hold on to your bowler hats because we're just getting warmed up.

At BritBox, we offer an unparalleled streaming collection of new and iconic mysteries, dramas, comedies and more. We have new rising stars like Blue Lights, hailed as “Belfast's answer to ‘The Wire'” (Time Out), catalogs of classics like Monty Python, full series of beloved hits like Vera, and everything in between. Our careful selection of thoughtfully crafted character-driven stories, brimming with trademark British wit and irresistible charm have helped us attract loyal fans all over the world.

Now, here's where you come in: this is your chance to be a part of something big. If you're passionate about entertainment, thrive in a fast-paced environment with a high performing yet supportive culture, and want to play a meaningful role in our remarkable growth story, this is your chance. Join our team and help us bring the best of British TV to fans everywhere.

Job Purpose

As Experimentation Manager, you will collaborate closely with multiple departments such as Marketing, Creative and Product to design, execute, and monitor tests. Through testing, you'll deliver improved results in areas such as paid media, key metrics for subscriptions like trial to paid conversion, LTV and retention, and ensure new launches and tactics are successful from the get-go.

This is an opportunity for a self-starter who can dig in and use both data-driven insights and testing techniques to drive growth within our company.

Key Responsibilities:

Test Setup & Execution: Assist in designing and implementing A/B tests and multivariate tests for marketing campaigns, creative assets, and subscriber strategies in product/app, email, push etc.

Project Management: Ensure all tests are tracked centrally, making all relevant updates to details and dates, proactively identifying conflicts and ensuring tests will start and end on agreed timelines.

Monitoring & Reporting: Regularly monitor test performance, analyze results, and compile reports that detail findings and recommendations for future campaigns.

Data Analysis: Utilize analytics tools to evaluate user behavior and conversion metrics, identifying trends and actionable insights to enhance marketing efforts.

Collaboration: Work closely with the Senior Manager, marketing team, and creative team to ensure tests align with business goals and user needs.

Subscriber Strategy Support: Contribute to the development of strategies aimed at attracting new subscribers and improving retention through data-driven insights.

Continuous Improvement: Stay informed about industry trends and best practices in testing and optimization, integrating new methodologies to improve testing processes.

Documentation & Communication: Maintain clear documentation of testing protocols and

communicate results effectively to stakeholders, ensuring alignment on strategic decisions.

Qualifications:

• Bachelor's degree in Marketing, Business, Data Science, or a related field.
• Previous experience in testing, optimization, or analytics, preferably in a digital or subscription-based environment.
• Understanding of key statistical concepts for hypothesis testing, including confidence intervals, p values, alpha, beta, standard deviation etc
• Familiarity with A/B testing platforms (e.g., Optimizely, VWO) and marketing automation tools.
• Familiarity with analytics platforms such as GA4, Meta, etc
• Strong analytical skills with proficiency in data analysis tools (e.g., Excel, Google Analytics, SQL, Tableau).
• Excellent communication skills, able to present complex data insights in a clear and actionable manner.
• Detail-oriented with strong organizational skills and the ability to manage multiple projects simultaneously.
• Passion for data-driven decision-making and improving customer experiences.
• Bonus: HTML/CSS/Javascript to directly set up tests in tools such as Optimizely

Skills and Personal Attributes:

• Passionate about British TV and SVOD
• Motivated by working in a fast-paced media environment
• Natural project manager, able to manage self & others to complete tasks on time and communicate clear deliverables and expectations
• Excited to pioneer and continually evolve a new platform for testing & optimization
• Proven ability to translate analytics into actionable insights
• Excellent communication and interpersonal skills with the ability to collaborate effectively with cross-functional teams.
• We work flexibly at BritBox, to support new markets some work may be conducted outside of US business hours to coordinate with territories in other time zones.
• This job spec is not exhaustive and may change from time to time in line with the evolving nature of a dynamic and growing business.

Salary Range: $90-100k base salary + competitive benefits + bonus potential

Please note that the salary range is intended to give as an indicator of the salaries that could be attributed to the breadth or experience for a given role. All candidates will be measured based on their level of experience.

We work flexibly at BritBox, to support new markets some work may be conducted outside of US business hours to coordinate with territories in other time zones.

This job spec is not exhaustive and may change from time to time in line with the evolving nature of a dynamic and growing business.