- Lead the end-to-end experimentation program, collaborating with cross-functional teams to ensure alignment with business objectives. Manage internal A/B testing tool development. The role will involve shaping the experimentation strategy, fostering a data-driven culture, maximizing the potential of our platform, being at the helm of our cross-channel experimentation efforts, driving revenue growth, and creating a cohesive and efficient experimentation workflow across product, marketing, retention, and other departments

- Lead cross-channel experimentation program

- Develop and execute a Semrush-wide experimentation roadmap aligned with strategic goals to drive revenue growth and product optimization

- Classify and unify experimentation activities across departments, introducing a comprehensive, company-wide experimentation program

- Oversee the design and execution of controlled experiments, A/B and MVT tests, and other research tools to measure product impact effectively

- Develop maturity of product, marketing, and operational teams on best experimentation practices and cutting-edge approaches from the industry

- Demonstrate the impact of experimentation on business metrics, encouraging data-driven decision-making

- Develop internal A/B testing product and manage a development team (2-3 members) and backlog

- Create processes with comprehensive documentation of experiments, methodologies, and results, effectively communicating findings to relevant stakeholders

- Seamlessly integrate and exchange data with user analytics services, using results from tests and prediction models to prioritize product and marketing activities


Requirements
Who we are looking for

- Demonstrated Project Leadership Experience: You will drive multiple testing initiatives, prioritize tests, and plan A/B testing tool development

- Excellent Communication Ability, including experience with presenting to leadership

- Technical Proficiency: SQL is necessary

- MS in CS/STEM or another quantitative discipline

- Collaborative Spirit: Working with and influencing teammates, customers, and partners from different cultures and backgrounds to execute against shared goals

- Experience in backlog management and stakeholder management

- Test and Learn Mentality: Leading A/B testing means that you’re open to everyone’s input and letting the results of a well-crafted experiment inform the next steps


They say there are no perfect candidates, but that might well be you, if

- You have Python/R experience (as a bonus)

- You share our common values: Trust, as we prefer to speak up and be our true selves; Sense of Ownership, as it’s not worth wasting time on something you don’t believe in; and enthusiasm for Constant Change, as we are always looking to make things better


A bit about the team
This role will lead the end-to-end experimentation program, collaborating with cross-functional teams to ensure alignment with business objectives. Manage internal A/B testing tool development. The role will involve shaping the experimentation strategy, fostering a data-driven culture, maximizing the potential of our platform, being at the helm of our cross-channel experimentation efforts, driving revenue growth, and creating a cohesive and efficient experimentation workflow across product, marketing, retention, and other departments.
We will try to create all the right conditions for you to work and rest comfortably

- It’s up to you to decide what work format works best for you. You can #wfo, #wfh, or mix both.

- Flexible working day start

- Unlimited PTO

- Hobby benefit

- Breakfast, snacks, and coffee at the office

- Corporate events

- Training, courses, conferences

- Gifts for employees