A/B Testing Optimization Engineer with Optimizely

A/B Testing Optimization Engineer with Optimizely

Posted 1 day ago by 1762952168

Negotiable
Outside
Remote
USA

Summary: The A/B Testing Optimization Engineer is tasked with designing, developing, and executing A/B and multivariate tests to improve user experience and conversion rates across digital platforms. This role requires a blend of technical skills, analytical expertise, and an understanding of user behavior and digital marketing. The engineer will collaborate with various teams to ensure effective testing and data-driven decision-making. The position is fully remote and classified as outside IR35.

Key Responsibilities:

  • Code and implement A/B and multivariate tests across websites, mobile apps, landing pages, and digital campaigns.
  • Gather technical specifications and build test variations using front-end technologies (HTML, CSS, JavaScript).
  • Maintain and troubleshoot integrations with 3rd-party analytics and optimization tools.
  • Work closely with product managers, designers, marketers, and developers to define test hypotheses, prioritize experiments, and ensure accurate tracking.
  • Train IT and development teams on A/B testing best practices and frameworks.
  • Peer review test code and implementations across engineering teams.
  • Analyze test results using statistical methodologies to determine significance.
  • Interpret and translate complex data into actionable insights and recommendations.
  • Present clear, data-backed findings to stakeholders at various levels.
  • Champion a culture of experimentation and data-driven decision-making.
  • Stay current with industry trends, testing tools, and CRO methodologies.
  • Contribute to the ongoing optimization of digital user experiences and business KPIs.

Key Skills:

  • 3+ years in A/B testing, CRO, digital analytics, or a similar optimization-focused role.
  • 3+ years of experience with Optimizely.
  • Strong knowledge of experimentation frameworks and hypothesis-driven testing.
  • Proficiency in front-end technologies (HTML, CSS, JavaScript).
  • Experience with testing platforms.
  • Proficient in web analytics tools like Google Analytics, Adobe Analytics, Hotjar, and Mouseflow.
  • Familiarity with statistical analysis and result validation.
  • Strong analytical thinking and attention to detail.
  • Effective communicator with the ability to explain technical and analytical concepts to non-technical audiences.
  • Excellent collaboration and time management skills.
  • Passion for continuous learning and improvement.

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

A/B Testing Optimization Engineer REMOTE!!

Role Overview:
The A/B Testing Optimization Engineer is responsible for designing, developing, and executing A/B and multivariate tests across digital platforms to enhance user experience, increase conversion rates, and support data-driven decision-making. This role combines technical proficiency, analytical acumen, and a deep understanding of user behavior and digital marketing to deliver measurable business outcomes.

Key Responsibilities:

  • Test Development & Execution
    • Code and implement A/B and multivariate tests across websites, mobile apps, landing pages, and digital campaigns.
    • Gather technical specifications and build test variations using front-end technologies (HTML, CSS, JavaScript).
    • Maintain and troubleshoot integrations with 3rd-party analytics and optimization tools.
  • Collaboration & Support
    • Work closely with product managers, designers, marketers, and developers to define test hypotheses, prioritize experiments, and ensure accurate tracking.
    • Train IT and development teams on A/B testing best practices and frameworks.
    • Peer review test code and implementations across engineering teams.
  • Data Analysis & Optimization
    • Analyze test results using statistical methodologies to determine significance.
    • Interpret and translate complex data into actionable insights and recommendations.
    • Present clear, data-backed findings to stakeholders at various levels.
  • Strategy & Innovation
    • Champion a culture of experimentation and data-driven decision-making.
    • Stay current with industry trends, testing tools, and CRO methodologies.
    • Contribute to the ongoing optimization of digital user experiences and business KPIs.

Required Qualifications:

  • Experience:
    • 3+ years in A/B testing, CRO, digital analytics, or a similar optimization-focused role.
    • 3+ years of experience with Optimizely
  • Technical Skills:
    • Strong knowledge of experimentation frameworks and hypothesis-driven testing.
    • Proficiency in front-end technologies (HTML, CSS, JavaScript).
    • Experience with testing platforms
  • Analytics & Tools:
    • Proficient in web analytics tools like:
      • Google Analytics
      • Adobe Analytics
      • Hotjar
      • Mouseflow
    • Familiarity with statistical analysis and result validation.
  • Soft Skills:
    • Strong analytical thinking and attention to detail.
    • Effective communicator with the ability to explain technical and analytical concepts to non-technical audiences.
    • Excellent collaboration and time management skills.
    • Passion for continuous learning and improvement.