Experimentation Manager
15 days ago
Why PlayStation?
PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of products and services including PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, acclaimed PlayStation software titles from PlayStation Studios, and more.
PlayStation also strives to create an inclusive environment that empowers employees and embraces diversity. We welcome and encourage everyone who has a passion and curiosity for innovation, technology, and play to explore our open positions and join our growing global team.
The PlayStation brand falls under Sony Interactive Entertainment, a wholly-owned subsidiary of Sony Corporation.
Experimentation Manager
San Francisco, CA
We are looking for an experienced Experimentation Leader to develop and scale PlayStation’s Experimentation Program. You will use your Program Leadership and expertise in Experimentation to drive significant impact on individual team's ability to rapidly test, learn, and iterate, while unlocking new opportunities for PlayStation’s go-to-market strategies.
Responsibilities:
- Act as primary experimentation & optimization point of contact, consulting and supporting various business partners (Product, Engineering) in the development of their experimentation roadmaps and the design of specific actions
- Be the subject matter authority in experimentation (A/B, multivariate, etc.); understand our existing platform and how to optimize it for experimentation at scale
- Maintain and proactively monitor live experiments and ensure that appropriate metrics and segments are accurately implemented and reported, while consolidating and sharing findings across teams and verticals
- Be a reliable source of expertise for experimentation tools and offerings including keeping up to date with industry trends, services, and technologies
- Work with Product Management, senior leadership, and your peers, to develop the strategy for the future of experimentation at PlayStation (build/buy)
- Contribute to the creation of procedures and governance for a successful organization wide experimentation program at PlayStation and onboard new teams and individuals to the program
- Build and maintain leadership facing dashboards and reports. Increase visibility by communicating results and findings of individual experiments, as well as the overall program with partners
- Relentlessly communicate, coach, evangelize, document and share standard methodologies to colleagues across the company. Host hypothesis generation and experimentation ideation sessions to help teams build and prioritize their testing roadmap
- Increase experiment velocity by developing efficient processes and automating wherever possible
- Develop a center-of-excellence among key partners to enable the program to scale responsibly
Qualifications:
- 5+ years of experimentation experience (or equivalent) with proven expertise in implementing, running, and analyzing A/B tests and multivariate tests
- 5+ years leading and growing a company-wide experimentation program with multiple partners
- 3+ years in leading a team of experimentation analysts and data scientists delivering impactful analyses
- Strong familiarity with the methodology and statistics behind effective testing campaigns, with experience tailoring explanations of statistical and technical concepts to a variety of audiences
- Deep understanding of the tools that power automation, experimentation, personalization, attribution, and analytics. Strong technical skills - navigate APIs, databases, and system architecture
- Great partner management and collaboration with product managers, data, engineering and analytics teams
- Experience with testing platforms built-in house and/or 3rd parties (Optimizely, Target, Optymyze AB Tasty)
- Experience with Analytics Platforms including Adobe Analytics (Omniture), Google Analytics and/or similar analytics platforms
- Experience with SQL. Other programming languages (e.g., Python, R)
- Bachelor’s degree or equivalent in a relevant field, such as economics, statistics, mathematics, or computer science
Equal Opportunity Statement:
Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy or maternity, trade union membership or membership in any other legally protected category.
We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond.
PlayStation is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.