Share this Job

Senior Web Analyst - A/B Testing

Date: Feb 3, 2019

Location: San Francisco, CA, US

Company: Williams-Sonoma Inc.

Requisition Number: SS-14729
Area of Interest: Information Technology
Organization: Corporate
Brand/Division: Shared Services
Position Type: Full-time


Senior Web Analyst -- A/B Testing

A Little Bit About Us...

You will be a key part of the Product team that is responsible for conceptualizing, designing and optimizing the customer experience and business technology innovations that drive Williams-Sonoma Inc.'s industry-leading multi-channel retail business. You'll be working with amazing peers, cutting-edge technologies and deep resources to help push the boundaries of product innovation. To learn more about our team, our values and our culture please check out our team site.

About The Job...

The Senior Web Analyst, Testing and Personalization, will conceptualize and execute digital A/B and multivariate testing strategies designed to improve site performance and the relevancy of our on-site experience to customers. This person will define both the long-term roadmap and manage day to day strategy and execution of our A/B testing efforts with significant opportunities to drive positive KPI growth. This role reports to the Manager of Web Analytics.

Responsibilities Include:

* Drive the strategic vision of all facets of the A/B Testing program for the Pottery Barn Brands to increase company ROI. Collaborate with a cross functional team of analysts, site management, creative and IT to ensure roadmap aligns with business strategies and goals.
* Create and execute test and campaigns using Adobe Target and homegrown A/B testing solution, enlisting IT development resources for more complicated functional test treatments.
* Identify testing opportunities using test results analysis and other data touchpoints (user experience, analytics reporting, behavioral tools, etc.). Drive stakeholders to ideate about site opportunities and future test plans.
* Define KPIs and metrics for tests as well as developing performance analysis that drives action. Ensure test results drive future test ideas and personalization strategy development.
* Monitor all metrics related to test results. Provide recurring performance reporting and post mortem test analysis to executives and stakeholders on a timely basis. Drive action, as-needed, based on test results and that are aligned with the business mission.
* Develop and document testing processes and policies to further improve campaign quality and executional efficiency.
* Work with the rest of the web analytics team to foster a culture of data-driven decision making across e-commerce that encourages validating or disproving assumptions about how we believe customers may react to various site experience scenarios.
* Size and scope testing opportunities, which should include a business case, an execution plan, and partnership buy-in.
* Regular, dependable attendance & punctuality.

Why you will love working at Williams-Sonoma, Inc.

* We're a successful, fast-growing company with an entrepreneurial vibe
* A technologically and data-driven business
* Competitive salaries and comprehensive health benefits
* We're at the forefront of tech and retail, redefining technology for the next generation
* We're passionate about our internal and external clients and live/breathe the client experience
* We get to be creative on a daily basis
* A smart, experienced leadership team that wants to do it right and is open to new ideas
* We believe in autonomy and reward taking initiative
* We have fun!


* 5+ years working in an A/B testing related function including campaign implementation and analysis.
* Experienced in utilizing statistical concepts for A/B test analysis: Statistical significance, confidence intervals, and establishing variance thresholds are a must.
* Experience leveraging Python for A/B test analysis. Particularly NumPy, Pandas, and Matplotlib libraries.
* Relevant experience working with web analytics, personalization and testing tools: Experience with at least one web analytics tool (Adobe Analytics, Google Analytics, or similar) and one testing tool (Target, Optimizely, or similar) required.
* Understands behavioral segmentation concepts and can dig into test results via Adobe Analytics and clickstream data with guidance from the analytics team.
* Self-starter who can ramp up quickly and thrive in a fast-paced environment.
* Strong attention to detail and organizational skills to manage a multiple work requests.
* Excellent communication skills and ability to interact with all levels of end users and technical resources. Comfortable presenting program strategy and results to senior management.
* Strong problem solving capabilities and a curious nature.
* High energy and results oriented with a passion for the role. Looking to drive improvements and change.
* Bachelor's Degree in Business Management, Marketing, Math, economics, Data Science or equivalent.
* Retail e-Commerce experience preferred.

About Williams-Sonoma, Inc.

Founded in 1956, Williams-Sonoma, Inc. is the premier specialty retailer of high-quality products for the home. Our family of brands includes Williams Sonoma, Pottery Barn, Pottery Barn Kids, PBteen, West Elm, Williams-Sonoma Home, Rejuvenation, and Mark and Graham. These brands are among the best known and most respected in the industry. We offer beautifully-designed, stylish and functional products for every area of the home, including the kitchen, living room, bedroom, home office, closet, laundry room, and even outdoor spaces. We've seen some big changes since our first brick-and-mortar store opened more than half of a century ago. What hasn't changed is our passion for high-quality products, functional design, outstanding customer service, and enhancing the lives of our customers and the communities where we operate. In 2017, we acquired Outward, Inc., a 3-D imaging and augmented reality platform for the home furnishings and décor industry. Today, we're a multi-brand, multi-channel, global enterprise supported by state-of-the-art technology and some of the most talented teams in retailing - and we're always looking for new energy and ideas.


Once you are here, you can look forward to a wide variety of benefits. Our corporate vision--to enhance our customers' quality of life at home--extends to the lives of our associates. To that end, we offer an extensive benefits package designed to help you grow, personally and professionally, to keep you healthy, to prepare you for the unexpected, to care for your family and to build a secure future. Depending on your position and your location, here's a look at what you might be eligible for:

* A generous discount on all Williams Sonoma Inc. brands through multiple shopping channels
* A 401(k) plan and other investment opportunities
* Paid vacations, holidays and other time-off programs
* Health benefits, including health, dental and vision insurance; health and dependent care tax-free spending accounts; medical, family and bereavement leave; same-sex domestic partner benefits; short- and long-term disability programs; life and travel insurance; an employee assistance program
* Tax-free commuter benefits
* A wellness program that supports your physical, financial and emotional health
* In-person and online learning opportunities through WSI University, LearnIt and AcademyX
* Cross-brand and cross-function career opportunities
* Quarterly sample sales
* A business casual work environment
* A bike share program
* Time off to volunteer
* Matching donations to qualifying nonprofit organizations
* Company-sponsored walks and runs
* Healthy, organic options in the cafeteria and an awesome salad bar
* Discounts on nearby gyms and other local businesses

Williams-Sonoma, Inc. is an Equal Opportunity Employer.

Williams-Sonoma, Inc. will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance, or other applicable state or local laws and ordinances.


Williams-Sonoma, Inc. is an Equal Opportunity Employer.

Williams-Sonoma, Inc. will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance, or other applicable state or local laws and ordinances.

Nearest Major Market: San Francisco
Nearest Secondary Market: Oakland

Job Segment: Business Manager, Testing, User Experience, Management, Technology