Share this Job

Senior Big Data Engineer

Date: Dec 5, 2018

Location: San Francisco, CA, US

Company: Williams-Sonoma Inc.

Requisition Number: SS-14559
Area of Interest: Information Technology
Organization: Corporate
Brand/Division: Shared Services
Position Type: Full-time


Location: San Francisco, CA

The Williams-Sonoma Architecture and Platform organization is looking for you, an engaged and experienced Senior Big Data Engineer to build analytics and ML platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services. The platform will also enable machine/deep learning infrastructure that operationalizes data science models for broad consumption. As a Senior Software Engineer in the Big data Analytics organization, you'll join a small team focused on the delivery of the platform and actionable insights which moves the needle.


* Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice
* Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production
* We develop real products. You need to be an expert in design, coding, and scripting
* Facilitate problem diagnosis and resolution in technical and functional areas
* Encourage change, especially in support of data engineering best practices and developer satisfaction
* Write high-quality code that is consistent with our standards, creating new standards as necessary
* Demonstrate correctness with pragmatic automated tests
* Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices
* Develop strong working relationships with others across levels and functions
* Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest
* Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain
* Serve as a member of an agile engineering team and participate in the team's workflow



* 5- 8 years of experience as a professional software engineer
* 3-5 years of experience with big data technologies
* Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time
* Strong knowledge of programming languages/tools including Java, Scala, Python, Akka, Spark, SQL, Hive, and Elasticsearch
* Experience with streaming technologies such as Spark streaming, Flink, or Apache Beam
* Experience with various messaging systems, such as Kafka
* Experience in implementing Lambda Architecture
* Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, and/or Couchbase
* Working experience with various time-series databases such as OpenTSDB and Apache Druid
* Familiarity with ML and Deep Learning
* Working knowledge of various columnar storage such as Parquet Kudu, and ORC
* An understanding of software development best practice
* Enthusiasm for constant improvement as a Data Engineer
* Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion
* Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood
* Ability to work independently on complex problems of varying complexity and scope
* Bachelor's degree in Computer Science, Engineering or equivalent demonstrable experience


Williams-Sonoma is a company of lifestyle brands that emphasize good living and good eating. We are a People First organization that values our customers, quality craftsmanship, corporate responsibility and a healthy work/life balance.

We are continually working to achieve our business goals while improving our social and environmental performance. As a framework to guide our efforts, we've committed to a positive impact in 3 key areas: Operations, Products and Materials, and People and Communities.

Our responsibility extends to every part of our business-- from our home to your home, to the world's home.

* Work with emerging technologies
* Team First culture
* Full-time Associate Discount at all WS brands (40% off)
* Competitive salary and 401k plan
* Bonus plans and/or LTI plans for some positions
* Shuttle to/from SF BART and Caltrain
* Pre-tax health and commuter benefits
* Bike share program
* Pet Insurance (Starting July 2018)
* Quarterly sample sales
* Wellness program and quality health insurance options
* Mothers' rooms and onsite showers
* Discounts at nearby gyms and restaurants


Williams-Sonoma, Inc. is an Equal Opportunity Employer.

Williams-Sonoma, Inc. will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance, or other applicable state or local laws and ordinances.

Nearest Major Market: San Francisco
Nearest Secondary Market: Oakland

Job Segment: Database, Engineer, Computer Science, Java, Developer, Technology, Engineering