Staff Big Data Tooling Engineer
Posted 5 months ago
Wayfair.com is a leader in the e-commerce space for all things home. Our Big Data Engineering team is looking for smart, passionate and curious people who are excited to help us scale, support and engineer our distributed analytic and streaming infrastructure. With the broad reach of the technologies we are using, you will have the opportunity to grow your network and skills by being exposed to new people and ideas who work on a diverse set of cutting-edge technologies.
As a Staff Software Engineer, you will join one of our core platform teams as a key contributor to the development of our tooling to manage our big data and messaging systems. You will be expected to
- Provide high quality scalable contributions to our data infrastructure and tools with a mind to follow best practices and an equally high degree of autonomy.
- Work with senior leadership to architect solutions and ensure that we deliver the right function in a timely manner.
- Mentor junior engineers to develop the next generation of Wayfair engineering.
In this hands on role, you’ll be able to see how your work powers the data science, analysts and the operations team to do their daily jobs more effectively.
What You’ll Do:
- Consult with our internal customers on their requirements, document and build specific tooling to meet their needs.
- Align system designs with larger strategic initiatives.
- Create specs and test plans and get them approved by stakeholders.
- Build automation and/or tools that adhere to the specs and build best in class CI/CD pipelines.
- Optimize our custom open source tools built in collaboration with other Fortune 500 Companies to run massive production workloads, company wide.
- Work closely with our Ops team to understand their day to day issues and recommend automated solutions to solve their problems.
- Lead and run Subject Matter Expert programs for BigQuery, Hive and other platforms to spread the knowledge of our supported platforms to our large and diverse user base.
- Build and deliver components for moving streaming data from Kafka to HDFS and cloud analytics systems and tools/dashboards to report on important metrics for Big Data Infrastructure.
- Clearly communicate project status and risks to engineering and executive stakeholders.
What You Have:
- 5+ years of software development experience while thinking like a data engineer
- Strong knowledge of Kafka and/or Hadoop
- Experience building and delivering Data Engineering systems.
- Strong programming skills: Python, Scala, Java
- Experience working with both Linux and Windows
- Strong agile SDLC background
- An analytical, creative, and innovative approach to solving problems
- Bachelor’s or Masters in Computer Science, Computer Engineering, or a related field
Wayfair is one of the world’s largest online destinations for the home. Whether you work in our global headquarters in Boston or Berlin, or in our warehouses or offices throughout the world, we’re reinventing the way people shop for their homes. Through our commitment to industry-leading technology and creative problem-solving, we are confident that Wayfair will be home to the most rewarding work of your career. If you’re looking for rapid growth, constant learning, and dynamic challenges, then you’ll find that amazing career opportunities are knocking.
No matter who you are, Wayfair is a place you can call home. We’re a community of innovators, risk-takers, and trailblazers who celebrate our differences, and know that our unique perspectives make us stronger, smarter, and well-positioned for success. We value and rely on the collective voices of our employees, customers, community, and suppliers to help guide us as we build a better Wayfair – and world – for all. Every voice, every perspective matters. That’s why we’re proud to be an equal opportunity employer. We do not discriminate on the basis of race, color, ethnicity, ancestry, religion, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, veteran status, or genetic information.