Software Development Engineer, Big Data
Mexico City
About the team
At Zillow Group, data is one of our most valuable assets to understand and support our customers to unlock life’s next chapter. The Data Platform organization enables teams across Zillow Group to unlock potential behind that data efficiently and securely.The Data Lifecycle Management Team provides guardrails for security, privacy, and data quality ensuring that the data infrastructure and processes adhere to industry standards and best practices. In addition to the Data Platform Governance team, the senior software development engineers collaborate closely with two other development teams within the Data Platform organization:
Learn more about what we are doing at https://www.zillow.com/engineering and https://www.zillow.com/ai
Acerca del equipo
En Zillow Group, los datos son uno de nuestros activos más valiosos para comprender y ayudar a nuestros clientes a desbloquear el siguiente capítulo de la vida. La organización de la Plataforma de Datos permite a los equipos de todo el Grupo Zillow desbloquear el potencial detrás de esos datos de forma eficiente y segura.
El equipo de gestión del ciclo de vida de los datos se encarga de la seguridad, la privacidad y la calidad de los datos, garantizando que la infraestructura y los procesos de datos se adhieran a las normas y mejores prácticas del sector. Además del equipo de Gobernanza de la Plataforma de Datos, los ingenieros superiores de desarrollo de software colaboran estrechamente con otros dos equipos de desarrollo dentro de la organización de la Plataforma de Datos:
Más información sobre lo que hacemos en https://www.zillow.com/engineering y https://www.zillow.com/ai
About the role
This role will be responsible for developing and supporting data platform infrastructure. They utilize data technologies such as Spark, Hive, Airflow, Databricks, Kafka, Flink, and other industry and internal tools.
Will collaborate to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions that create trust and delight our customers.
Acerca del puesto
Este rol será responsable de desarrollar y dar soporte a la infraestructura de la plataforma de datos. Utilizará tecnologías de datos como Spark, Hive, Airflow, Databricks, Kafka, Flink y otras herramientas internas y del sector.
Colaborarán para proporcionar entornos de plataforma de datos que permitan a los clientes internos del Grupo Zillow ofrecer soluciones de datos de alta calidad que generen confianza y deleiten a nuestros clientes.
This role has been categorized as a teleworker position. Teleworkers do not have a permanent corporate office workplace and, instead, work from a physical location of their choice which must be identified to the Company. Employees may live in any part of Mexico, but preferably in Mexico City, as we would encourage attendance for occasional in-office events.
In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location.
Who you are
Collaboration and Leadership:
- Collaborate with cross-functional team members and data scientists to understand their requirements and provide solutions.
- Passion and experience mentoring junior data engineers.
Continuous Learning:
- Enthusiasm for continuous learning and staying updated with the latest trends and technologies in the data engineering field.
- Proactive in exploring new tools and techniques to enhance data platform systems capabilities.
General Requirements:
- Experience in software development with one or more programming languages such as Python, Java, C++, etc..
- Proficiency in developing and supporting services with cloud infrastructure such as AWS.
- Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes.
- Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink.
- Experience in setting up and optimizing data pipelines
- Experience in developing scalable processes for supporting multiple user groups and teams.
- Familiarity and Experience with running on-call operational responsibilities for data platform systems
- Databricks experience is a plus.
- Experience with Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) is a plus
Transferable Skills:
- Here at Zillow - we value the experience and perspective of candidates with non-traditional backgrounds. We encourage you to apply if you have transferable skills or related experiences.
Quiénes somos
Colaboración y liderazgo:
- Colaborar con los miembros del equipo multifuncional y los científicos de datos para comprender sus requisitos y proporcionar soluciones.
- Pasión y experiencia como mentor de ingenieros de datos junior.
Aprendizaje continuo:
- Entusiasmo por el aprendizaje continuo y por mantenerse actualizado con las últimas tendencias y tecnologías en el campo de la ingeniería de datos.
- Proactivo en la exploración de nuevas herramientas y técnicas para mejorar las capacidades de los sistemas de plataformas de datos.
Requisitos generales:
- Experiencia en desarrollo de software con uno o más lenguajes de programación como Python, Java, C++, etc..
- Competencia en el desarrollo y soporte de servicios con infraestructura en la nube como AWS.
- Experiencia y capacidad para depurar/resolver problemas de plataformas de orquestación de contenedores como Kubernetes.
- Experiencia con sistemas de infraestructura de datos como Databricks, Spark, Hive, Airflow, Trino, Kafka y Flink.
- Experiencia en la configuración y optimización de pipelines de datos.
- Experiencia en el desarrollo de procesos escalables para dar soporte a múltiples grupos de usuarios y equipos.
- Familiaridad y experiencia en la ejecución de responsabilidades operativas de guardia para sistemas de plataformas de datos
- Experiencia en Databricks es un plus.
- Experiencia con Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) es un plus
Habilidades transferibles:
- Aquí en Zillow - valoramos la experiencia y la perspectiva de los candidatos con antecedentes no tradicionales. Te animamos a presentar tu candidatura si tienes habilidades transferibles o experiencias relacionadas.
Get to know us
Zillow is reimagining real estate to make it easier to unlock life’s next chapter.
As the most-visited real estate website in the United States, Zillow® and its affiliates help movers find and win their home through digital solutions, first class partners, and easier buying, selling, financing and renting experiences. Millions of people visit Zillow Group sites every month to start their home search, and now they can rely on Zillow to help make it easier to move. The work we do is helping people move from dreaming to transacting — and no matter what job you're in, you will play a critical role in making this vision a reality.
Our efforts to streamline the real estate transaction are supported by a deep-rooted culture of innovation, our passion to redefine the employee experience, and a fundamental commitment to Equity and Belonging. We’re also setting the standard for work experiences of the future, where our employees are supported in doing their best work and living a flexible, well-balanced life. But don’t just take our word for it. Read recent reviews on Glassdoor and recent recognition from multiple organizations, including: the 100 Best Companies to Work For in 2022 list, Glassdoor Employees’ Choice Award, honoring the Best Places to Work in 2022, Bloomberg Gender-Equality Index 2022, Human Rights Campaign (HRC) Corporate Equity Index and Best Place to Work for LGBTQ Equality 2022, and TIME 100 Most Influential Companies list.
Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, and gender identity. If you have a disability or special need that requires accommodation, please contact your recruiter directly.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Big Data Databricks Data governance Data pipelines Data quality Engineering Flink Java Kafka Kubernetes Pipelines Privacy Python Security Spark
Perks/benefits: Career development Competitive pay Equity / stock options Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Research Scientist jobs
- Open Junior Data Analyst jobs
- Open Business Data Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Scientist II jobs
- Open Sr Data Engineer jobs
- Open BI Analyst jobs
- Open Business Intelligence Engineer jobs
- Open Data Science Intern jobs
- Open Sr. Data Scientist jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Azure Data Engineer jobs
- Open Software Engineer, Machine Learning jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Marketing Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Engineering Manager jobs
- Open Product Data Analyst jobs
- Open Senior Software Engineer jobs
- Open Power BI-related jobs
- Open GCP-related jobs
- Open Tableau-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open LLMs-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Consulting-related jobs
- Open Data visualization-related jobs
- Open Generative AI-related jobs
- Open Business Intelligence-related jobs
- Open Data governance-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Docker-related jobs
- Open Git-related jobs
- Open Snowflake-related jobs