Software Engineer - Data Infrastructure
New York, USA, Remote
Applications have closed
About Datadog:
We're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale—trillions of data points per day—allowing for seamless collaboration and problem-solving among Dev, Ops and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way.
The Team:
Using a mix of open-source and proprietary applications the Data Engineering Infrastructure team enables engineers at Datadog to build and run thousands of data pipelines per day against petabyte-scale data. If you’re excited by the intersection of big data and building platforms, this is the team for you.
The Opportunity:
As an engineer for the Data Engineering Infrastructure team, you will design, build, scale, and evolve our data engineering platform, services and tooling. Your work will have a critical impact on all areas of Datadog's business: powering core data pipelines, supporting detailed internal analytics, calculating customer usage, securing our platform, and much more.
You Will:
- Build a big data platform-as-a-service (PaaS) for Spark, Luigi, Airflow, Kubernetes, and other open-source technologies on AWS, Azure and GCP
- Engage other teams at Datadog about their use of the platform to ensure we’re always building the right thing
- Use Datadog products to provide observability for our engineers so they can easily debug, scale, and tune their Spark jobs and data pipelines
- Join a tightly knit team solving hard problems the right way
You Are:
- You have a BS/MS/PhD in a scientific field or equivalent experience
- You have experience contributing to a software engineering team
- You have experience with a mix of backend programming, operations, and working with data
- You value code simplicity and performance
- You want to work in a fast, high-growth startup environment that respects its engineers and customers
Bonus Points:
- You have production experience running and operating state-of-the-art data processing frameworks, technologies, and platforms
- You have built and operated data pipelines for real customers in production systems
- You’ve built applications that run on AWS, Azure or GCP
#LI-TB1
#LI-Remote This is a remote position
Equal Opportunity at Datadog:
Datadog is an Affirmative Action and Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
Your Privacy:
Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice.
Tags: Airflow AWS Azure Big Data Data pipelines Engineering GCP Kubernetes PhD Pipelines Security Spark
Perks/benefits: Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs