Senior Data Engineer
New York City, United States
Full Time Senior-level / Expert USD 170K - 220K
adMarketplace
adMarketplace reimagines search advertising for advertisers and publishers by creating a frictionless consumer shopping journey during moments of intent and unlocking media value.Who We Are
At adMarketplace, our mission is to deliver the most engaging consumer search experiences while empowering advertisers to measure media performance accurately. Today, millions of people worldwide engage with our exclusive, transparent media placements across the internet’s leading browsers, shopping apps, and review sites.
Our mantra at adMarketplace is to let our winners run. From your very first day at AMP, you’ll have the opportunity to start making a valuable contribution to our company.
We’ve built our award-winning culture around five core values (known as our 5C’s): Curiosity, Collaboration, Creative Conflict, Commitment, and Competitiveness. With these guiding values, adMarketplace seeks to empower each and every employee to succeed, continue learning, and do their best work.
The Role
At adMarketplace, we create best of breed consumer search technology using cutting-edge architecture with millisecond response time and crunch through terabytes of data every day. The ideal candidate is motivated to design for massive scale and push the boundaries of using real-time data in automated decisions. You will be involved in the entire software development lifecycle, from defining requirements to designing, coding, testing, and supporting the product in production. You will have a clear career progression path and numerous opportunities for both personal and professional growth in an intellectually stimulating and dynamic work environment.
Responsibilities
- Develop and maintain ad-tech related data systems and system components using Python
- Data streaming, processing, and aggregation solutions
- Data-driven applications, ETL/ELT Pipelines
- 24/7 low latency large-scale distributed systems
- Cloud migration and containerization projects
- External Integrations for data exchange
- Work with the team for technical implementation of Data Engineering projects including data streaming, data transformation and aggregation pipelines
- Build data pipelines on cloud-based platforms
- Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)
- Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions
Basic Qualifications
- BS in Engineering, Computer Science or related discipline
- Must have 5+ years strong hands-on development experience using Python
- Must have experience with big data and streaming technologies like Apache Spark, Apache Kafka and Data Warehouse
- Experience with Cloud Analytics platforms like Databricks/Snowflake
- Experience developing, delivering and maintaining scalable data streaming, ETL processing and aggregation pipelines
- Experience Workflow Management tools like Airflow, Argo Workflows, Azkaban
- Experience with relational SQL and NoSQL databases
- Experience with public cloud AWS/ GCP/ Azure
- Experience working in a Linux environment/ Shell Scripting
- Ability to collaborate with multiple teams and understanding testing and deployment methodologies
- Experience building software in continuous integration and delivery fashion in an automated way
- Excellent documentation, communication, and troubleshooting skills
Preferred Qualifications
- Experience with Java/Scala development
- Databricks experience is a big plus
- Experience with Search Engines like Apache Solr, ElasticSearch
- Agile software development experience.
- Prior experience in the ad tech or e-commerce industry.
*Compensation Range: $170,000 - $220,000
#LI-Onsite
Join Us
adMarketplace has been named as one of the best places to work in New York City by Built In and Crain’s- the latter of which have recognized us the past three years straight! AMP is currently experiencing triple digit growth, and it’s never been a better time to join our team!
We offer a robust continuing education program, management training, regular company-wide lunch and learns, and well-defined career paths to ensure all our employees have an opportunity to grow.
At adMarketplace, we play to win, but we learn from our setbacks. Our commitment to a collaborative environment means no one succeeds alone, and no one fails alone either.
We know you’ve come to expect comprehensive healthcare, wellness programs, paid time off, commuter benefits, and 401k matching from any company, so it’s a good thing we offer all of that and so much more. adMarketplace offers a dog friendly office, Summer Fridays, catered lunches, a fully stocked kitchen, ZogSports teams, happy hours and corporate retreats to encourage a strong work/life balance.
Must be located or willing to relocate to New York City Metropolitan Area
*This range represents the low and high end of the base salary someone in this role may earn as an employee of adMarketplace in the New York office. Salaries will vary based on various factors including but not limited to professional and academic experience; training; associated responsibilities; and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.
Tags: Agile Airflow Architecture AWS Azkaban Azure Big Data Computer Science Databricks Data pipelines Data warehouse DevOps Distributed Systems E-commerce Elasticsearch ELT Engineering ETL GCP Java Kafka Linux NoSQL Pipelines Python Scala SDLC Shell scripting Snowflake Spark SQL Streaming Testing
Perks/benefits: 401(k) matching Career development Pet friendly Snacks / Drinks Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Manager jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open DevOps-related jobs