Staff Data Engineer, Analytics

At ASAPP, our mission is to solve complex and challenging problems by building transformative machine learning-powered products. We leverage artificial intelligence to address significant challenges that share three common characteristics: huge economic scale, systemic inefficiencies, and tremendous amounts of data. Our talented teams that drive our product innovation and development are located in New York City, Mountain View, Buenos Aires, Bangalore, and remote locations around the United States.
The Data Engineering & Analytics team powers the core of our data and analytics products. ASAPP's products are based on natural language processing and serve tens of millions of end-users in real time. We need sophisticated metrics to monitor and continuously improve our systems. 
We are seeking a Staff Data Engineer to serve as both a technical leader and the core contributor by designing and building analytic data feeds for both our business partners and internal stakeholders.

What you'll do

• Lead and deliver projects, working closely with engineers, business partners, product managers, and other stakeholders
• Engage with business and product teams to understand data requirements and translate those requirements into technical solutions
• Develop data models, data flows, and integration patterns for reporting applications
• Contribute to a data lake that facilitates analysis across hundreds of systems events
• Review code for style and correctness across the entire team
• Write production-grade Redshift & Athena SQL queries
• Manage and maintain Airflow ETL jobs
• Test query logic against sample scenarios
• Work across teams to gather requirements and understand reporting needs
• Investigate metric discrepancies and data anomalies
• Debug and optimize queries for other business units
• Review schema changes across various engineering teams
• Maintain high-quality documentation for our metrics and data feeds 
• Contribute to our data infrastructure platform, tooling, and automation
• Participate in our on-call rotation to keep production pipelines up and running
• Identify inefficiencies, both technical and business processes, and propose solutions

What you'll need

• 12+ years of experience in software engineering
• 8+ years industry experience as a data engineer with demonstrated expertise in building data warehouses and data lakes
• Extensive hands-on experience in designing dimensional data models, data profiling, ETL/ELT processes, and BI development
• Experience working with large-scale cloud data warehouse solutions such as Amazon Redshift, Google BigQuery, or Snowflake
• Expertise in at least one query language such as MySQL, PostgreSQL, or Oracle
• Proficiency in a high-level programming language, such as Python, Java, Scala, or Go.
• Technical knowledge of data exchange and serialization formats such as Protobuf, YAML, JSON, and XML
• Familiarity with reporting tools like Sisense, Power BI,  Looker, Tableau is a plus
• Experience with workflow management systems such as Apache Airflow or dbt
• Ability to work independently with minimal supervision and unclear requirements

What we'd like to see

• M.S. in computer science, data science, software engineering, information technology, applied mathematics, or statistics
• Previous experience in a data engineering, data architect, or data analyst role
• Ability to embrace and quickly ramp up on new technologies and programming languages
• Experience with temporal data warehouses, anomaly detection, or complex event processing

ASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at careers@asapp.com to obtain assistance. #LI-FA1 #LI-Hybrid