Data Engineer - Toronto Hub
Canada - Toronto
Applications have closed
Veeva Systems
Veeva Systems Inc. is a leader in cloud-based software for the global life sciences industry. Committed to innovation, product excellence, and customer success, Veeva has more than 1,100 customers, ranging from the world's largest...Veeva is a ‘Work Anywhere’ company, so you can connect with teams in our Toronto office while also having the flexibility to work from home. And as a Public Benefit Corporation, you will work for a company with purpose and focused on making a positive impact on society.
Veeva is looking for a data engineer to create ETL pipelines for our Veeva Data Cloud product. We’re building a system to provide our customers with access to billions of records a day with insightful analysis along with aggregations and transformations.
For this role, we need someone who can design flexible data processes and leverage their Python and Scala skillsets to implement them in an AWS cloud environment.
You’ll be responsible for creating and owning the implementation of numerous data analysis features as well as the pipelines that process those features in a multi-tenant, highly parallel system.
What You'll Do
- Design and build scripts and tools that perform data analysis, transformations, aggregations, and other augmentations on large sets of in a spark-based AWS environment (EMR, Glue, S3, Redshift, Athena)
- Evaluate various pipeline models, tools, and environments and implement these to push data from our sources through your transformations and finally to our customers
- Work with product management and data research teams to prototype and test new ideas then take those to production
- Work in a fast-paced, test-driven environment
Requirements
- BS degree in Computer Science, Engineering or related subject
- 3 years+ experience working on Apache Spark applications in either Python (PySpark) and/or Scala
- Experience creating spark jobs that work on at least 1 billion records.
- Intermediate or greater SQL knowledge
- Experience creating data pipelines in a production system
- Experience working on AWS environments (S3, EMR, Glue, Redshift)
Nice to Have
- Experience working with Data Quality techniques
- Java development experience
- Experience working with Machine Learning/AI models
- Experience with AWS glue
- Familiarity with agile methodologies
- Experience with the following tools: Jira, Git, Terraform
Perks & Benefits
- Allocations for continuous learning & development
- Annual budget to donate to the non-profit of your choice
- Health & wellness programs
Veeva’s headquarters is located in the San Francisco Bay Area with offices in more than 15 countries around the world.
Veeva Systems is an equal opportunity employer. Accordingly, we are committed to fair and accessible employment practices. Veeva Systems welcomes and encourages applications from people with disabilities. Accommodations are available upon request for candidates taking part in all aspects of the selection process.
Tags: Agile Athena AWS Computer Science Data analysis Data pipelines Engineering ETL Git Jira Machine Learning Pipelines PySpark Python Redshift Research Scala Spark SQL Terraform
Perks/benefits: Career development Flex hours Health care Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs