Data Infrastructure Engineer
Austin, TX, United States
Vericast
Company Description
Vericast is a premier marketing solutions company that accelerates profitable revenue growth for the thousands of businesses it serves directly by influencing consumer purchasing and transaction behavior at scale while engaging with over 120 million households daily. We are recognized as leading providers of incentives, advertising, marketing services, transaction solutions, customer data and cross-channel campaign management, and intelligent media delivery that create millions of customer touch points annually for their clients. For more information, visit http://www.vericast.com or follow Vericast on LinkedIn.
Job Description
The Data Infrastructure Engineer is a critical contributor to developing and growing a modern data mesh architecture for scalable analytics and innovation within a data lakehouse framework. This new architecture enables organizations to build valuable data products within a self-service infrastructure, in turn making them discoverable, reliable, reusable, and compliant. This role will build the key architectural and feature components for the data lakehouse, including but not limited to data APIs, metadata cataloging, documentation, data lineage, and user access. Additionally, the project includes implementing the orchestration, transformation, and data movement of the datasets involved in the data lakehouse architecture. The Data Infrastructure Engineer will report to the Principal Data Infrastructure Lead.
Primary Responsibilities:
- Design and troubleshoot data systems powering and serving the data lakehouse, databases, event stores, and large-scale data processing engines
- Design and implement self-service tools enabling development teams to quickly deploy their own data infrastructure and pipelines with appropriate guardrails in place to ensure reliability
- Developing and documenting APIs using commercial, full API lifecycle management tools and best practices
- Build unit test cases for data products and execute them for coverage
- Contribute to a cross functional Agile Scrum team using Agile Scrum best practices, ceremonies, and artifacts
Qualifications
Required Skills, Experience, Qualification:
- 3-5+ years of hands-on data engineering experience, preferably in a cloud or hybrid cloud environment
- Experience with creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop,
- Hive, Spark, NoSQL, RDBMS, S3, and Snowflake
- Experience building ETL/ELT data pipelines, data quality checks and data anomaly detection and notification systems
- Knowledge of BI concepts and implementation experience across multiple backends
- Experience curating APIs for compliant data consumption
- Experience with migration of infrastructure from on-prem to cloud
- Curiosity to learn and apply new technologies
- Excellent verbal and communication skills
- Experience with agile development methodologies
Additional Information
Salary: $140,000 - $155,000
Vericast offers a generous total rewards benefits package that includes medical, dental and vision coverage, and generous PTO allowance. A wide variety of additional benefits like life insurance, employee assistance and pet insurance are also available, not to mention smart and friendly coworkers!
At Vericast, we don’t just accept differences - we celebrate them, we support them, and we thrive on them for the benefit of our employees, our clients, and our community. As an Equal Opportunity employer, Vericast considers applicants for all positions without regard to race, color, creed, religion, national origin or ancestry, sex, sexual orientation, gender identity, age, disability, genetic information, veteran status, or any other classifications protected by law. Applicants who have disabilities may request that accommodations be made in order to complete the selection process by contacting our Talent Acquisition team at talentacquisition@vericast.com. EEO is the law. To review your rights under Equal Employment Opportunity please visit: www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf
#LI-TT1
#LI-REMOTE
Tags: Agile APIs Architecture Data pipelines Data quality ELT Engineering ETL Hadoop NoSQL Pipelines RDBMS Scrum Snowflake Spark
Perks/benefits: Health care Insurance
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs