Data Engineer

The Data Engineer creates and maintains data pipelines for key data and analytics capabilities in the enterprise. This position works in collaboration with analytics and data warehousing staff, DBAs and subject matter experts to create reliable processes that load targeted data with integrity and quality, enabling it for strategic use by the business.

Collaborate within an agile, multi-disciplinary team to develop optimal data integration and transformation solutions

Document and analyze data requirements (functional and non-functional) to develop scalable, automated, fault-tolerant data pipeline solutions for business and technology initiatives

Profile data to assess the accuracy and completeness of data sources and work with business partners to mitigate issues

Build and maintain data pipelines for using appropriate tools and practices in development, test, and production environments. Design with modularity to leverage reuse of code wherever possible

Create data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments into the analytics environment

Use a mix of ELT, ETL, data virtualization, and other methods to optimize the balance of minimal data movement against performance

Maintain metadata management processes and documentation

Monitor data quality to detect emerging issues and consult with the team to create transformation rules to cleanse against defined rules and standards

Participate in code reviews and unit testing to optimize performance and minimize issues

Job Specifications

Typically has the following skills or abilities:

Bachelor’s degree in computer science, data science, statistics, economics, or related functional area; or equivalent experience

Effective written and verbal communication skills with the ability to gather requirements and effectively collaborate with teammates and business partners

4+ years’ experience working in a development team providing analytical capabilities

4+ years of hands-on experience in the data space spanning data preparation, SQL, integration tools, ETL/ELT/data pipeline design

SQL coding experience

Familiarity with agile development environments (Scrum, Kanban) with a focus on Continuous Integration and Delivery

Previous experience using a data integration platform (IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo), and familiarity with data warehouse MPP platforms such Snowflake, Netezza, Teradata, Redshift, etc.

Familiarity with event store and stream processing (Apache Kafka and platforms like Confluent) and with API development and management platforms (MuleSoft, Axway) is also beneficial

Capable of focusing on a specific set of tasks while also ensuring alignment to a broader strategic design

Exhibits the traits of a pro-active, self-driven contributor, who values continual learning and the adoption of new technology

Preferred Skills

Working knowledge of Snowflake

Remediation of production issues in tables, pipelines, or other Snowflake-internal operations on domain data

Understanding of Snowflake architectural patterns and best practices

Data Vault & Delivery Vault MuleSoft development & application management experience

Confluent development & application/schema management experience Strong Python, SQL, Javascript skills

DataStage development & deployment experience

#LI-REMOTE

#LI-VISIONCARE

Compensation range for the role is listed below. Applicable salary ranges may differ across markets. Actual pay will be determined based on experience and other job-related factors permitted by law. As a part of the compensation package, this role may include eligible bonuses and commissions. For more information regarding VSP Vision benefits, please click here. 

Salary Ranges: $60,000.00 - $103,500.00

VSP Vision is an equal opportunity employer and gives consideration for employment to qualified applicants without regard to age, gender, race, color, religion, sex, national origin, gender identity, sexual orientation, disability or protected veteran status.  We maintain a drug-free workplace and perform pre-employment substance abuse testing.

Notice to Candidates: Fraud Alert - Fake Job Opportunity Solicitations Used to Collect Fees/Personal Information. 

We have been made aware that fake job opportunities are being offered by individuals posing as VSP Vision and affiliate recruiters. Click here to learn about our application process and what to watch for regarding false job opportunities. 

As a regular part of doing business, VSP Vision (“VSP”) collects many different types of personal information, including protected health information, about our audiences, including members, doctors, clients, brokers, business partners, and employees.  VSP Vision employees will have access to this sensitive personal information and are subject to follow Information Security and Privacy Policies.