Data Engineer

Looking for a product software data engineer to help us to maintain accurate data into data warehouse using multiple technologies and also help in providing data insights by building visualization/dashboards. You will also work with data science team to build data pipe lines for multiple projects.

Under guidance, helps develop, testing, debugging and implementing operating systems components, software tools, and utilities required for the operation, maintenance, and control of computer systems. Helps modify existing software to fit specialized needs and configurations and maintains program libraries and technical documentation.

Responsibilities

• Analyze data using state-of-the-art methods.

• You need to build and maintain ETL jobs to keep data up to date in data warehouse from multiple sources like RDBMS, Salesforce, flat files, json files, DynamoDb etc.

• You also need to create and maintain visualization/dashboards on variety of data using visualization tool.

• Provide insights to business by analyzing complex data.

• Assist data scientist in building data pipe lines.

• Process, cleansing, and verifying the integrity of data used for analysis.

• Do ad-hoc analysis and present results.

• Create automated anomaly detection systems and constant tracking of its performance.

• Work with users and internal resources to define and refine requirements.

• Be an informal resource to less experienced colleagues with resolving technical issues.

• Participate in helping identify product and process changes to help the team move forward and better achieve its goals.

• You will report to the Lead Engineer

Skills and Qualifications

• Bachelor’s Degree in Computer Science or equivalent.

• Overall 2+ years of experience.

• 1+ years of experience in AWS Cloud.

• 1+ years of experience in AWS Glue or Talend ETL tool.

• 1+ years of experience in data visualization tool like Power BI or Tableau.

• Experience of writing and debugging complex SQLs.

• Experience of transforming complex data structures like json, xml files.

• Experience of working on AWS platform like S3, Redshift data warehouse.

• Experience of working on Python will be preferred.

• Experience of building APIs will be desirable.

• Stay informed about relevant technology trends and developments whenever required.

• Experience creating detailed technical documentation and analysis, while still able to understand the merits of others’ opinions.

• Experience weighing specific technical tradeoffs to maximize impact for effort.

• Highly motivated, organized, proactive self-starter and a team player.

• Data-oriented personality.