Senior Cloud Data Engineer

Senior Cloud Data Engineer

Kaizen Analytix LLC, an analytics products and services company that gives clients unmatched speed to value through analytics solutions and actionable business insights, is seeking qualified candidates for a Senior Cloud Technology Consultant specialized in Cloud Data Engineering. Responsibilities, capabilities for success, requirements, and the ideal candidate for this position are provided below.

Responsibilities:

Actively contribute to client Analytics & Cloud engagements – consisting of both custom and packaged solutions by…

• Participating in core delivery teams of Kaizen and non-Kaizen (clients, third parties) resources that possess business, technology focused on cloud and data engineering
• Managing multiple work streams from acquisition and planning through successful delivery
• Solving business problems through excellent decision-making and innovative, strategic ideas
• Profiling and engineering data movement between applications and systems

Capabilities for Success:

Candidate should demonstrate an ability to…

• Understand business context of an analytics solution: Current state, problem, goals/objectives and their business value, obstacles, and impacted client constituents
• Work with team(s) of analysts/data scientists/software engineers in performing and implementing high quality, sophisticated analysis in support of client engagements and internal projects

• Develop custom scalable and sustainable integrated data management modules including database design & architecture, implementations, migrations, ETL by leveraging technical skills.
• Working experience in big data platforms – Hadoop, Spark is preferable.
• Actively involved in designing and developing programmatic scripts or libraries to address several data management activities using Java, Python, Scala, and other Cloud-based tools.
• Work with team(s) in an Agile software development frameworks and methodologies
• Develop working knowledge of new models and solution techniques which could be leveraged across projects

• Facilitate a critical communications role by interacting with project owners (client team members), users (business domain), project team members and development personnel (technical domain)
• Present analysis, models, on-going challenges/risks (if any) and insights as an executive summary to client teams and internal groups

Job Requirements:

Mandatory

• Showing strong understanding of fundamental concepts in database management like ACID, Normalization, Normal Forms
• Proven skills in Enterprise data design and architecture
• Education and Experience:
  • Bachelor's degree in computer science/information systems and/or Engineering disciplines with at least 4 years of relevant experience in cloud-based or on-prem data management projects

• Excellent knowledge of cloud technologies and hybrid cloud services such as:
  • AWS: IAM, EC2, RDS, EMR, S3, Elasticache, Kinesis, Lambda, and EKS
  • AZURE: Azure Active Directory, blob storage, Azure Functions, Azure Kubernetes Service (AKS), HDInsight, Azure Databricks, Azure Data Factory

• Extensive experience building data pipelines (Talend, Azure Data Factory, AWS Glue etc.)
• Experience with databases (MySQL, PostgreSQL, Redshift, Aurora, Azure Cosmos DB, MongoDB, Cassandra), cache technologies (Redis, Memcached) and queue technologies (SQS).
• Experience with monitoring, logging, and alerting technologies like OpenSerach, Grafana, InfluxDB, Graphite, Cloudwatch, Elasticsearch, Kibana, New Relic, PagerDuty).

• Experience with stream-processing systems (Kafka, Storm, Spark-Streaming)
• Excellent written, verbal, and presentation skills
• Ability to travel as requested by client
• Experienced in generating data quality and validation reports
• Familiar with data governance, data security and privacy, and leveraging them in design and architecture of the data management systems.
• Familiar with data access and control to limit or employee RBAC on the data for limit access and authorization

Good to have

• Expertise in two or more of the following areas: basic math programming, basic of probability &statistics, machine learning, or other heuristics

• AWS Cloud Developer Certification
• Experience working on other cloud platforms like GCP / Oracle / PCF
• Dashboarding using Tableau or Power BI
• Familiarity with Alteryx or Talend

The ideal candidate will meet or exceed all the above and ideally:

• Possess industry experience in Automotive, Media and Entertainment, Communications, or Consumer Goods
• Have experience with data mining and business reporting
• Passionate about data-driven solutions and helping companies deliver value through analytics