Data Engineer

3Pillar Global, we build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Our key differentiator is our Product Mindset. Our development teams focus on building for outcomes and all of our team members around the globe are trained on the Product Mindset’s core values – Minimize Time to Value, Solve For Need, and Excel at Change. Our teams apply this mindset to build digital products that are customer-facing and revenue-generating. Our business-minded approach to agile development ensures that we align to client goals from the earliest conceptual stages through market launch and beyond.

RESPONSIBILITIES

• Work with a scrum team(s) to deliver product stories according to priorities set by the client and the Product Owners with a focus on building infrastructure
• Writing code to move data, such as: migrate informatica jobs to client's custom framework migrating legacy environment to S3 environment pipeline support.
• Working with existing teams that also write code to move data.
• Attending standups and scrum ceremonies.
• Interact with stakeholders and support our partners in leveraging pipelines.

REQUIREMENTS

• Must Have:
• Demonstrated expertise with a minimum of 3+ years of experience as data engineer or similar role
• Advanced SQL skills and experience with relational databases
• Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
• Strong exposure to write ETL / pipeline code
• Experience in Data collection from multiple sources and integrating based on business needs
• Proficient with Spark
• Familiarity with the AWS/Azure/GCP data engineering services
• Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
• Proficiency in the English language.
• Nice to have:
• Exposure to AI / ML
• Exposure to work with Big Data technologies such as Spark, Hadoop etc
• Knowledge of DataBricks, Snowflake, BigQuery
• Exposure to Tableau, PowerBI
• Experience in Java or Scala

BENEFITS

• Vacations. According to the law from your first anniversary.
• Discretionary Time Off (employees are able to take time off when necessary)*
• 26 days of Christmas bonus
• Food coupons
• Major medical insurance
• Life Insurance (optional)
• Savings box (optional)
• Law benefits: IMSS, Afore, Infonavit.
• Career plan that will let you grow and plan for the future
• Home Office
• Internal Trainings
• Support with external trainings and certifications
• Referrals bonus


• #LI-Remote