Sr Staff, Software Engineer

About the Role

In this role, you will design highly scalable and high performing technology solutions in an Agile work environment by developing creative and innovative solutions using and Agile practices. You will collaborate closely with key business support teams, product managers, security and architecture to assist in resolving critical production issues to help simplify and improve business processes through the latest in technology and automation. You are a technical expert and will lead through the requirements gathering, design, development, deployment, and support phases of a product. You will leverage your in-depth knowledge of domain and core programming technologies or packages and architecture to influence the direction of the product.

What You'll Do

Must-Have - Databricks, Delta Lake, PySpark (Apache Spark), MLOps, Data Drift Detection, Vector DB and Feature Store

Data Engineering Solution Architect with expertise in designing and implementing scalable data solutions, including architecting robust data pipelines. Strong proficiency in data architecture, ETL processes, MLOps practices for efficient model deployment, and utilizing technologies such as Databricks, DataLake, Vector DB, and Feature Store are essential.

Tech Skills

• Design, optimize, and maintain scalable data pipelines using PySpark (Apache Spark), Python, Databricks, and Delta Lake.
• Implement MLOps practices for efficient deployment and monitoring of machine learning models.
• Develop strategies and tools for detecting and mitigating data drift.
• Utilize Vector DB for effective data querying and management.
• Establish and manage a Feature Store to centralize and share feature data for machine learning models.
• Ensure data integrity and quality throughout all stages of the pipeline.
• Collaborate with teams and stakeholders to deliver impactful data solutions.
• Demonstrate proficiency in Python programming, PySpark (Apache Spark), data architecture, ETL processes, and cloud platforms (AWS, Azure, GCP).

Who You Are

Soft Skill

• Collaborate effectively with cross-functional teams and stakeholders to deliver impactful data solutions.
• Demonstrate strong communication skills to articulate complex technical concepts to non-technical stakeholders.
• Exhibit problem-solving skills to address data-related challenges and optimize processes.