Sr. Manager, Data Engineering
This is what you’ll do:· Build and manage a highly scalable Big Data architecture with high volumes & variety of data from business applications and machine data· Create and manage a highly performant IIOT/IOT infrastructure and advanced analytics framework.· Collaborate with other technology teams to implement a framework of tools and technologies to ingest high volume of data to support data science and machine learning.· Solve complex analytical requirements using software engineering tools.· Implement tools and technologies to provide data governance and security around data lake and data warehouse.· Continuous research of the latest big data technologies like time series database/graph databases to provide new capabilities and continuously increase efficiency.· Create and support of real-time data pipelines & querying capability using Kafka/Kinesis/SQS, Glue, Spark, Redshift/Spectrum and Athena· Build data applications to provide real-time data alerts & analysisThis is what you’ll need:· Passion for Software & data engineering, pioneering data technologies and architecture. Ability to understand complex business problems and provide software solutions.· Strong leadership and team building qualities.· Excellent communication skills to collaborate with multiple Engineering, IT & business teams.· 15+ years of experience in software and data engineering and extensive experience in building petabytes scale Big Data architecture using AWS services & open-source technologies.· Proven experience in solving large scale IOT used cases.· Extensive hands-on experience in building data solutions and architecture using AWS & open-source services like SQS, Kinesis, Kafka, Spark, Athena, Sagemaker, IOT Core, ElasticSearch etc.· Real-life production experience in creating architecture for Data Science teams to build, train & scale machine learning models.· Strong data base knowledge in NOSQL, Timeseries, Columnar, graph and relational databases.· Experience in building data governance and security in data lake, implementing data catalog solutions like Alation, Collibra, Atlas· Hands-on experience in one or more programming languages like Java, Python, Scala.· Good knowledge of statistical models and machine learning algorithms.· Bachelors/Masters in computer science, engineering, mathematics, or a related technical discipline preferred Rivian is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: Rivian is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Rivian are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Rivian will not tolerate discrimination or harassment based on any of these characteristics. Rivian encourages applicants of all ages.
Job tags: AWS Big Data Engineering Java Kafka Machine Learning NoSQL Python Redshift Research Scala Security Spark
Job region(s): North America