Sr. Infrastructure Engineer - Data Infrastructure (Remote)

GBR Remote

Applications have closed

HARMAN International

HARMAN International is a global leader in connected car technology, lifestyle audio innovations, design and analytics, cloud services and IoT solutions.

View company page

​​#WeAreCrowdStrike and our mission is to stop breaches. As a global leader in cybersecurity, our team changed the game. Since our inception, our market leading cloud-native platform has offered unparalleled protection against the most sophisticated cyberattacks. We’re looking for people with limitless passion, a relentless focus on innovation and a fanatical commitment to the customer to join us in shaping the future of cybersecurity. Consistently recognized as a top workplace, CrowdStrike is committed to cultivating an inclusive, remote-first culture that offers people the autonomy and flexibility to balance the needs of work and life while taking their career to the next level. Interested in working for a company that sets the standard and leads with integrity? Join us on a mission that matters - one team, one fight.

About The Role:

CrowdStrike is looking to hire a Senior Software Engineer to join the Data Infra Engineering team as a Distributed Systems Engineer. In this team, we are on a mission to create a hyper scale data lake, which helps finding bad actors and stopping breaches. The team builds and operates systems to centralize all of the data the falcon platform collects, making it easy for internal and external customers to transform and access the data for analytics, machine learning, and threat hunting.

As a Software Engineer in this team you will be responsible for building our Spark ecosystem in our AWS and DataCenter that includes but not limited to Kubernetes, Flink, Kafka, Spark, MinIO, HDFS, Trino, Hive, Pinot etc. We are looking for candidates that have setup big data scale clusters in the DataCenter or Cloud (PB-scale would be a plus) in the DataCenter/AWS and are passionate about solving problems at high scale. This role involves leading efforts to build State-of-the-art Flink/Spark k8 platform.

What You'll Do:

  • Build and manage Large scale Distributed data processing systems both in cloud or Datacenters.

  • Build platform and oversee a variety of functions to ensure that our Flink/Spark infrastructure on Kubernetes/AWS making sure it is available, reliable, stable and secure.

  • Demonstrate very strong problem solving expertise in large scale systems.

  • Applies judgment in analyzing and selecting technologies, installation and maintenance of software and hardware systems that allow multiple Engineering and DataScience teams to interact with this system

  • Design, write and own APIs, automate and generate reports to visualize cluster health.

  • Working experience with Kubernetes, Terraform, Chef, Ansible, CI-CD, Dev-ops.

  • Has responsibility for building and maintaining the Flink infrastructure such that software engineers, data analysts and data scientists can run jobs to gather data and insights.

  • Work on Query systems, like Apache Presto or Trino, Jupyter Notebooks etc and strong programing background.

What You'll Need:

  • Strong in one or both of field i.e., Flink/ Spark ecosystem with Kubernetes ecosystem background

  • Strong analytical skills and with deep understanding of Distributed Systems

  • Strong programming skills in languages as Go, Python or Java

  • Understanding of Apache Spark ecosystem technologies (Flink operator or Spark Operator, Kafka, FluxCD, ArgoCD, Jenkin Pipelines etc)

  • Experience with large-scale business critical platforms with Flink/Spark on Kubernetes on data center or cloud.

  • Experience with continuous deployment on K8 with Helm, fluxCD. ArgoCD etc

  • Solid understanding of either Flink or Spark(data) and K8 storage systems (Object stores S3/Minio, Spark ephemeral storage, Persistent volumes mapping and claims)

  • Understanding or Flink streaming/spark memory management and experience with spark internals.

  • Familiarity with Chef is preferred.

  • Proven ability to work with both local and remote teams

  • Strong communication skills both verbal and written

#LI-MB1 

#LI-Remote

Benefits of Working at CrowdStrike:

  • Remote-first culture

  • Market leader in compensation and equity awards with option to participate in ESPP in eligible countries

  • Competitive vacation and flexible working arrangements

  • Physical and mental wellness programs 

  • Paid parental leave, including adoption 

  • A variety of professional development and mentorship opportunities

  • Access to CrowdStrike University, LinkedIn Learning and Jhanna

  • Offices with stocked kitchens when you need to fuel innovation and collaboration

  • Birthday time-off in your local country

  • Work with people who are passionate in our mission and Great Place to Work certified across the globe

We are committed to fostering a culture of belonging where everyone feels seen, heard, valued for who they are and empowered to succeed. Our approach to cultivating a diverse, equitable, and inclusive culture is rooted in listening, learning and collective action. By embracing the diversity of our people, we achieve our best work and fuel innovation - generating the best possible outcomes for our customers and the communities they serve.

CrowdStrike is committed to maintaining an environment of Equal Opportunity and Affirmative Action. If you need reasonable accommodation to access the information provided on this website, please contact Recruiting@crowdstrike.com​, for further assistance.

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Ansible APIs AWS Big Data Distributed Systems Engineering Flink HDFS Helm Java Jupyter Kafka Kubernetes Machine Learning Pipelines Python Spark Streaming Terraform

Perks/benefits: Career development Competitive pay Equity Flex hours Flex vacation Health care Parental leave Wellness

Regions: Remote/Anywhere Europe
Country: United Kingdom
Job stats:  10  2  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.