Senior Data Engineer
Dublin, Ireland
Applications have closed
Vectra
Vectra AI's Threat Detection and Response Platform protects your business from cyberattacks by detecting attackers in real time and taking immediate action.Vectra® is the leader in AI-driven threat detection and response for hybrid and multi-cloud enterprises.
The Vectra Platform captures packets and logs across network, public cloud, SaaS, and identity by applying patented security-led AI to surface and prioritize threats for rapid threat response. Vectra's threat detections are powered by a deep understanding of attacker methods and problem-optimized AI algorithms. Alerts uncover attacker methods in action and are correlated across customer environments to expose real attacks. Organizations around the world rely on Vectra to see and stop threats before a breach occurs. For more information, visit www.vectra.ai.
Position Overview
Detecting attackers in real-time requires a high-performance technology stack that enables machine learning and statistical techniques. This requires the management of considerable volumes of data. We are looking for an innovative and resourceful data engineer to join our growing team. Our data science and analytical capabilities rely on the fast, efficient flow of large volumes of data. Working in concert with our existing Data Engineering/Data Science teams you will assist in optimizing these flows as well as building out new data pipelines to support our growing product portfolio.
Responsibilities
- Create, test and maintain optimal data pipeline architectures
- Identify and develop data set processes for data modeling, minding, and production
- Build the infrastructure required for optimal extraction, transformation, and loading of large data sets
- Spark fresh ideas that are infused in our culture and our products
- Leverage emerging tech and Big Data to ensure delivery of real time analytics solutions
- Work on complex, large-scale, group-wide big data projects
- Perform analysis tasks required to troubleshoot data-related issues and present optimised solutions.
- Interface with other groups including Product Management, UX, Security Research and Data Science to help customers simplify security
Qualifications
Required
- 6+ years in software development, data engineering, or equivalent
- Knowledge of software design principles and leading software development practices
- Strong communication & collaboration skills
- Willingness to get things done, learn new things, take initiative and challenge existing assumptions and conventions
- Experience building and deploying to any cloud service (AWS, Azure, GCP, etc.)
Preferred
- Production experience with various distributed processing technologies (e.g. Kubernetes, Kafka, Spark, etc.)
- Comfort in dealing with low level data storage formats (e.g. Parquet, Avro, Arrow, etc.)
- Experience programming in any of the following (python, golang, scala)
- Experience with infrastructure as code (Terraform), automated testing, and CI/CD
- Knowledge of the following tools (or similar): Git, Jira
- Experience working with a geographically dispersed team
- Experience with grooming business-stakeholder requirements into achievable technical goals
- Ability to work in a collaborative environment
Education
- B.S or M.S or Ph.D. in Computer Science (or equivalent experience)
A two-minute video that describes what we do at Vectra, and an article about Vectra's last funding round:
https://vimeo.com/89579264
https://tcrn.ch/3gVAXNw
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Arrow Avro AWS Azure Big Data CI/CD Computer Science Data pipelines Engineering GCP Git Golang Jira Kafka Kubernetes Machine Learning Parquet Pipelines Python Research Scala Security Spark Terraform Testing UX
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open LLMs-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs