Principal Data Engineer
Remote
Red Canary
The combination of our market-defining technology and expertise prevents breaches every day and sets a new standard for partnership in the industry. We’re united in our commitment to customers and grounded in our values, which earned us a place on the Forbes Best Start-up Employers 2022 list. If our mission resonates with you, let’s talk.
What We Believe In- Do what’s right for the customer- Be kind and authentic- Deliver great quality- Be relentless
Challenges You Will SolveAt Red Canary, the validation and data science team is essential in driving the development of new features and improvements across our platform, closely aligned with our product roadmap. This success stems from our collaboration with security operations, product management, and engineering teams, focusing on deep analysis of the data generated by our platform. We strive to identify innovative approaches to enhance operational efficiency and maintain vigilant oversight of data throughout its journey in our detection engines.
As a Principal Data Engineer, you are at the heart of our mission to secure organizations by harnessing the power of data. Our team ensures that Red Canary stays ahead in the cybersecurity industry by managing, analyzing, and leveraging vast amounts of data to protect our customers. As a leader within our team, you will play a crucial role in enhancing our data processing capabilities and providing strategic insights to our customers.
You will act as a pioneer, developing cutting-edge data solutions that enable us to detect and respond to cybersecurity threats more effectively. Your work will directly impact our ability to offer timely, data-driven advice and solutions to our customers, helping them to understand the cybersecurity landscape and make informed decisions. By identifying new opportunities for data acquisition and use, you will help Red Canary improve its detection capabilities and contribute to the ongoing development of our data engineering practices.
What You'll Do
- Work on a team dedicated to designing, developing, and maintaining data pipelines, ensuring they can handle increasing volumes of data with complexity and cybersecurity considerations at the forefront.
- Develop and implement comprehensive data strategies that address the needs of our customers, enhancing Red Canary’s ability to detect and respond to cybersecurity threats.
- Collaborate closely with other departments, including Detection Engineering, Intelligence, and Engineering, to integrate cybersecurity data insights into our overall service offering.
- Oversee the enhancement of data quality, reliability, and security, ensuring our data infrastructure is robust, scalable, and aligned with industry best practices.
- Spearhead innovation within the data science team, identifying new tools, technologies, and processes that can enhance our capabilities.
- Actively mentor and develop the data science team, sharing your knowledge and expertise to foster a culture of continuous learning and improvement.
What You'll Bring
- 8+ years of experience in data engineering, with a strong background in cybersecurity or a related field.
- Demonstrated leadership skills, with the ability to guide and inspire a team of data engineers.
- Expertise in programming and scripting languages such as Python, SQL, and Scala or PySpark.
- Expertise in building and maintaining Data Lakehouses.
- Deep knowledge of big data frameworks (Apache Spark, Kafka, Flink) and cloud platforms and services, especially AWS (Glue, EMR, Athena, Redshift, and others).
- Proficiency in modern data stack platforms and tools, including experience with data integration, ETL/ELT pipelines, storage formats (parquet, avro), open table formats (iceberg, hudi, delta), semantic/query layers (trino, presto, dremio), ingestion tools (upsolver, airbyte), transformation tools (dbt).
- Experience with orchestration tools like Apache Airflow or Prefetch.
- Experience in setting up and maintaining data visualization platforms such as Apache Superset or Redash.
- A solid understanding of containerization and orchestration technologies, such as Docker and Kubernetes.
- Experience with data quality and governance tools, and knowledge of data privacy regulations like GDPR and CCPA.
- Excellent communication skills, with the ability to convey complex data concepts to technical and non-technical stakeholders alike.
- A strong desire to mentor and develop others, sharing your expertise to elevate the team's capabilities.
Targeted base salary: $225,000 + bonus eligibility and equity depending on experience
Benefit Highlights:- 100% Paid Premiums: Red Canary offers a 100% paid plan option for medical, dental and vision for you and your dependents. No waiting period.- Health & Wellness - Access to mental health services, Employee Assistance Program and additional programs to incentivize healthy habits. - Fertility Benefits: All new hires are eligible for benefits as of their first day.- Flexible Time Off: Take the time you need to recharge including vacation, sick, bereavement, jury duty, and holidays. - Paid Parental Leave- Full base pay to bond/care for your new child.- Pre-Tax Plans - Red Canary offers a variety of plans to fit you and your dependent specific needs including FSA, HRA and HSA, with employer funding to offset out of pocket health care expenses. - Flexible Work Environment- With 60% remote workforce, Canaries can work virtually from almost anywhere in the US.
The application deadline is April 19th, 2024
Why Red Canary?Red Canary is where people embody our mission to improve security outcomes for all. People work hard to maintain a culture that encourages authenticity in order to do your best work. Our people are driven and committed to finding the best security outcomes, delivering real and actionable answers, and being transparent along the way.
At Red Canary, we offer a very rich benefits program to our full-time team members so they can focus on their families and improving our customers’ security. For a full list of benefits, please review our Benefits Summary:https://resource.redcanary.com/rs/003-YRU-314/images/RedCanary_2024BenefitsSummary.pdf?version=0
Individuals seeking employment at Red Canary are considered without regard to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation.
Tags: Airflow Athena Avro AWS Big Data Data pipelines Data quality Data visualization dbt Docker ELT Engineering ETL Flink Kafka Kubernetes Parquet Pipelines Privacy PySpark Python Redash Redshift Scala Security Spark SQL Superset
Perks/benefits: Career development Equity Fertility benefits Flex vacation Health care Medical leave Parental leave Salary bonus Startup environment Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Data Manager jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Research Scientist jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs