Senior Software Engineer (Big Data)
Boston, Raleigh or Remote
BitSight
Bitsight is a global cyber risk management leader transforming how companies manage exposure, performance, and risk for themselves and their third parties.BitSight’s mission is to enable trust in digital transactions. Together, we are transforming how the market governs cybersecurity risk through Security Ratings. BitSight Security Ratings are real-time, data-driven measurements of cyber security performance that help companies, investors, insurers, government agencies and regulators make informed, dynamic risk decisions impacting business results, financial investments and national security.
- Founded in 2011, BitSight transforms how organizations manage information security risk.
- Manage third party risk, underwrite cyber insurance policies, benchmark performance, conduct M&A due diligence and assess aggregate risk.
- Seven of the top 10 cyber insurers, 20% of Fortune 500 companies, and 3 of the top 5 investment banks use BitSight
- BitSight is the most widely used Security Ratings Service with over 2,500 customers and the largest ecosystem of users and information
BitSight is looking for an experienced Big Data Engineer to join our engineering team. We pride ourselves in building exceptional career opportunities and offering outstanding benefits to our team. We have the enthusiasm of a start-up but the structure and solidity of a mature industry leader.
BitSight’s mission is to make the online world a safer place by helping governments, companies and NGOs understand and mitigate their cybersecurity risks. Ours is an internet-scale challenge - we track every IP address, every piece of malware, and a good portion of the world’s internet traffic.
BitSight’s data pipeline is the core of our Security Ratings product. We ingest security-related intelligence data from over 100 sources, feed terabytes of data into a proprietary rating algorithm, and deliver ratings for over 500,000 organizations on a daily basis. Built on the highly scalable AWS ecosystem, our pipeline code base meets the highest standards of reliability and scalability to deliver consistent, actionable, intuitive, and responsive ratings to the customer.
We are looking for developers with a passion for building software to collect, aggregate, and analyze data at scale using continuous, incremental development methodologies. Working with a close-knit team across multiple locations, you will help us architect and evolve the pipeline to support even larger volumes via cloud data warehouses. You will bring actionable security insights to the customer through integrating new data sources, surfacing new features from existing data, and refining the rating algorithm. Collaborating with data science and research teams, you will build trust with BitSight customers in the quality and integrity of our data.
Apart from domain skills, what we truly value are strong generalists: those with the critical thinking skills to use a variety of technologies and languages and pick up new concepts when needed. Strong collaboration skills are a must. We offer an opportunity to make a unique impact, not just as an individual but on the entire engineering team.
Requirements
- 3+ years working with modern Java (version 8 or higher)
- Prior experience building and operating large-scale data pipelines
- Strong computer science fundamentals in design, data structures, and algorithms
- Experience working with a team of engineers, designers, and product owners in delivering a product to end-users
- Excellent (English) written and verbal communication skills.
Preferred Skills
- Experience with Python
- Experience with technologies such as Hadoop, Spark, Elasticsearch
- Experience with NoSQL data warehouses such as AWS Redshift
- Experience with CI/CD and Kubernetes
- Experience working in the IT security domain
- Diversity. BitSight is proud to be an equal opportunity employer. This means we do not tolerate discrimination of any kind and are committed to providing equal employment opportunities regardless of your gender identity, race, nationality, religion, sexual orientation, status as a protected veteran, or status as an individual with a disability.
- Culture. We put our people first. BitSight offers best in class benefits, including unlimited paid time off, 401k match, and commuter benefits. All employees are bonus eligible. We devote the same energy to nurturing our company's inclusive culture as we apply to serving our customers' needs. Working at BitSight will give you the opportunity to fulfill your professional goals and expand your skills.
- Open-minded. If you got to this point, we hope you’re feeling excited about the job description you just read. Even if you don’t feel that you meet every single requirement, we still encourage you to apply. We’re eager to meet people that believe in BitSight’s mission and can contribute to our team in a variety of ways.
For San Francisco positions, qualified applicants with criminal histories will be considered for employment consistent with the requirements of the San Francisco Fair Chance Ordinance. This position may be considered a promotional opportunity, pursuant to the Colorado Equal Pay for Equal Work Act. If you are resident of Colorado, please email us at recruiting@bitsighttech.com to receive compensation and benefits information for this role.
Tags: AWS Big Data CI/CD Computer Science Data pipelines Elasticsearch Engineering Hadoop Kubernetes NoSQL Pipelines Python Redshift Research Security Spark
Perks/benefits: 401(k) matching Career development Insurance Unlimited paid time off
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Junior Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open LLMs-related jobs
- Open Airflow-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs