Senior Data Engineer
Bengaluru, Karnataka
Optiv
Optiv manages cyber risk so you can secure your full potential. Cybersecurity advisory services and solutions. Powered by the best minds in cyber.In your role at Optiv, you’ll be inspired by a team of the brightest business and technical minds in cybersecurity. We are passionate champions for our clients and know from experience that the best solutions for our clients’ needs come from working hard together. As part of our team, your voice matters, and you will do important work that has an impact, on people, businesses, and nations. Our industry and our company move fast, and you can be sure that you will always have room to learn and grow. We’re proud of our team and the important work we do to build confidence for a more connected world.
Build data pipelines to automate batch and real-time data delivery through Stream Sets’ streaming data platform to data lakes, warehouses, analytical and machine learning applicationsDevelop applications from ground up using a modern technology stack including Python, Spark, Scala, RDS, NoSQL, Graph databases, Elastic Search, Splunk Integrate and ship code into AWS and Azure cloud Production environments Build and utilize APIs and data delivery services that support critical operational and analytical applications for customersTransform complex analytical models into scalable, production-ready solutionsCustomer facing role – Walk thru to white boarding of architecture and implementation planning to stakeholders
Qualifications
- 5+ years of related work experience (Bachelor’s degree preferred)
- 5+ years of experience delivering data solutions using open-source components
- 3+ years of technical architecture experience
- 3+ years of experience in one or more scripting programming languages – Python, JSON, Ruby, C#, PowerShell, YAML
- 3+ years of experience with relational SQL and NoSQL databases
- 2+ years of experience with AWS, Azure, and/or GCP preferred
- Experience taking technical ownership over projects
- Experience with service-oriented architecture for cloud-based services.
- Experience with big data tools: Hadoop, Spark, Kafka, etc
- Experience with stream-processing systems: Stream Sets, NiFi, Storm, Spark-Streaming, etc.
- Strong analytic skills related to working with unstructured datasets
- Experience building and optimizing data pipelines, architectures and data sets utilizing tools like NiFi, Stream Sets, etc
- Experience with the following technologies is highly desirable: Scala, Tableau, Salt, Elastic stack (Logstash, Elasticsearch, Kibana)
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Experience with Agile Practices like Scrum, Kanban, CI/CD preferred
- Experience with deployment orchestration, automation, and security configuration management (Jenkins, Puppet, Chef, Cloud Formation, Terraform, Ansible) preferred
- Experience working with cloud security and governance tools, cloud access security brokers (CASBs), and server virtualization technologies
- Working knowledge of common and industry standard cloud-native/cloud-friendly authentication mechanisms (OAuth, OpenID, etc)
- Strong written and presentational skills; ability to clearly communicate complex messages to a variety of audiences
- Experience with enterprise architecture and working as part of a cross-functional team to implement solutions
- Strong interpersonal and communication skills; ability to work in a team environment
- Ability to work independently with minimal direction; self-starter/self-motivated
- Technical writing experience
- Possess high standard of integrity and confidentiality
With Optiv you can expect:
• A company committed to championing Diversity, Equality, and Inclusion through our Affinity groups including, Black Employee Network, Disabled Employee Network, Latino Employee Network, Optiv Pride (LGBTQIA+), Veterans Support Network, and Women's Network.• Work/life balance. • Professional training resources• Creative problem-solving and the ability to tackle unique, complex projects• Volunteer Opportunities. “Optiv Chips In” encourages employees to volunteer and engage with their teams and communities.• The ability and technology necessary to productively work remote/from home (where applicable)
Optiv is an equal opportunity employer. All qualified applicants for employment will be considered without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, status as an individual with a disability, veteran status, or any other basis protected by federal, state, or local law.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Ansible APIs AWS Azure Big Data CI/CD Data management Data pipelines Elasticsearch GCP Hadoop JSON Kafka Kanban Kibana Logstash Machine Learning NoSQL Pipelines Python Ruby Scala Scrum Security Spark Splunk SQL Streaming Tableau Terraform
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs