Data Engineer
Remote
Applications have closed
AnaVation
Responsibilities
- Develop tools and processes to ingest cyber data into an enterprise data lake.
- Make recommendations on standards for a common cyber data model and standards for harmonization of common data elements on data ingest.
- Develop and evaluate tools to search, analyze, discover, and otherwise exploit data in the data lake to support investigative operations.
- The ideal candidate will possess an understanding of prior AnaVation experience, frameworks, and solutions in the big data management domain.
Required Qualifications
- 5 or more years of relational database design and development (PostgreSQL, Oracle, Microsoft SQL Server)
- 5 or more years of ETL/ELT development experience
- 2 or more years with Linux environment experience
- 2 or more years of shell scripting experience
- Experience implementing data access controls
- Experience analyzing unstructured, structured, and semi-structured data
- Strong technical and computational skills, coupled with the ability relate data to use cases, mission requirements, and end-user experience
- Experience with development in one or more programming or scripting languages (Java/Python/Go)
- Bachelor’s degree in Computer Science, Information Systems. or related discipline
Desired Qualifications
- Experience with PostgreSQL
- Experience with Elasticsearch
- Experience with cloud concepts and big data architectures such as Hadoop, Kafka, etc.
- Knowledge of Continuous Integration/Continuous Delivery tools and practices
- Experience with cloud platforms such as AWS
- Experience working in Agile Environments
- Experience with DevOps toolsets
- Familiarity with containerization (Docker, Containerd, etc.)
- Experience with microservices
Clearance Requirements
- IRS Suitability
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Big Data Computer Science Data management DevOps Docker Elasticsearch ELT Engineering ETL Hadoop Kafka Linux Microservices Oracle PostgreSQL Python Shell scripting SQL
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs