Data Engineer
Remote
Bixal
A mission-driven organization determined to improve people’s lives through human-centered strategies and transformative technologies. We deliver on this promise by partnering with leading federal agencies to conceive and create powerful...What will you do?We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.
To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.
Location:This role can be remote. You must be legally eligible to work in the United States. Bixal does not provide visa sponsorship. You must be able to pass and maintain a Public Trust clearance.
Responsibilities:
- Analyze and organize raw data
- Build data systems and pipelines
- Build visualizations using modern frameworks and tools
- Translate business requirements into technical specifications, including data streams, integrations, transformations, databases, and data warehouses.
- Implement data flows, i.e., which parts of the organization generate data, which require data to function, how data flows are managed, and how data changes in transition.
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Migrate data from legacy systems to new solutions
- Optimize data collection and ETL systems performance by conducting tests, troubleshooting, and integrating new elements
- Define security and backup procedures
- Perform other duties as required
Qualifications:
- Minimum of a Bachelor’s degree in a comparable field required
- 8 years of experience with at least the last 2 years in data collection specifically
- Previous experience as a data engineer or in a similar role
- Technical expertise with data models, data mining, and segmentation techniques
- Knowledge of programming languages (R, Python and Scala)
- Hands-on experience with data lakes, data lakehouses, and data warehouses, such as AWS Redshift, Databricks, Snowflake
- Hands-on experience with cloud solutions for data storage (eg. AWS S3, HDFS)
- Deploying applications to cloud solutions, AWS, Azure, or GCP
- Basic understanding of database administration and experience with modern databases (DynamoDB, Postgres)
- Experience writing scripts using Shell and/or Python
- Experience implementing data transferring solutions (eg. Apache Kafka, SCP, FTP, IBM ConnectDirect)
- Knowledge of APIs implementation and usage
- Hands-on experience with SQL database design
- Great numerical and analytical skills
Nice to Haves:
- Experience with Java
- Experience with Apachi, NiFi, and Spark
- Strong experience with Databricks
- Experience with Apache Hive
- Interpret trends and patterns
- Conduct complex data analysis and report on results
- Prepare data for prescriptive and predictive modeling
No recruiters or agencies please. Bixal is an equal opportunity employer and is committed to building a safe, inclusive environment for people of all backgrounds.
Tags: APIs AWS Azure Data analysis Databricks Data Mining DynamoDB Engineering ETL GCP HDFS Kafka Pipelines PostgreSQL Predictive modeling Python R Redshift Scala Security Snowflake Spark SQL
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs