Technical Lead / Data Engineer
Remote within the U.S.
Bixal
A mission-driven organization determined to improve people’s lives through human-centered strategies and transformative technologies. We deliver on this promise by partnering with leading federal agencies to conceive and create powerful...Location:This role is remote. You must be legally eligible to work in the United States. Bixal does not provide visa sponsorship. You must be able to pass and maintain a Public Trust clearance.
What Will You Do?We are looking for an experienced Technical Lead / Data Engineer to join our growing team of experts. The hire will be responsible for optimizing critical Federal data and data pipeline architectures, as well as optimizing data flows for downstream use by cross-functional teams. He or she will maintain strategic alignment of technical design and architecture to meet business growth and directions. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems, while understanding the flow from ingestion points to delivery to syndicators. The Technical Lead / Data Engineer will lead systems architects, database architects and data analysts on initiatives. They will ensure optimal data delivery architecture is consistent. They must be self-directed and comfortable collecting requirements from multiple teams and systems. The right candidate will be excited to positively impact millions of Americans by infusing their knowledge into the Federal government’s data processes.
Responsibilities:
- Architect overall systems using prototyping and proof of concepts.
- Develop product roadmaps, backlogs, and measurable success criteria, writing user stories to ensure effective delivery.
- Collect requirements to create and maintain optimal data pipeline architectures.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal ELT of data from a wide variety of data sources using SQL and ‘big data’ technologies.
- Communicate with a wide range of digital delivery disciplines and talent.
- Work with data and analytics experts to strive for greater functionality in data systems.
Qualifications:
- Experience as a technical lead on Agile Scrum teams.
- Experience leading cross-functional teams in a dynamic environment.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Proficient at building processes supporting data transformation, data structures, metadata, dependency and workload management.
- Ability to resolve complex ingestion issues due to evolving data layouts and formats.
- A successful history of manipulating, processing and extracting value from large datasets.
- Proficiency with object-oriented/object function scripting languages: Python, Java, Scala, etc.
- Experience with ‘big data’ tools: Hadoop, Spark, EMR, AWS Glue, and AWS OpenSearch.
- Experience with databases: MySQL, SQL Server and Redshift.
- Experience with AWS cloud services: s3, ec2, RDS.
- Experience with Jira
- We are looking for a candidate with a graduate degree in a technology field and 6+ years of experience in a Data Engineer role, or a commensurate combination of education and experience.
No recruiters or agencies please. Bixal is an equal opportunity employer and is committed to building a safe, inclusive environment for people of all backgrounds.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Big Data Data pipelines EC2 ELT Hadoop Jira MySQL Pipelines Prototyping Python RDBMS Redshift Scala Scrum Spark SQL
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data warehouse-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs