Senior Spark/Scala Data Engineer
US Remote
Applications have closed
Kin + Carta
Leveraging 2,000 consultants, engineers and data scientists, Kin + Carta makes the journey to becoming a digital business tangible, sustainable, and profitable.At Kin + Carta, we’ve got opportunities to offer you — for growth, for leadership, for big, world-changing impact and for, dare we say it, fun. We are a global workforce that is committed to building a world that works better for everyone. And that starts with our Kin. That’s why we’re proud of:
- The life we create within our virtual walls, every day
- Being B Corp certified
- Our honor as a “Best Company to Work For” by Women's Choice Award
The role
Ideal candidates will have strong quantitative backgrounds and analytical discipline. While they will have some demonstrated ability to write code, they will not have learned programming languages for the sake of building their resume, but rather as a means to express their intellectual curiosity and analytical voice. Kin + Carta will provide a platform and training to help them reach their full potential.
Kin + Carta is looking to hire Senior Spark/Scala Data Engineers to join our growing team. If you are innovative, passionate about data and AI technologies, and look to continually learn and enjoy sharing expertise, read on!
Role responsibilities
- Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
- In this role, the candidate will be designing, coding, testing, automating, debugging and supporting all types of applications consistent with established specifications and business requirements
- Provide consultation and lead the implementation of complex programs
- Develop and maintain documentation relating to all assigned systems and projects
- Tune queries running over billions of rows of data running in a distributed query engine
- Perform root cause analysis to identify permanent resolutions to software or business process issues
Minimum qualifications
We want all new hires to succeed in their roles at Kin + Carta. That's why we've outlined the job requirements below. To be considered for this role, it's important that you meet all Minimum Qualifications. If you do not meet all of the Preferred Qualifications, we still encourage you to apply.
- Strong/expert level hands-on coding experience in Spark using Scala
- Experience designing and building web environments on AWS, including working with services like S3, Amazon EMR and Kinesis Data Streams
- Collaborative, able to work remotely, and still be an engaging team member
- Strong analytical and design skills
- Flexibility to work on CST hours as necessary
Preferred qualifications
- Experience coding in Java/Spring, and Python
- Experience with Terraform
- Proficiency with data pipeline software, CI/CD and Devops
- Proficiency with cloud architecture components in AWS
- Ability to turn raw data and ambiguous business questions into distilled findings and recommendations for action
- Experience with statistical and machine learning libraries along with the ability to apply them appropriately to business problems
- Experience with Kubernetes and Docker in order to build, deliver, and scale containerized apps
- Proficiency in front and back-end web application development stacks and frameworks (Javascript, HTML, CSS, React/Vue/AngularJS) including API design (REST/GraphQL) and library development
- Experience using DevOps tools in a cloud environment, such as Ansible, Artifactory, Docker, GitHub, Jenkins, Kubernetes, Maven, and Sonar Qube
- Experience leading and managing technical data/analytics/machine learning projects
About Kin + Carta
Kin + Carta is a global digital transformation consultancy committed to working alongside our clients to build a world that works better #ForEveryone. Our 2,000 curious minds make creative connections between people, data and technology to create connected outcomes across the full lifecycle of the product and platform ecosystems.
We’re makers, builders and creators by nature, and we come to work every day to build experiences for some of the world’s most influential companies. We help businesses accelerate their digital roadmap, rapidly innovate, modernize their systems, enable their teams and optimize for continued growth.
We are a technology business with trust and human connection at its heart. As a Certified B Corp, our triple bottom line focus on people, the planet and profit is at the core of everything we do.
We welcome our Kin to show up as their authentic selves every day. Because this is so important to us, Kin + Carta is proud to be an equal opportunity employer. To read further about our commitment to Inclusion, Diversity, Equity and Awareness, check out the IDEA page on our website.
If you need accommodations at any point in the application or interview process, please let us know.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Angular Ansible APIs Architecture AWS CI/CD DevOps Docker Engineering GitHub GraphQL Java JavaScript Kinesis Kubernetes Machine Learning Maven Pipelines Python React Scala Spark Statistics Terraform Testing Vue
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs