Big Data Engineer II
Cape Town
Applications have closed
Our Company:
At Impact.com our culture is our soul. We are passionate about our people, our technology, and are obsessed with customer success. Working together enables us to grow rapidly, win, and serve the largest brands in the world. We use cutting edge technology to solve real world problems for our clients and continue to pull ahead of the pack as the leading SaaS platform for businesses to automate their partnerships and grow their revenue like never before. We have an entrepreneurial spirit and a culture where ambition and curiosity is rewarded. If you are looking to join a team where your opinion is valued, your contributions are noticed, and enjoy working with fun and talented people from all over the world..then this is the place for you.
Impact.com is the global leader in Partnership Automation. We work with enterprise and innovative brands like Ticketmaster, Levi’s, Microsoft, Airbnb, and Uber to help them manage all different types of partnerships. From social influencers, B2B, strategic partners, publishers, and traditional affiliates, we have them covered. Our combined suite of products covers the full life partnership lifecycle including onboarding, tracking ads and paying partners, recruiting for new partners, data and marketing intelligence, and protection from fraud. Founded in 2008 by the same team that founded Commission Junction, Impact has grown to over 500 employees and ten offices across the United States, Europe, Africa, and Asia.
Why this role is exciting:
As a Big Data Engineer II, your focus will be on delivering stories for the squad, monitoring production environments and managing deployments to production. This role assumes that you are able to utilize the latest features of a language and can effectively select and implement the right design pattern to solve problems independently.
You will have experience implementing integration tests, be comfortable working with CI and confidently reuse existing frameworks.
At this level you are expected to have an understanding of the business requirements of all stories in the sprint, implement stories on existing cloud infrastructure and services and independently implement agreed design to spec. You should feel comfortable escalating appropriately.
You are also expected to help team members with implementation and troubleshooting.
Responsibilities:
- Collaborate with the team to fulfill the department's quarterly objectives
- Design, implement features, and write tests on the Impact Data Platform leveraging most Big Data Tech Stack
- Perform Releases, maintain continuous integration pipeline, code merging
- Intermediate knowledge of Hadoop, Spark, SQL, NoSQL, Streaming
- On-Call for Monitoring and Alerting and communicate to team / Company as needed
- Analyze any job failure, log tickets in JIRA, deliver analysis, code fix, possibly data fix
- Communicate cross squad via slack, email, JIRA, Zoom
- Create & Maintain proper documentation
- Approve & Merge Pull Requests
- Able to tune performance of Systems, Pipeline flows, Applications, Datastores
- Assist systems group with database and other infrastructure upgrades (sometimes off- hours/weekends)
- Gain and maintain enough understanding of The Business to deliver effective solutions
- Perform data quality analysis and introduce monitors with proper alerting for the team
- Be part of the team conducting interviews of new candidates
- Regularly share technical approaches with team
- Mentor Associate Engineers as well as knowledge share within the Team and broader Engineering Department
- Identify potential new technologies in our stack
Does this sound like you?
- Initiative
- Adaptability
- Personal Development
- Completed B.S. In Computer Science or related field or equivalent professional experience
- Any open source contributions are strongly desired
- Desire to work with Big Data and surrounding Technologies
- 3+ years experience with numerous ETL / Streaming Pipeline Technologies
- 4+ years Software Development experience
- Agile / Iterative processes. Kanban / Scrum
- Experience working in a Start-up or Internet business is valuable
- Customer Focus
- Service-Oriented
- Experience working with Large Data Volumes - Terabytes to Petabytes - required
- Experience working with Big Data Tech - Spark, Kafka, Google Pub/Sub, HBase
- Exposure and experience in any Google Cloud technology highly desired
- Knowledge of Digital Marketing or Web Analytics is a big plus
- Continuous Integration / Delivery methods, tooling, integrations
- Ability to Implement core principles of Ralph Kimball - Star Schemas / Facts / Dimensions etc.
- Ability to tune numerous types of system and applications in a Data Pipeline
- Experience with Relational Databases, Table design, SQL
- Exposure and Knowledge of Scheduling Frameworks; Azkaban a plus
- Experience writing enterprise-level application code in a JVM Language (Scala preferred)
Benefits/Perks:
- Casual work environment, including working from home
- Flexible work hours
- Unlimited PTO policy
- Take the time off that you need. We are truly committed to a positive work-life balance, recognising that it is important to be happy and fulfilled in both
- 6 month paternity/maternity leave
- Training & Development
- Learning the advanced partnership automation products
- Medical Aid and Provident Fund
- Group schemes with Discovery & Bonitas for medical aid
- Group scheme with Momentum for provident fund
- Restricted Stock Units
- 3-year vesting schedule pending Board approval
- Internet Allowance
- Fitness club fee reimbursements
Impact is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, colour, ethnicity, religion, creed, national origin, ancestry, genetics, sex, pregnancy or childbirth, sexual orientation, gender (including gender identity or non-binary or nonconformity and/or status as a trans individual), age, physical or mental disability, citizenship, marital, parental and/or familial status, past, current or prospective service in the uniformed services, or any characteristic protected under applicable law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires accommodation, please let us know.
LI-RL1
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Azkaban Big Data Computer Science Data quality Engineering ETL GCP Google Cloud Hadoop HBase Jira Kafka Kanban NoSQL Open Source RDBMS Scala Scrum Spark SQL Streaming
Perks/benefits: Career development Flex hours Flex vacation Medical leave Parental leave Startup environment Team events Unlimited paid time off
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open NLP-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs