Big Data Technical Lead
Boston, Massachusetts, United States
Quantexa
Quantexa helps bring context to data so you know every decision is the right decision, at the right time.Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 6 years, 10 locations and 500+ employees later we still believe that today. We connect the dots within our Customers data using dynamic entity resolution and advanced network analytics to create context, empowering businesses to see the bigger picture and drive real value from their data.
Due to the continuous success and high demand from our customers, we are looking for a Senior Data Engineer with a proven track record to join the Quantexa family. 🚀
Typical responsibilities include:
- Manage, transform, and cleanse high volume data.
- Write defensive, fault tolerant and efficient code for data processing.
- Automate data processing to enable on-going alerts on high-risk activity.
- Present project results to clients both face to face and virtually.
- Work very closely with data scientists to ensure efficient and effective delivery of solutions.
- Use leading open source big-data tools, such as Spark, Hadoop, Scala and Elasticsearch. You should be comfortable with working with high profile clients, on their sites.
- Work with our expert software development team to produce reusable applications.
- Use emerging and open-source technologies such as Spark, Hadoop, and Scala.
- Collaborate on scalability issues involving access to massive amounts of data and information.
- Take on ad-hoc tasks as required for the running of a small, yet rapidly expanding business.
- Leading a team and mentoring junior engineers.
Requirements
What do I need to have?
- Proven big data experience, either from an implementation or a data science prospective.
- Excellent technical skills including expert knowledge of at least one big data technology such as Spark, Hadoop, or Elasticsearch.
- Experience of building data processing pipelines for use in production “hands off” batch systems, including either (or preferably both) traditional ETL pipelines and/or analytics pipelines.
- Strong coding experience in the likes of Scala, Java, or Python.
- Strong client facing, communication and presentation skills.
- Strong academic qualifications, high quality degree (2:1 or above) or equivalent.
- Enthusiasm to learn and develop emerging technologies and techniques.
- Exhibit strong technical communication skills with demonstrable experience of working in rapidly changing client environments.
- Demonstrate strong analytical and problem-solving skills and the ability to debug and solve technical challenges with sometimes unfamiliar technologies.
Ideal candidates will also:
- Have worked on a variety of complex data orientated projects for financial services clients.
- Have a good understanding of Computer Science and preferable come from a software engineering background or other scientific degree incorporating IT modules (e.g. Maths/Physics)
- Have exposure to Agile, especially SCRUM.
- Arrive with experience at working with a variety of modern development tooling (e.g. Git, Gradle, Jenkins, Nexus) as well as technologies supporting automation and DevOps (e.g. Ansible, Chef, Puppet, Docker and a little bit of good old Bash scripting).
- Have an excellent appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this.
Benefits
- Competitive Salary
- Company Bonus
- 401(k) match up to 5%
- Competitive PTO Allowance + Paid US Federal Holidays + Your Birthday Off!
- Medical, Dental, and Vision coverage
- Short-term and Long-term Disability, Life, and AD&D insurance
- Access to One Medical - primary care practice that offers 24/7 on-demand virtual care
- Access to Teladoc - on-demand healthcare via phone or video
- Access to Health Advocate - the nation’s leading healthcare advocacy and assistance company
- Access to Calm App Subscription - the #1 app for meditation, relaxation, and sleep
- Access to Talk Space - the #1 rated, HIPAA-compliant app for online counseling and therapy services
- Continuous Training and Development, including access to Udemy Business
- Access to WeWork offices & Company-wide socials
Why join Quantexa?
We know that just having an excellent glass door rating isn’t enough, so we’ve put together a competitive package as a way of saying thank you for all your hard work and dedication.
We offer:
Quantexa is proud to be an Equal Opportunity Employer. We’re dedicated to creating an inclusive and diverse work environment, where everyone feels welcome, valued, and respected. We want to hear from people who are passionate about their work and align with our values. Regardless of race, beliefs, colour, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness – whoever you are, if you’re a curious, caring, and an authentic human being who wants to help push the boundaries of what’s possible, we want to hear from you.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Ansible Big Data Computer Science DevOps Docker Elasticsearch Engineering ETL Git Hadoop Java Open Source Physics Pipelines Python Scala Scrum Spark
Perks/benefits: 401(k) matching Competitive pay Health care Insurance
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs