Big Data Technical Lead
Málaga, Andalusia, Spain
Quantexa
Quantexa helps bring context to data so you know every decision is the right decision, at the right time.Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 6 years, 10 locations and 500+ employees later we still believe that today. We connect the dots within our Customers data using dynamic entity resolution and advanced network analytics to create context, empowering businesses to see the bigger picture and drive real value from their data.
Due to the continuous success and high demand from our customers, we are looking for a Senior Data Engineer with a proven track record to join the Quantexa family. 🚀
Typical responsibilities include:
- Manage, transform, and cleanse high volume data.
- Write defensive, fault tolerant and efficient code for data processing.
- Automate data processing to enable on-going alerts on high-risk activity.
- Present project results to clients both face to face and virtually.
- Work very closely with data scientists to ensure efficient and effective delivery of solutions.
- Use leading open source big-data tools, such as Spark, Hadoop, Scala and Elasticsearch. You should be comfortable with working with high profile clients, on their sites.
- Work with our expert software development team to produce reusable applications.
- Use emerging and open-source technologies such as Spark, Hadoop, and Scala.
- Collaborate on scalability issues involving access to massive amounts of data and information.
- Take on ad-hoc tasks as required for the running of a small, yet rapidly expanding business.
- Leading a team and mentoring junior engineers.
Requirements
What do I need to have?
- Proven big data experience, either from an implementation or a data science prospective.
- Excellent technical skills including expert knowledge of at least one big data technology such as Spark, Hadoop, or Elasticsearch.
- Experience of building data processing pipelines for use in production “hands off” batch systems, including either (or preferably both) traditional ETL pipelines and/or analytics pipelines.
- Strong coding experience in the likes of Scala, Java, or Python.
- Strong client facing, communication and presentation skills.
- Strong academic qualifications, high quality degree (2:1 or above) or equivalent.
- Enthusiasm to learn and develop emerging technologies and techniques.
- Exhibit strong technical communication skills with demonstrable experience of working in rapidly changing client environments.
- Demonstrate strong analytical and problem-solving skills and the ability to debug and solve technical challenges with sometimes unfamiliar technologies.
Ideal candidates will also:
- Have worked on a variety of complex data orientated projects for financial services clients.
- Have a good understanding of Computer Science and preferable come from a software engineering background or other scientific degree incorporating IT modules (e.g. Maths/Physics)
- Have exposure to Agile, especially SCRUM.
- Arrive with experience at working with a variety of modern development tooling (e.g. Git, Gradle, Jenkins, Nexus) as well as technologies supporting automation and DevOps (e.g. Ansible, Chef, Puppet, Docker and a little bit of good old Bash scripting).
- Have an excellent appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this.
Benefits
Why join Quantexa?
We know that just having an excellent glass door rating isn’t enough, so we’ve put together a competitive package as a way of saying thank you for all your hard work and dedication.
We offer:
- Competitive salary 💰
- Company bonus
- Free Calm App Subscription #1 app for meditation, relaxation and sleep 🧘♀️
- Ongoing personal development
- Great Company wide socials
- Plus other local benefits
Quantexa is proud to be an Equal Opportunity Employer. We’re dedicated to creating an inclusive and diverse work environment, where everyone feels welcome, valued, and respected. We want to hear from people who are passionate about their work and align with our values. Regardless of race, beliefs, colour, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness – whoever you are, if you’re a curious, caring, and an authentic human being who wants to help push the boundaries of what’s possible, we want to hear from you.
Tags: Agile Ansible Big Data Computer Science DevOps Docker Elasticsearch Engineering ETL Git Hadoop Open Source Physics Pipelines Python Scala Scrum Spark
Perks/benefits: Competitive pay
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Data Manager jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Data Analyst Intern jobs
- Open Junior Data Engineer jobs
- Open Research Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open PhD-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs