Experienced Big Data Engineer
Tel Aviv, Israel
Applications have closed
At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.
Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange and continue reaching new heights! Come work alongside Similarwebbers who are bright, curious, practical, and good people.
We’re looking for an Experienced Data-Server Engineer to take an important part in SimilarWeb’s data extraction team and play a key role in our growing data acquisition operation.
This role will report to the Team manager- R&D.
Why is this role so important at Similarweb?
Similarweb is a data-focused company, and data is the heart of our business. As a data server engineer, you will work in one of the company’s core teams and design and implement complex, high-scale systems that retrieve and analyze data from around the internet.
Data-Server engineers on Data-Extraction are responsible for
- Scraping - Building and maintaining high scale web-scraping operations.
- Processing - Creating complex data pipelines that process and enrich our raw data and serve it to different consumers through various databases and data-lakes.
- Engineering - Designing and building large scale, high quality systems to support our data infrastructure and production systems
As a Data-Server Engineer in Data Extraction, you will:
- Write complex PySpark applications that process, manipulate and validate large datasets, in high quality and under strict SLA.
- Develop dockerized high-performance microservices.
- Take a major part in designing and implementing complex high scale systems using a large variety of technologies.
- Work in a team with talented and independent engineers with whom you’ll be able to share knowledge and expertise.
- learn new technologies, handle a multitude of systems.
- Implement solutions in AWS cloud environment.
- Take part in monitoring and debugging data pipelines and high scale services in order to identify and fix bottlenecks and failures.
This is the perfect job for someone who:
- Has at least 4 years of server-side software development experience in one or more general purpose programming languages (C#, Java, Python etc.)
- Has Experience with Big Data technologies such as Hadoop, Spark, Databricks and Airflow.
- Worked in a cloud environment such as AWS or GCP, and is familiar with its different services, as well as docker and Kubernetes
- Has experiences with web scraping technologies or familiar with web technologies and the internet’s internals.
- Holds a BSc degree in Computer Science or equivalent practical experience.
- Is comfortable taking on challenges and learning new technologies, including new coding languages.
- Is a team player and likes giving and receiving constructive feedback
- Can effectively prioritize tasks, multitask and work independently
- Has good communication skills and enjoys helping and supporting team members as well as people from other groups
*All Similarweb offices work in a hybrid model, so you can enjoy the flexibility of working from home with the benefits of building face to face connections with fellow Similarwebbers.*
Why you’ll love being a Similarwebber:
You’ll actually love the product you work with: Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world.
You’ll find a home for your big ideas: We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization.
We offer competitive perks & benefits: We take your well-being seriously, and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours.
You can grow your career in any direction you choose: Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here.
Diversity isn’t just a buzzword: People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. We believe our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day.
We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available HERE.
We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available here.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Big Data Computer Science Databricks Data pipelines Docker Engineering GCP Hadoop Java Kubernetes Microservices Pipelines Privacy PySpark Python R R&D Spark
Perks/benefits: Career development Competitive pay Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Manager jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Principal Data Scientist jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open ML Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open NLP-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open Consulting-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs