Senior Data Engineer

Scoutbee's AI-powered Supplier Intelligence and Discovery platform is leading the digital procurement (r)evolution. We believe we need a more sustainable economy that works for both people and the planet. Our mission is to drive this transformation by providing companies with better data, enabling them to make better decisions, and contribute to creating a better world.

We are looking for a Senior Data Engineer to join us on this data journey and help shape the data ecosystem at scoutbee in our Berlin office.

Your role and responsibilities

As a Senior Data Engineer, your responsibilities would include the following:

• Facilitate data architecture design decisions to support the ever-changing data landscape on cloud.
• Hands-on with designing and building Data pipelines
• Contribute to setting up value streams in Data Engineering
• Ownership of Data architecture and data flow at scoutbee
• Build Data Ops initiatives as part of long-term plan
• Help Scale scoutbee to millions of suppliers, purchasers and billions of products indexed and cataloged in the knowledge graph
• Design and implement Standard Data APIs

Problems you will be working on

• Running and improving large-scale crawling with Kafka, Spider implemented by Python, CommonCrawl, S3
• Operationalizing pipelines which are written with AWS Step functions, AWS lambdas, SQS
• Running and improving large-scale Machine learning prediction pipelines written with Apache Spark
• Designing, building, and operating the backbone for data enrichment.

What you bring to our team

• 5+ years of experience in the role of a data engineer
• Experience with structured, semi-structured, and unstructured data is a big plus
• Experience with ETL pipelines
• Excellent knowledge of Python
• Solid knowledge of Elasticsearch, Spark, Databricks, Airflow/Prefect/AWS Glue
• Solid knowledge of AWS Data ecosystem - Data lake, S3
• Experience in Monitoring Data pipelines such as Data dog
• Experience with systems such as Kafka, Redis
• Experience with contributions to CI/CD for the data systems such as Github CI/Jenkins/Travis/Semaphore
• A good understanding of Machine learning is a big plus.
• Proficient command of English
• Have experience working in an agile environment
• Excellent team player with ethos in building self-sufficient teams.

What's in it for you?

• Work with a team that is on a mission to revolutionize digital procurement - for better data, better decisions and a better world
• Contribute your ideas and work on challenging projects that will impact the future of modern procurement
• Virtual Stock Option Program for all employees, because ownership at all levels matters
• Development budget and growth paths for your individual learning journey
• Hybrid working model with flexibility for remote work and onsite collaboration
• Benefits supporting your health and wellbeing (Urban Sports Club, Counseling through Better Help, company organized sports activities)
• Kindergarten grant, with priority selection for Kita in our Berlin building (right across the hall!)
• Unlimited access to German and English language courses via Lingoda, adapted to your level and availability

We'd love to hear from you!

At Scoutbee, we’re on a mission to connect. Our employees focus on shared experiences so they can have a more accurate view of the world. This enables us to innovate, challenge our own ideas and assumptions, and be ourselves at work. For us, personality and cultural fit are more important than qualifications. If you’re worried that you don’t quite tick all the boxes, don’t be. We say that not knowing it all can actually be a good thing and we’re more than happy to support – and learn from – our new colleagues while they find their feet at Scoutbee.

Scoutbee is an equal opportunities employer 

All qualified applicants will receive consideration for employment without regard to ethnic background, color, religion, gender, sexual orientation, national origin, age, disability status, protected veteran status, or any other characteristic protected by law.

About Scoutbee

Scoutbee’s market-leading supplier data platform empowers procurement professionals to enhance their master data, make better sourcing decisions, and find and onboard new suppliers from all over the world. Powered by AI and ML, Scoutbee enables faster end-to-end strategic sourcing projects with up to 90% less effort than traditional methods. If you’d like to find out more about what we do, and see what daily life at Scoutbee looks like, please feel free to visit our website or follow us on LinkedIn, Twitter, Facebook, and YouTube.