Senior Data Engineer – Azure
Germany - Remote
Rackspace
As a cloud computing services pioneer, we deliver proven multicloud solutions across your apps, data, and security. Maximize the benefits of modern cloud.Responsibilities
- Design and build resilient and efficient data pipelines for batch and real-time streaming
- Architect and design data infrastructure on cloud using Infrastructure-as-Code tools.
- Collaborate with product managers, software engineers, data analysts, and data scientists to build scalable and data-driven platforms and tools.
- Provide technical product expertise, advise on deployment architectures, and handle in-depth technical questions around data infrastructure, PaaS services, design patterns and implementation approaches.
- Collaborate with enterprise architects, data architects, ETL developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities
- Address aspects such as data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modeling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations.
- Lead a team of engineers to deliver impactful results at scale.
- Execute projects with an Agile mindset.
- Build software frameworks to solve data problems at scale.
Technical Requirements
- 10+ years of data engineering experience with a proven track recordand experience leading implementations of large scale lakehouses on Databricks, Snowflake or Synapse. Prior experience using DBT will be a plus. Prior experience with PowerBI will be a plus.
- 5+ years' experience architecting solutions for optimal extraction, transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi-structured using SQL, NoSQL and data pipelines for real-time, streaming, batch and on-demand workloads
- Extensive experience with Azure and its ADS PaaS services and related infrastructure services like firewall, storage, key vault etc. is required.
- 3+ years' experience with analytics/data management strategy formulation, architectural blueprinting and effort estimation of analytics.
- Strong Spark, SQL, Data Modeling, Data lakehouse concepts.
- Strong programming / scripting experience using SQL and python.
- Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, TFS, Shell, PowerShell, Bitbucket.
- Experience with Agile development methods in data-oriented projects
- Certifications in architecture, data engineering and development on Azure Cloud
Other Requirements
- Highly motivated self-starter and team player and demonstrated success in prior roles.
- Track record of success working through technical challenges within enterprise organizations
- Ability to prioritize deals, training, and initiatives through highly effective time management
- Excellent problem solving, analytical, presentation, and whiteboarding skills
- Track record of success dealing with ambiguity (internal and external) and working collaboratively with other departments and organizations to solve challenging problems
- Strong knowledge of technology and industry trends that affect data analytics decisions for enterprise organizations
- Based In Germany
- #LI-JB2
- #LI-Remote
About Rackspace TechnologyWe are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future. More on Rackspace TechnologyThough we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture Azure Bitbucket Business Analytics Data Analytics Databricks Data management Data pipelines dbt Engineering ETL Git Jira NoSQL Pipelines Power BI Privacy Python Security Snowflake Spark SQL Streaming
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Manager jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Science Manager jobs
- Open Principal Data Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs