Data Engineering Manager
Remote, United States
Applications have closed
Atlassian
Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.Atlassian is looking for a Data Engineering Manager to join our Data Engineering team and build world-class data solutions and applications that powers crucial business decisions throughout the organization. We are looking for an open minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights, and play an active role in building Atlassian’s data driven culture. You love thinking about the ways the business can consume data and then figuring out how to build it.
On a typical day, you may be consulted on the information architecture of our data lake and help design and/or optimize the event collection infrastructure. You will be working with different stakeholders to understand the business needs and architect/build the data models, data acquisition/ingestion processes and data applications that can help address those needs. You have got industry experience working with large scale, high-performance data processing systems (batch and/or streaming) to drive Atlassian’s business growth and improve the product experience. Constantly striving to optimize the data pipelines/infrastructure with the goal of providing data with quality and trust. As the data domain expert, you will be partnering with our technology teams, analytical teams, and data scientists across various initiatives.
You'll lead the team and own a problem end-to-end, providing solutions by understanding the systems that generated it and automate your analyses and reporting. On an on-going basis, you'll be responsible for defining and implementing data engineering best practices and improving the data by adding new sources, coding business rules, and producing new metrics that support the business. Requirements will be vague, and Iterations will be rapid. You will need to be nimble and take smart risks.More about you
As a data engineering manager, you will have the opportunity to apply your strong technical experience on expanding existing analytics data models that supports a broad range of analytical requirements across the company. You will work with extended teams to continually evolve solutions as business processes and requirements change. You enjoy working in a fast-paced environment and you are able to take vague requirements and transform them into solid framework-based solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to hands on writing the code.
On your first day, we'll expect you to have:
- A BS in Computer Science or equivalent experience with 10+ years professional experience with 4+ years of experience managing data engineering team or in a similar role
- Develop and execute data roadmap aligning with product, global analytics, engineering, platform, data science strategy teams
- Manage and elevate team members with the ability to get the best out of them and build strong engagement and grow their careers
- Build partnerships with cross-functional teams to have better collaboration with engineering, product management, analytics, data science, and platform
- Interface with our global analytics team and other stakeholders, gathering requirements and delivering solutions
- Manage and execute data lake plans for a product or a group of products to solve well-scoped problems
- Identify the data needed for a business problem and implement data observability required to ensure quality, completeness & availability of data, with proactive altering solutions
- Build data expertise and leverage data controls to ensure privacy, security, compliance, and operations for allocated areas of ownership
- Build the data products, features, tools and frameworks that enable and empowering data engineering, analytics teams across Atlassian with our data
- Programming skills using Python & Java (good to have)
- Experience in designing data models for optimal storage and retrieval to meet critical product and business requirements
- Experience building scalable data pipelines using Spark leveraging Airflow scheduler/executor framework or similar scheduling tool
- Experience working in a technical environment with cutting-edge technologies like AWS data services (S3, Redshift/snowflake, Athena, EMR) or similar, Apache projects (Spark, Flink, Hive, Kafka/Kinesis)
- Ability to understand and influence logging to support our data flow, architecting logging framework & best practices where needed
- Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
- You’re well versed in modern software development practices (Agile, TDD, CICD) and how they can apply to data engineering
- Working knowledge of relational databases and query authoring (SQL)
- Experience with SaaS companies
- We’d be super excited if you have experience with ML engineering
- Followed a Data mesh architecture with any of your previous deployments
- Experience managing a team across multiple geo’s
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
Tags: Agile Airflow Athena AWS Bitbucket Computer Science Data pipelines Engineering Finance Flink Jira Kafka Kinesis Machine Learning Pipelines Python RDBMS Redshift Security Snowflake Spark SQL Streaming TDD
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open ETL Developer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open DevOps-related jobs
- Open LLMs-related jobs