Senior Data Engineer
Bengaluru, India
Applications have closed
Atlassian
Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.Atlassian is looking for a Senior Data Engineer to join our Data Engineering Team and build world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights, and play an active role in building Atlassian’s data-driven culture. You love thinking about the ways the business can consume data and then figuring out how to build it.
On a typical day, you may be consulted on the Information Architecture of our Data Lake and help design and/or optimize the event collection infrastructure. You will be working with different stakeholders to understand the business needs and architect/build the data models, data acquisition/ingestion processes and data applications that can help address business needs. You have got industry experience working with large scale, high-performance data processing systems (batch and/or streaming) with a “Streaming First” mindset to drive Atlassian’s business growth and improve the product experience. Constantly striving to optimize the data pipelines/infrastructure with the goal of providing data with quality and trust. As the data domain expert, you will be partnering with our Technology Team, Global Analytical Team, and Data Scientists across various initiatives.
You'll own a problem end-to-end, so those skills will come in handy not just to collect, extract, and clean the data, but also to understand the systems that generated it, and automate your analyses and reporting. On an ongoing basis, you'll be responsible for improving the data by adding new sources, coding business rules, and producing new metrics that support the business. Requirements will be vague, and Iterations will be rapid. You will need to be nimble and take smart risks. Industry professional with a mindset of continued development of data products & digital innovation to meet evolving stakeholder/customer needs in months and years to come.
More about you
On your first day, we'll expect you to have:
- A BS in Computer Science or equivalent experience with 5+ years professional experience as a Sr. Data Engineer or in a similar role.
- Strong programming skills using Python & Java (good to have).
- Experience in designing data models for optimal storage and retrieval to meet critical product and business requirements.
- Experience building scalable data pipelines using Spark leveraging Airflow scheduler/executor framework or similar scheduling tools.
- Experience working in a technical environment with cutting-edge technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, Kafka).
- Ability to understand and influence logging to support our data flow, architecting logging framework & best practices where needed.
- Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
- You’re well versed in modern software development practices (Agile, TDD, CICD) and how they can apply to data engineering.
- Improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues.
- Working knowledge of relational databases and query authoring (SQL).
We’d be super excited if you have:
- Experience with ML engineering.
- Followed a Kappa architecture with any of your previous deployments
- Experience working with SaaS companies.
- Domain knowledge of Order Management, Entitlement, Billing, Financial, and People systems.
More about the teamThe data engineering team is responsible for managing multiple analytical data models and data pipelines all across Atlassian, including finance, growth, product analysis, customer support, sales, marketing, etc. - so there are endless opportunities for growth. We maintain Atlassian's data lake and build creative and reliable analytics data models that provide a unified way of analyzing our customers, our products, our operations, and the interactions among them.You’ll be joining a team that is crazy smart and very direct. We ask hard questions and challenge each other to constantly improve our work. We are self-driven but team-oriented. We're all about enabling growth by delivering the right data and insights in the right way to partners across the company.
More about our benefits
Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
If your experience looks a little different from what we’ve identified and you think you can rock the role, we’d love to learn more about you.
Learn more about Atlassian’s culture, interviewing flow, and hiring process by checking out our Candidate Resource Hub.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Athena AWS Bitbucket Computer Science Data pipelines Engineering Finance Flink Jira Kafka Machine Learning Pipelines Python RDBMS Redshift Spark SQL Streaming TDD
Perks/benefits: Career development Flex hours Flex vacation Startup environment Travel
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs