Senior Data Engineer

Bengaluru, India

Applications have closed

Atlassian

Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.

View company page

Atlassian can hire people in any country where we have a legal entity, assuming candidates have eligible working rights and a sufficient timezone overlap with their team. As our offices re-open, Atlassians can choose to work remotely or return to an office, unless it’s necessary for the role to be performed in the office. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Atlassian is looking for a Senior Data Engineer to join our Data Engineering Team and build world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights, and play an active role in building Atlassian’s data-driven culture. You love thinking about the ways the business can consume data and then figuring out how to build it.
On a typical day, you may be consulted on the Information Architecture of our Data Lake and help design and/or optimize the event collection infrastructure. You will be working with different stakeholders to understand the business needs and architect/build the data models, data acquisition/ingestion processes and data applications that can help address business needs. You have got industry experience working with large scale, high-performance data processing systems (batch and/or streaming) with a “Streaming First” mindset to drive Atlassian’s business growth and improve the product experience. Constantly striving to optimize the data pipelines/infrastructure with the goal of providing data with quality and trust. As the data domain expert, you will be partnering with our Technology Team, Global Analytical Team, and Data Scientists across various initiatives.
You'll own a problem end-to-end, so those skills will come in handy not just to collect, extract, and clean the data, but also to understand the systems that generated it, and automate your analyses and reporting. On an ongoing basis, you'll be responsible for improving the data by adding new sources, coding business rules, and producing new metrics that support the business. Requirements will be vague, and Iterations will be rapid. You will need to be nimble and take smart risks. Industry professional with a mindset of continued development of data products & digital innovation to meet evolving stakeholder/customer needs in months and years to come.
More about you

On your first day, we'll expect you to have:

  • A BS in Computer Science or equivalent experience with 5+ years professional experience as a Sr. Data Engineer or in a similar role.
  • Strong programming skills using Python & Java (good to have).
  • Experience in designing data models for optimal storage and retrieval to meet critical product and business requirements.
  • Experience building scalable data pipelines using Spark leveraging Airflow scheduler/executor framework or similar scheduling tools.
  • Experience working in a technical environment with cutting-edge technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, Kafka).
  • Ability to understand and influence logging to support our data flow, architecting logging framework & best practices where needed.
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
  • You’re well versed in modern software development practices (Agile, TDD, CICD) and how they can apply to data engineering.
  • Improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues.
  • Working knowledge of relational databases and query authoring (SQL).

We’d be super excited if you have:

  • Experience with ML engineering.
  • Followed a Kappa architecture with any of your previous deployments
  • Experience working with SaaS companies.
  • Domain knowledge of Order Management, Entitlement, Billing, Financial, and People systems.
Above all, as a senior data engineer, you will be leading the development process, driving architectural decisions, and incorporating business and technology strategy. You will be earning the trust of other developers in the team and then coaching and influencing them into the right behaviors to build the ultimate analytical data model and pipelines.
More about the teamThe data engineering team is responsible for managing multiple analytical data models and data pipelines all across Atlassian, including finance, growth, product analysis, customer support, sales, marketing, etc. - so there are endless opportunities for growth. We maintain Atlassian's data lake and build creative and reliable analytics data models that provide a unified way of analyzing our customers, our products, our operations, and the interactions among them.You’ll be joining a team that is crazy smart and very direct. We ask hard questions and challenge each other to constantly improve our work. We are self-driven but team-oriented. We're all about enabling growth by delivering the right data and insights in the right way to partners across the company.
More about our benefits
Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
If your experience looks a little different from what we’ve identified and you think you can rock the role, we’d love to learn more about you.
Learn more about Atlassian’s culture, interviewing flow, and hiring process by checking out our Candidate Resource Hub.

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Agile Airflow Athena AWS Bitbucket Computer Science Data pipelines Engineering Finance Flink Jira Kafka Machine Learning Pipelines Python RDBMS Redshift Spark SQL Streaming TDD

Perks/benefits: Career development Flex hours Flex vacation Startup environment Travel

Region: Asia/Pacific
Country: India
Job stats:  0  0  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.