Senior Data Engineer, Asset Attribution

Bengaluru, India

Applications have closed

Atlassian

Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.

View company page

Working at Atlassian
Atlassian can hire people in any country where we have a legal entity. Assuming you have eligible working rights and a sufficient time zone overlap with your team, you can choose to work remotely or return to an office as they reopen (unless it’s necessary for your role to be performed in the office). Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Are you passionate about building elegant systems that can power Atlassian products with modern big data technologies?
We are looking for a Senior Data Engineer to join our Asset Attribution Team and build world-class data solutions to power Atlassian products and also develop internal systems to help Atlassian make crucial business decisions throughout the organisation.
On a typical day, you will be working with different stakeholders to understand the business needs and architect/build the data models, data acquisition/ingestion processes, and data applications that can help address business needs. You have got industry experience working with large-scale, high-performance data processing systems (batch and/or streaming) with a “Streaming First” mindset to drive Atlassian’s business growth and improve the product experience. Constantly striving to optimise the data pipelines/infrastructure with the goal of providing data with quality and trust.
You'll own a problem end-to-end, so those skills will come in handy not just to collect, extract, and clean the data, but also to understand the systems that generated it, and automate your analyses and reporting. On an ongoing basis, you'll be responsible for improving the data by adding new sources, coding business rules, and producing new metrics that support the business.
Requirements will be vague, and Iterations will be rapid. You would be nimble and take smart risks. Industry professional with a mindset of continued development of data products & digital innovation to meet evolving stakeholder/customer needs in months and years to come. Your innovation, leadership, craft, and timely deliveries will ensure that new products and features are delivered with top-notch quality and reliability.
More about you
As a Data Engineer, you will have the opportunity to apply your strong technical experience to building analytics data models that support a broad range of analytical requirements across the company. You will work with extended teams to evolve solutions continuously as business processes and requirements change. You enjoy working in a fast-paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code.

On your first day, we'll expect you to have:

  • A BS in Computer Science or equivalent experience with 6+ years of professional experience as a Data Engineer or in a similar role.
  • Proficiency in any modern object-oriented programming language - some combination of Java, Kotlin (preferred), Scala, Python, Node.js, Go
  • Expertise in handling complex problems in a distributed and big data environment
  • Experience in designing data models for optimal storage and retrieval to meet critical product and business requirements.
  • Experience building scalable data pipelines using Databricks, PySpark, SQL leveraging Airflow scheduler/executor framework, or similar scheduling tools.
  • Experience working in a technical environment with cutting-edge technologies like AWS data services (Redshift, Athena, EMR, S3, SQS, Kinesis) or similar Apache projects
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
  • You’re well versed in modern software development practices (Agile, TDD, CICD) and how they can apply to data engineering.
  • Improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues.
  • Working knowledge of relational databases and query authoring (SQL).
  • Be a strong advocate of writing clean code and tests
  • Be an effective collaborator with other engineers to come up with solutions
  • Ability to lead a project from the beginning until completion

We’d be super excited if you have:

  • Experience in data modelling
  • Knowledge of Cloud formation, Terraform, Ansible
  • Experience building self-service tooling and platforms
  • Strong knowledge of DevOps
  • Prior knowledge in working under Databricks environment
More about our benefits
Our offices are open, highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, learning and tuition budgets, fitness reimbursements, five paid volunteer days a year to support your favourite cause, plenty of food and beverages, ergonomic workstations, unique ShipIt days, a company paid trip after five years and more.
Our perks & benefits
To support you at work and play, our perks and benefits include ample time off, an annual education budget, paid volunteer days, and so much more.
About Atlassian
The world’s best teams work better together with Atlassian. From medicine and space travel, to disaster response and pizza deliveries, Atlassian software products help teams all over the planet. At Atlassian, we're motivated by a common goal: to unleash the potential of every team.
We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.
To learn more about our culture and hiring process, explore our Candidate Resource Hub.

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Agile Airflow Ansible Athena AWS Big Data Computer Science Databricks Data pipelines Data quality DevOps Engineering Kinesis Node.js OOP Pipelines PySpark Python RDBMS Redshift Scala SQL Streaming TDD Terraform

Perks/benefits: Career development Flex hours Flex vacation Startup environment Travel

Region: Asia/Pacific
Country: India
Job stats:  3  0  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.