Senior Data Engineer, Asset Attribution
Bengaluru, India
Applications have closed
Atlassian
Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.Atlassian can hire people in any country where we have a legal entity. Assuming you have eligible working rights and a sufficient time zone overlap with your team, you can choose to work remotely or return to an office as they reopen (unless it’s necessary for your role to be performed in the office). Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Are you passionate about building elegant systems that can power Atlassian products with modern big data technologies?
We are looking for a Senior Data Engineer to join our Asset Attribution Team and build world-class data solutions to power Atlassian products and also develop internal systems to help Atlassian make crucial business decisions throughout the organisation.
On a typical day, you will be working with different stakeholders to understand the business needs and architect/build the data models, data acquisition/ingestion processes, and data applications that can help address business needs. You have got industry experience working with large-scale, high-performance data processing systems (batch and/or streaming) with a “Streaming First” mindset to drive Atlassian’s business growth and improve the product experience. Constantly striving to optimise the data pipelines/infrastructure with the goal of providing data with quality and trust.
You'll own a problem end-to-end, so those skills will come in handy not just to collect, extract, and clean the data, but also to understand the systems that generated it, and automate your analyses and reporting. On an ongoing basis, you'll be responsible for improving the data by adding new sources, coding business rules, and producing new metrics that support the business.
Requirements will be vague, and Iterations will be rapid. You would be nimble and take smart risks. Industry professional with a mindset of continued development of data products & digital innovation to meet evolving stakeholder/customer needs in months and years to come. Your innovation, leadership, craft, and timely deliveries will ensure that new products and features are delivered with top-notch quality and reliability.
More about you
As a Data Engineer, you will have the opportunity to apply your strong technical experience to building analytics data models that support a broad range of analytical requirements across the company. You will work with extended teams to evolve solutions continuously as business processes and requirements change. You enjoy working in a fast-paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code.
On your first day, we'll expect you to have:
- A BS in Computer Science or equivalent experience with 6+ years of professional experience as a Data Engineer or in a similar role.
- Proficiency in any modern object-oriented programming language - some combination of Java, Kotlin (preferred), Scala, Python, Node.js, Go
- Expertise in handling complex problems in a distributed and big data environment
- Experience in designing data models for optimal storage and retrieval to meet critical product and business requirements.
- Experience building scalable data pipelines using Databricks, PySpark, SQL leveraging Airflow scheduler/executor framework, or similar scheduling tools.
- Experience working in a technical environment with cutting-edge technologies like AWS data services (Redshift, Athena, EMR, S3, SQS, Kinesis) or similar Apache projects
- Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
- You’re well versed in modern software development practices (Agile, TDD, CICD) and how they can apply to data engineering.
- Improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues.
- Working knowledge of relational databases and query authoring (SQL).
- Be a strong advocate of writing clean code and tests
- Be an effective collaborator with other engineers to come up with solutions
- Ability to lead a project from the beginning until completion
We’d be super excited if you have:
- Experience in data modelling
- Knowledge of Cloud formation, Terraform, Ansible
- Experience building self-service tooling and platforms
- Strong knowledge of DevOps
- Prior knowledge in working under Databricks environment
Our offices are open, highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, learning and tuition budgets, fitness reimbursements, five paid volunteer days a year to support your favourite cause, plenty of food and beverages, ergonomic workstations, unique ShipIt days, a company paid trip after five years and more.
Our perks & benefits
To support you at work and play, our perks and benefits include ample time off, an annual education budget, paid volunteer days, and so much more.
About Atlassian
The world’s best teams work better together with Atlassian. From medicine and space travel, to disaster response and pizza deliveries, Atlassian software products help teams all over the planet. At Atlassian, we're motivated by a common goal: to unleash the potential of every team.
We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.
To learn more about our culture and hiring process, explore our Candidate Resource Hub.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Ansible Athena AWS Big Data Computer Science Databricks Data pipelines Data quality DevOps Engineering Kinesis Node.js OOP Pipelines PySpark Python RDBMS Redshift Scala SQL Streaming TDD Terraform
Perks/benefits: Career development Flex hours Flex vacation Startup environment Travel
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs
- Open Hadoop-related jobs