Data Engineer, GTM
Bengaluru, India
Applications have closed
Atlassian
Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.Job Description
Atlassian is looking for a Data Engineer to join our Go-To-Market Data Engineering (GTM-DE) team which is responsible for building our data lake, maintaining our big data pipelines/services, and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.On a typical day, you will help our stakeholder teams ingest data faster into our data lake, you’ll find ways to make our data pipelines more efficient, or even come up with ideas to help instigate self-serve data engineering within the company. Then you will move on to building micro-services, architecting, designing, and enabling self-serve capabilities at scale to help Atlassian grow.You’ll get the opportunity to work on a AWS based data lake backed by the full suite of open source projects such as Presto, Spark, Airflow and Hive. We are a team with little legacy in our tech stack and as a result you’ll spend less time paying off technical debt and more time identifying ways to make our platform better and improve our users experience.
More about you
As a data engineer in the GTM-DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.
On your first day, we'll expect you to have:At least 2 years professional experience as a software engineer or data engineerA BS in Computer Science or equivalent experienceStrong programming skills (some combination of Python, Java, and Scala preferred)Experience with data modelingKnowledge of data warehousing conceptsExperience writing SQL, structuring data, and data storage practicesExperienced building data pipelines and micro servicesExperience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming dataA willingness to accept failure, learn and try againAn open mind to try solutions that may seem crazy at firstExperience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)
It's preferred, but not technically required, that you have:Experience building self-service tooling and platformsBuilt and designed Kappa architecture platformsA passion for building and running continuous integration pipelines.Built pipelines using Databricks and well versed with their API’sContributed to open source projects (Ex: Operators in Airflow)
More about the team
Data is a BIG deal at Atlassian. We ingest over 180 billion events each month into our analytics platform and we have dozens of teams across the company driving their decisions and guiding their operations based on the data and services we provide.It’s the data engineering teams job to make more Atlassian’s data-driven and facilitate growth. We do this by providing metrics and other data elements which are reliable and trustworthy, as well as services and data products to help teams better self-serve and improve their time to reliable insights.You’ll be joining a team with a brand new mission, expanding into a new office. There will be plenty of challenges and scope to grow. We work very closely with Sales, Marketing and Commerce teams. We value when people ask hard questions and challenge each other to constantly improve our work. We are independent but love highly collaborative team environments, so you'll get the opportunity to work with lots of other awesome people just like you. We're all about enabling teams to execute growth and customer retention strategies by providing the right data fabrics and tools.
More about our benefits
Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
If your experience looks a little different from what we’ve identified and you think you can rock the role, we’d love to learn more about you.
Learn more about Atlassian’s culture, interviewing flow, and hiring process by checking out our Candidate Resource Hub.
Tags: Airflow APIs AWS Big Data Bitbucket Computer Science Databricks Data pipelines Data Warehousing Engineering Jira Kinesis Open Source Pipelines Python Scala Spark SQL Streaming
Perks/benefits: Career development Flex hours Flex vacation Team events Travel
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Data Manager jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Big Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Research Scientist jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open PhD-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs