Data Engineer
Bengaluru, India
Applications have closed
Atlassian
Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.Are you passionate about data and the ability to use data to drive our business? If so this role with our team at Atlassian is for you! As a Data Engineer on the Customers Success and Support team, you'll be driving our business to scale by building and improving our data infrastructure and pipelines.Some examples of what you will be doing are:Architect, build, launch, and manage data models to enable analytics and ITDesign, build, improve, and manage data pipelines and ETL jobsCreate ETL scripts using SparkSQL, PySpark, and PythonAutomate data pipeline and reporting processesBuild data expertise and own data quality for the awesome pipelines you build
Some of the tools/languages/systems you'll use are:Spark, Postgres, Presto, PySparkAmazon EC2, EMR, S3PythonDockerSourceTree and BitbucketGitLinux Shell
You'll work together with other data engineers, analysts, project managers, and subject matter experts to deliver impactful outcomes to the organization. You'll participate in high-visibility projects along with ad-hoc questions from your internal customers.We continually require modifications to the data pipeline for improvements in quality, speed, and features. In this role, you'll focus on building out the future state of our data pipeline. You'll help design event collection infrastructure, build data models, and ETL processes to collect, extract, and clean the data for subsequent reporting and analysis. The target is to make our data model more scalable, reliable, maintainable, and better integrated with other Atlassian data models.
Required Experience:
- BS/BA in Computer Science, Engineering, Information Management or other technical fields, or 2-3 years of data engineering experience
- High proficiency in SQL/Spark, preferably in a distributed computing environment in order to profile, cleanse, transform, and analyze data
- Proven ability to work with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column store (e.g. Redshift)
- Experience in some scripting languages (Python, Shell, JavaScript, etc.). You can build/maintain transformation scripts for different types of data.
- Experience with data modeling for analysis and reporting, REST APIs, and Spark
- Experience with Git or other version control systems
- Experience with automation, scheduling and workflow frameworks, and principles
- Good business acumen, communication skills, critical thinking, and agile software development methodologies
- You're the type of person that publishes good documentation to help people use the information you provide. You pay meticulous attention to end-to-end data quality, validation, and consistency
More about our benefits
Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
If your experience looks a little different from what we’ve identified and you think you can rock the role, we’d love to learn more about you.
Learn more about Atlassian’s culture, interviewing flow, and hiring process by checking out our Candidate Resource Hub.
Tags: Agile APIs Bitbucket Computer Science Data pipelines EC2 Engineering ETL Git JavaScript Jira Pipelines PostgreSQL PySpark Python RDBMS Redshift Spark SQL
Perks/benefits: Career development Flex hours Flex vacation Startup environment Travel
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open NLP-related jobs
- Open Airflow-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs