Data Engineer
San Francisco, United States
Applications have closed
Atlassian
Atlassian's team collaboration software like Jira, Confluence and Trello help teams organize, discuss, and complete shared work.Atlassian is looking for an experienced Data Engineer to join the Data Engineering team and build data solutions and applications that power business decisions across the organization.As the data specialist, you will be partnering with a cross-functional team consisting of Information Technology, data platform, product engineering, analytics teams, and data scientists across various initiatives. You are an empathetic, structured problem solver who is passionate about building systems at scale. Requirements may be vague, but the iterations will be rapid, and you need to take smart and calculated risks.About the Team
The Data Engineering team is responsible for building and managing data pipelines and data visualizations that powers analytics, insights, machine learning, and AI across Atlassian, including finance, growth, product analysis, customer support, sales, marketing, and people functions. We maintain Atlassian's Enterprise data lake and build a creative, reliable, and scalable analytics data model that provides a unified way of analyzing our customers, our products, our operations and drives growth and innovations while improving operational excellence.You'll be joining a team that is crazy smart and very direct. We ask hard questions and challenge each other to improve our work continually. We are self-driven yet collaborative. We're all about enabling growth by delivering the right data and insights in the right way to partners across the company.
What you will do in this role:
- Partner with Product Manager, analytics, and business teams to review and gather the data/reporting/analytics requirements and build trusted and scalable data models, data extraction processes, and data applications to help answer complex questions.
- Design, build, test, and maintain scalable data pipelines and microservices sourcing both first-party and third-party datasets and store using distributed (cloud) structures and other applicable storage forms such as graph databases and relational NoSQL databases.
- Build high volume, distributed, and scalable data platform capabilities and microservices to create efficient and scalable data solutions to enable data access by applications via API.
- Build utilities, user-defined functions, libraries, and frameworks to better enable data flow patterns
- Develop analytical data models and dashboards to serve the needs of insights and analytics
- Constantly strive to optimize the data models to provide data with quality and trust.
- Utilize and advance continuous integration and deployment frameworks
- Work with architecture & engineering leads to ensure quality solutions are implemented and engineering standard methodologies adhered to.
- Research, evaluate and utilize new technologies/tools/frameworks centered around high-volume data processing.
- Leverage artificial intelligence, machine learning, and other big-data techniques to provide a competitive edge to the business.
Skills you need to be successful in the role:
- Empathetic, structured problem solver who is passionate about building systems at scale.
- Solid understanding of disciplines such as database engineering and software development.
- Proficient in database schema design, analytical and operational data modeling
- Proven experience working with large datasets and big data ecosystem for computing (spark, Kafka, Hive or similar), orchestration tools (airflow, oozie, luigi), and storage(S3, Hadoop, DBFS)
- Complete understanding of microservices guiding principles to design and build restful API's to allow other systems to be integrated and consume data off of data repositories(Data Lake, SSOT/MDM)
- Experience with modern databases (Redshift, Dynamo DB, Mongo DB, Postgres or similar)
- Proficient in one or more programming languages such as Java, Python, Scala, etc. and rock-solid SQL skills.
- Champions automated builds and deployments using CICD tools like Bitbucket, Git
- Experience in developing, publishing, and maintaining sophisticated reports/dashboards/visualization, using tools like Tableau, Redash, or d3js.
- Strong hands-on experience in designing and developing curated datasets for data science and machine learning
- Prior experience working with Analytics and with Data Science teams
- Proven analytical, communication, and organizational skills and the ability to prioritize multiple tasks at a given time.
- An open mind to try solutions that may seem astonishing at first
- A BS in Computer Science or equivalent experience
Skills not required but good to have:
- Experience working for SAAS companies
- Experience with Machine Learning
- Committed code to open source projects
- Experience building self-service tooling and platforms
Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
If your experience looks a little different from what we’ve identified and you think you can rock the role, we’d love to learn more about you.
Learn more about Atlassian’s culture, interviewing flow, and hiring process by checking out our Candidate Resource Hub.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Tags: Airflow APIs Big Data Bitbucket Computer Science Data pipelines Engineering Finance Git Hadoop Jira Kafka Machine Learning Microservices NoSQL Oozie Open Source Pipelines PostgreSQL Python Redshift Research Scala Spark SQL Tableau
Perks/benefits: Career development Flex hours Flex vacation Startup environment Travel
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open LLMs-related jobs
- Open Airflow-related jobs
- Open Data warehouse-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs