Senior Data Engineer

San Francisco, United States

Atlassian logo
Atlassian
Apply now

Posted 2 weeks ago

Atlassian is continuing to hire for all open roles with all interviewing and on-boarding done virtually due to COVID-19. Everyone new to the team, along with our current staff, will temporarily work from home until it is safe to return to our offices.
JOB DUTIES: 
BUILD SOFTWARE SOLUTIONS USING PUBLIC CLOUD OFFERINGS, BIG DATA PROCESSING, AND STORAGE TECHNOLOGIES TO DEVELOP WORLD-CLASS DATA SOLUTION THAT POWERS CRUCIAL BUSINESS DECISIONS THROUGHOUT THE ORGANIZATION. COLLECT, EXTRACT, CLEAN, AND ORGANIZE DATA ACROSS MULTIPLE DATASETS BASED ON DEEP UNDERSTANDING OF BIG DATA CHALLENGES AND ECO-SYSTEM. MANAGE PROCESS TO MAKE DATA ACTIONABLE BY UTILIZING SOLUTION BUILDING AND ARCHITECTING WITH PUBLIC CLOUD OFFERINGS SUCH AS AMAZON WEB SERVICES, REDSHIFT, S3, EMR/SPARK, PRESTO/ATHENA. OWN PROBLEM END-TO-END BY MAINTAINING AN UNDERSTANDING OF THE SYSTEMS THAT GENERATES DATA AND AUTOMATES THE ANALYSES AND REPORTING BASED ON EXPERTISE IN DATA PIPELINE WITH SUCH WORKFLOW TOOLS AS AIRFLOW, OOZIE OR LUIGI. DESIGN MARKETING DATA INFRASTRUCTURE BASED ON THE INFORMATION ARCHITECTURE OF COMPANY’S WEBSITE BASED ON EXPERIENCE WITH SPARK AND HIVE. IMPROVE DATA BY ADDING NEW SOURCES, CODING BUSINESS RULES, AND PRODUCING NEW METRICS THAT SUPPORT THE BUSINESS BASED ON TEST AUTOMATION AND CONTINUOUS DELIVERY WHILE ENSURING DATA QUALITY ACROSS MULTIPLE DATASETS USED FOR ANALYTICAL PURPOSES. UTILIZE KNOWLEDGE OF SQL, QUERY TUNING, SCHEMA DESIGN, ETL PROCESSES, TEST AUTOMATION, CONTINUOUS DELIVERY, CONTINUOUS INTEGRATION, AND SOURCE CONTROL SYSTEM SUCH AS GIT. POSSESS SOLID UNDERSTANDING EXPERIENCE IN BUILDING RESTFUL APIS AND MICROSERVICES, E.G. WITH FLASK.
MINIMUM REQUIREMENTS: 
MASTER’S DEGREE IN COMPUTER SCIENCE OR RELATED FIELD OF STUDY PLUS TWO (2) YEARS OF EXPERIENCE IN DATA ENGINEERING WITH TEST AUTOMATION AND CONTINUOUS DELIVERY, ENSURING DATA QUALITY ACROSS MULTIPLE DATASETS USED FOR ANALYTICAL PURPOSES, SOLUTION BUILDING AND ARCHITECTING WITH PUBLIC CLOUD OFFERINGS SUCH AS AMAZON WEB SERVICES, REDSHIFT, S3, EMR/SPARK, PRESTO/ATHENA, LAMBDA ARCHITECTURE OR OTHER BIG DATA ARCHITECTURAL BEST PRACTICES AND WITH SPARK AND HIVE.
ALTERNATE REQUIREMENTS: 
BACHELOR’S DEGREE IN COMPUTER SCIENCE OR RELATED FIELD OF STUDY PLUS FIVE (5) YEARS OF PROGRESSIVE EXPERIENCE IN DATA ENGINEERING WITH TEST AUTOMATION AND CONTINUOUS DELIVERY, ENSURING DATA QUALITY ACROSS MULTIPLE DATASETS USED FOR ANALYTICAL PURPOSES, SOLUTION BUILDING AND ARCHITECTING WITH PUBLIC CLOUD OFFERINGS SUCH AS AMAZON WEB SERVICES, REDSHIFT, S3, EMR/SPARK, PRESTO/ATHENA, LAMBDA ARCHITECTURE OR OTHER BIG DATA ARCHITECTURAL BEST PRACTICES AND WITH SPARK AND HIVE.
TRAVEL REQUIREMENTS: 
UP TO 10% DOMESTIC TRAVELSMore about our benefits
Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.
More about Atlassian
Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.
Additional Information
We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Job tags: Airflow Big Data Engineering ETL Marketing Redshift Spark SQL Travel