Senior Data Engineer - Azure

Irving - 6011 Connection

Gartner

Gartner provides actionable insights, guidance, and tools that enable faster, smarter decisions and stronger performance on an organization’s mission-critical priorities.

View company page

We are hiring near our Irving, Texas COE.

About Gartner IT:

Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients.  We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner.  Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team.  

About the role:

Gartner is looking for a well-rounded and motivated developer to join its team which is responsible for developing scalable and configurable data engineering pipelines. These efforts will help us curate and deliver data optimally and efficiently to downstream applications. .

What you will do:

  • Participate in architecture design and implementation of high-performance, scalable, and optimized data solutions. 

  • Design, build and automate the deployment of data pipelines and applications to support data scientists and researchers with their reporting and data requirements. 

  • Integrate data from a wide variety of sources, including on premise databases and external data sources with rest APIs and harvesting tools. 

  • Collaborate with internal business units and data science teams on business requirements, data access, processing/transformation and reporting needs and leverage existing and new tools to provide solutions. 

  • Effectively support and partner with businesses on implementation, technical issues, and training on the data lake ecosystem 

  • Work with team on managing AWS resources (EMR, ECS clusters, etc.) and continuously improve deployment process of our applications 

  • Work with administrative resources and support provisioning, monitoring, configuration, and maintenance of AWS tools. 

  • Promote the integration of new cloud technologies and continuously evaluate new tools that will improve the organization’s capabilities while leading to lower total cost of operation. 

  • Support automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins. 

  • Work with the team to implement data governance, access control and identify and reduce security risks. 

What you will need :

Strong IT professional with 5-6 yrs of experience in software development for data engineering using Azure.

The candidate should have strong problem-solving skills along with high on ownership and accountability. 

Must have:

  • 5 + years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics and data science

  • Experience working in different programming languages (Java, python, scala) and  version control tools (Git, Subversion)"Azure Data Factory" or "Data Factory" or "ADF" OR "azure Databricks"  and " data engineer"

  • Experience working with both structured and unstructured data

  • Strong understanding of OOPS, Design principles and Distributed systems and experience of Data Structures and algorithms

  • Experience working in different programming languages (Java, python, scala) and  version control tools (Git, Subversion)"Azure Data Factory" or "Data Factory" or "ADF" OR "azure Databricks"  and " data engineer"

  • Experience working with Spark/ Hive/HDFS 

  • Experience using automated build systems (CI/CD)

  • Experience in Azure

Who you are:

  • Graduate/Post graduate in BE/Btech, ME/MTech or MCA is required or 5 years experience in leu of.

  • Excellent communication and prioritization skills.

  • Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.

  • Owns success – Takes responsibility for successful delivery of the solutions.

  • Strong desire to improve upon their skills in software development, frameworks, and 

Don’t meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.

#Technology

#LI - hybrid

# #LI-GV1

Who are we?

At Gartner, Inc. (NYSE: IT), we deliver actionable, objective insight that drives smarter decisions and stronger performance on an organization’s mission-critical priorities. We’ve grown exponentially since our founding in 1979 and we're proud to have over 19,500 associates globally that support over 15,000 client enterprises in more than 100 countries.

What makes Gartner a great place to work?

Our teams are composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations. We believe that a diversity of experiences makes us stronger—as individuals, as communities and as an organization. That’s why we're recognized worldwide as a great place to work year after year. We've been recognized by Fortune as one of the World’s Most Admired Companies, named a Best Place to Work for LGBTQ Equality by the Human Rights Campaign Corporate Equality Index and a Best Place to Work for Disability Inclusion by the Disability Equality Index. Looking for a place to turn your big ideas into reality? Join #LifeAtGartner

What we offer:

Our people are our most valuable asset, so we invest in them from Day 1. When you join our team, you’ll have access to a vast array of benefits to help you live your life well. These resources are designed to support your physical, financial and emotional well-being. We encourage continued personal and professional growth through ongoing learning and development opportunities. Our employee resource groups, charity match and volunteer programs keep you connected to your internal Gartner community and causes that matter to you.

Gartner believes in fair and equitable pay. A reasonable estimate of the base salary range for this role is 96,000 USD - 130,500 USD. Please note that actual salaries may vary within the range, or be above or below the range, based on factors including, but not limited to, education, training, experience, professional achievement, business need, and location. In addition to base salary, employees will participate in either an annual bonus plan based on company and individual performance, or a role-based, uncapped sales incentive plan. Our talent acquisition team will provide the specific opportunity on our bonus or incentive programs to eligible candidates. We also offer market leading benefit programs including generous PTO, a 401k match up to $7,200 per year, the opportunity to purchase company stock at a discount, and more.


The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to affirmatively seek to advance the principles of equal employment opportunity.

Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company’s career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to ApplicantAccommodations@gartner.com.

Job Requisition ID:86414

By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.

Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy


For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.

Apply now Apply later
  • Share this job via
  • or

Tags: Agile APIs Architecture Arrow AWS Azure CI/CD Data Analytics Databricks Data governance Data pipelines Distributed Systems ECS Engineering ETL Git HDFS Java Pipelines Privacy Python Scala Scrum Security Spark Terraform Unstructured data

Perks/benefits: 401(k) matching Career development Salary bonus Startup environment

Region: North America
Country: United States
Job stats:  81  1  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.