Mid-Level DevOps Engineer with Databricks Experience

Columbia, Maryland, United States

Applications have closed

#310 Mid-Level DevOps Engineer with Databricks Experience

We are seeking a talented Mid-Level DevOps Engineer with specialized expertise in Databricks to join our dynamic team. The ideal candidate will have a strong foundation in DevOps principles and practices, coupled with extensive experience working with Databricks platforms. As a key team member, you will play a pivotal role in designing, implementing, and maintaining robust infrastructure solutions to support our organization's evolving needs.

Responsibilities:

  • Collaborate with cross-functional teams to understand infrastructure requirements and design scalable, reliable, and secure solutions leveraging Databricks technology.
  • Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for deploying Databricks applications and services.
  • Manage and optimize Databricks clusters to ensure high performance, reliability, and cost-effectiveness.
  • Automate infrastructure provisioning, configuration management, and monitoring using tools such as Terraform, Ansible, and Prometheus.
  • Develop and maintain scripts and tools for monitoring, logging, and troubleshooting Databricks environments.
  • Implement the best security, compliance, and data governance practices within Databricks environments.
  • Collaborate with data engineers and data scientists to streamline data workflows and optimize data processing pipelines.
  • Stay abreast of emerging technologies and industry trends related to Databricks and DevOps practices.
  • Provide technical guidance and support to junior team members as needed.

 

Requirements

Requirements:

    • MUST HAVE HANDS-ON experience working with AWS services like EC2, S3, VPC, EKS, MWAA, etc.
    • Design, develop, and implement data engineering solutions on the Databricks platform.
    • Demonstrated expertise in deploying and managing Databricks clusters, notebooks, and jobs.
    • Experience with infrastructure as code (IaC) tools such as Terraform and configuration management tools like Ansible.
    • Proficiency in scripting languages such as Python, Bash, or PowerShell.
    • Familiarity with containerization technologies such as Docker and container orchestration platforms like Kubernetes.
    • Solid understanding of networking, security, and IAM concepts in cloud environments.
    • Excellent problem-solving skills and the ability to troubleshoot complex issues in distributed systems.

Education/Experience:

    • Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, or a related engineering discipline
    • Total of five (5) years of DevOps experience, with three (3) years of experience working with AWS services such as EC2, S3, RDS, CloudFormation, Lambda, and IAM; and with at least one (1) - two (2) years of hands-on experience working with Databricks.
    • Strong communication skills and the ability to effectively collaborate with cross-functional teams.
    • Experience in developing and deploying scalable cloud solutions and services for the federal sector (required)
    • HHS/CMS AWS Cloud experience (preferred)
    • Possessing one (1) professional and one (1) specialty AWS certification is desirable.

Preferred Qualifications:

    • Databricks Certification(s) is a plus.
    • Experience with big data technologies like Apache Spark, Hadoop, or Kafka.
    • Familiarity with monitoring and logging tools such as Prometheus, Grafana, ELK Stack, or Splunk.
    • Knowledge of software development methodologies and version control systems (e.g., Git).

 General:

  • Strong organizational and communication skills
  • Ability to manage multiple tasks and prioritize workload based on the needs of the client
  • Ability to deal with ambiguity and frequent changes in priorities
  • Ability to work with minimal supervision
  • Excellent technical writing skills and proven experience in systems with complex requirements
  • Excellent teamwork and interpersonal skills with the ability to team with others to meet project objectives
  • Understanding of the system development lifecycle as implemented with Agile; SAFe knowledge a plus

Physical Requirements:

  • Prolonged periods of sitting at a desk and working on a computer
  • Must be able to navigate in an office setting unassisted
  • Must be able to lift up to 10 pounds
  • Strong speaking skills, including the ability to articulate thoughts in a clear manner and excellent word enunciation skills are required

Additional Information about this opening:

  • Employees of Next Phase shall, as an enduring obligation throughout their term of employment, adhere to all information security requirements as documented in company policies and procedures
  • Enjoy the flexibility of a hybrid work environment, with three days in the office per week (Tuesday, Thursday, and Friday) and two days working remotely
  • We are committed to your professional growth, providing opportunities for advancement and exposure to exciting projects and initiatives
  • This position is suited for candidates within commuting distance to Columbia, MD, and not eligible for a fully remote schedule
  • As a healthcare and science research company, Next Phase embraces the recommendations from the CDC regarding vaccines for highly infectious diseases. Unless qualified for a religious or medical exemption, employees are required to be vaccinated against COVID-19.
  • We offer a competitive salary, a comprehensive benefits package, and professional growth and development opportunities. If you meet the above requirements and are looking for a challenging and rewarding career opportunity, please submit your application for consideration.
  • The pay range for this job level is a general guideline only, not a compensation or salary guarantee. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, abilities, internal equity, alignment with market data, applicable bargaining agreement (if any), or other laws.

Join us as we continue to innovate and drive excellence in our infrastructure operations using cutting-edge Databricks technology. If you're passionate about DevOps and thrive in a fast-paced, collaborative environment, we'd love to hear from you!

ABOUT NEXT PHASE SOLUTIONS AND SERVICES, INC.

Innovation. It’s What Defines Us.

Next Phase Solutions and Services, Inc. provides insights and solutions for healthcare, engineering, and science research. Next Phase commits to creating an environment where our employees achieve their full potential, increase productivity, and expand their professional and personal horizons. We look for bright, innovative people who achieve results, understand the importance of being productive and supportive team members, and prioritize customer satisfaction. Next Phase leadership is looking for new leaders, scientific and technical subject matter experts, and technically savvy people interested in putting forth the effort and commitment needed to grow our company.

Will you join us to share in the success?

Benefits

Benefits include, but are not limited to:

HEALTH AND WELLNESS BENEFITS

  • Choose from three medical healthcare plans.
  • Dental and Vision Insurance plans.
  • Enjoy a Flexible Spending Account (FSA) and Health Savings Account (HSA), and a company-sponsored Wellness Program.

PERSONAL INSURANCE BENEFITS

  • Next Phase offers life insurance, accidental death, and dismemberment (AD&D) insurance, as well as short-term and long-term disability insurance, all of which are paid for by the company.

PAID LEAVE

  • Employees receive competitive paid time off, including 11 holidays and maternity leave for recovering mothers.

RETIREMENT

  • Next Phase contributes 5% to a 401K plan without requiring employee contributions.

PROFESSIONAL DEVELOPMENT

  • Employees can be reimbursed for professional development expenses such as classes, books, technical certification/testing fees, professional dues/subscriptions, and professional licenses required for their position.

PET INSURANCE

  • You have two options to ensure the happiness and health of your pets.

COMPETITIVE BONUS PROGRAM

  • At Next Phase, we believe in sharing our success with the employees who make it happen!

Next Phase Solutions and Services, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

"EOE, including disability/vets"

“APPLICANTS HAVE RIGHTS UNDER FEDERAL EMPLOYMENT LAWS”

KNOW YOUR RIGHTS: WORKPLACE DISCRIMINATION IS ILLEGAL

FAMILY AND MEDICAL LEAVE ACT (FMLA)

PAY TRANSPARENCY

EMPLOYEE RIGHTS EMPLOYEE POLYGRAPH PROTECTION ACT

YOUR RIGHTS UNDER USERRA

JOB SAFETY AND HEALTH: IT'S THE LAW!

EMPLOYEE RIGHTS UNDER THE FAIR LABOR STANDARDS ACT

NEED ASSISTANCE?

If you are a person with a disability requiring assistance with the electronic submission process, please contact us at HRDirector@npss-inc.com.

Our ADA Process Steps include:

1. Initiate Communication:

Our dedicated HR representatives promptly reach out to applicants to discuss their specific needs and explore how we can support them throughout the application process.

2. Offer Reasonable Accommodations:

Our HR team asks about the nature of assistance needed, ensuring we are ready to provide reasonable accommodations that enable applicants to complete the electronic submission process comfortably.

3. Engage in an Interactive Process:

We engage in open and effective communication with individuals, seeking to understand their limitations and unique requirements.

4. Document the Interaction:

We maintain detailed records of communication and any accommodations provided, ensuring compliance with the ADA and facilitating future inquiries or audits. All documentation is treated confidentially.

5. Ensure Confidentiality:

We prioritize the confidentiality of information related to an applicant's disability, sharing it only with individuals who have a legitimate need to know, such as those involved in providing accommodations.

6. Provide Assistance as Needed:

Based on the applicant's information, our HR representatives offer assistance tailored to accommodate individual disabilities, whether it be additional time, alternative formats, or other reasonable adjustments.

7. Educate Staff:

Our HR staff and relevant personnel are well-versed in ADA requirements and our commitment to providing reasonable accommodations. We provide ongoing training to ensure our team responds appropriately to similar requests, fostering an inclusive and supportive environment.

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Agile Ansible AWS Big Data CI/CD CloudFormation Computer Science Databricks Data governance DevOps Distributed Systems Docker EC2 ELK Engineering Git Grafana Hadoop Kafka Kubernetes Lambda Pipelines Python Research Security Spark Splunk Terraform Testing

Perks/benefits: 401(k) matching Career development Competitive pay Equity Flex hours Flexible spending account Flex vacation Health care Insurance Medical leave Salary bonus Startup environment Wellness

Regions: Remote/Anywhere North America
Country: United States
Job stats:  11  3  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.