Mid-Level DevOps Engineer with Databricks Experience
Columbia, Maryland, United States
#310 Mid-Level DevOps Engineer with Databricks Experience
We are seeking a talented Mid-Level DevOps Engineer with specialized expertise in Databricks to join our dynamic team. The ideal candidate will have a strong foundation in DevOps principles and practices, coupled with extensive experience working with Databricks platforms. As a key team member, you will play a pivotal role in designing, implementing, and maintaining robust infrastructure solutions to support our organization's evolving needs.
Responsibilities:
- Collaborate with cross-functional teams to understand infrastructure requirements and design scalable, reliable, and secure solutions leveraging Databricks technology.
- Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for deploying Databricks applications and services.
- Manage and optimize Databricks clusters to ensure high performance, reliability, and cost-effectiveness.
- Automate infrastructure provisioning, configuration management, and monitoring using tools such as Terraform, Ansible, and Prometheus.
- Develop and maintain scripts and tools for monitoring, logging, and troubleshooting Databricks environments.
- Implement the best security, compliance, and data governance practices within Databricks environments.
- Collaborate with data engineers and data scientists to streamline data workflows and optimize data processing pipelines.
- Stay abreast of emerging technologies and industry trends related to Databricks and DevOps practices.
- Provide technical guidance and support to junior team members as needed.
Requirements
Requirements:
- MUST HAVE HANDS-ON experience working with AWS services like EC2, S3, VPC, EKS, MWAA, etc.
- Design, develop, and implement data engineering solutions on the Databricks platform.
- Demonstrated expertise in deploying and managing Databricks clusters, notebooks, and jobs.
- Experience with infrastructure as code (IaC) tools such as Terraform and configuration management tools like Ansible.
- Proficiency in scripting languages such as Python, Bash, or PowerShell.
- Familiarity with containerization technologies such as Docker and container orchestration platforms like Kubernetes.
- Solid understanding of networking, security, and IAM concepts in cloud environments.
- Excellent problem-solving skills and the ability to troubleshoot complex issues in distributed systems.
Education/Experience:
- Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, or a related engineering discipline
- Total of five (5) years of DevOps experience, with three (3) years of experience working with AWS services such as EC2, S3, RDS, CloudFormation, Lambda, and IAM; and with at least one (1) - two (2) years of hands-on experience working with Databricks.
- Strong communication skills and the ability to effectively collaborate with cross-functional teams.
- Experience in developing and deploying scalable cloud solutions and services for the federal sector (required)
- HHS/CMS AWS Cloud experience (preferred)
- Possessing one (1) professional and one (1) specialty AWS certification is desirable.
Preferred Qualifications:
- Databricks Certification(s) is a plus.
- Experience with big data technologies like Apache Spark, Hadoop, or Kafka.
- Familiarity with monitoring and logging tools such as Prometheus, Grafana, ELK Stack, or Splunk.
- Knowledge of software development methodologies and version control systems (e.g., Git).
General:
- Strong organizational and communication skills
- Ability to manage multiple tasks and prioritize workload based on the needs of the client
- Ability to deal with ambiguity and frequent changes in priorities
- Ability to work with minimal supervision
- Excellent technical writing skills and proven experience in systems with complex requirements
- Excellent teamwork and interpersonal skills with the ability to team with others to meet project objectives
- Understanding of the system development lifecycle as implemented with Agile; SAFe knowledge a plus
Physical Requirements:
- Prolonged periods of sitting at a desk and working on a computer
- Must be able to navigate in an office setting unassisted
- Must be able to lift up to 10 pounds
- Strong speaking skills, including the ability to articulate thoughts in a clear manner and excellent word enunciation skills are required
Additional Information about this opening:
- Employees of Next Phase shall, as an enduring obligation throughout their term of employment, adhere to all information security requirements as documented in company policies and procedures
- Enjoy the flexibility of a hybrid work environment, with three days in the office per week (Tuesday, Thursday, and Friday) and two days working remotely
- We are committed to your professional growth, providing opportunities for advancement and exposure to exciting projects and initiatives
- This position is suited for candidates within commuting distance to Columbia, MD, and not eligible for a fully remote schedule
- As a healthcare and science research company, Next Phase embraces the recommendations from the CDC regarding vaccines for highly infectious diseases. Unless qualified for a religious or medical exemption, employees are required to be vaccinated against COVID-19.
- We offer a competitive salary, a comprehensive benefits package, and professional growth and development opportunities. If you meet the above requirements and are looking for a challenging and rewarding career opportunity, please submit your application for consideration.
- The pay range for this job level is a general guideline only, not a compensation or salary guarantee. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, abilities, internal equity, alignment with market data, applicable bargaining agreement (if any), or other laws.
Join us as we continue to innovate and drive excellence in our infrastructure operations using cutting-edge Databricks technology. If you're passionate about DevOps and thrive in a fast-paced, collaborative environment, we'd love to hear from you!
ABOUT NEXT PHASE SOLUTIONS AND SERVICES, INC.
Innovation. It’s What Defines Us.
Next Phase Solutions and Services, Inc. provides insights and solutions for healthcare, engineering, and science research. Next Phase commits to creating an environment where our employees achieve their full potential, increase productivity, and expand their professional and personal horizons. We look for bright, innovative people who achieve results, understand the importance of being productive and supportive team members, and prioritize customer satisfaction. Next Phase leadership is looking for new leaders, scientific and technical subject matter experts, and technically savvy people interested in putting forth the effort and commitment needed to grow our company.
Will you join us to share in the success?
Benefits
Benefits include, but are not limited to:
HEALTH AND WELLNESS BENEFITS
- Choose from three medical healthcare plans.
- Dental and Vision Insurance plans.
- Enjoy a Flexible Spending Account (FSA) and Health Savings Account (HSA), and a company-sponsored Wellness Program.
PERSONAL INSURANCE BENEFITS
- Next Phase offers life insurance, accidental death, and dismemberment (AD&D) insurance, as well as short-term and long-term disability insurance, all of which are paid for by the company.
PAID LEAVE
- Employees receive competitive paid time off, including 11 holidays and maternity leave for recovering mothers.
RETIREMENT
- Next Phase contributes 5% to a 401K plan without requiring employee contributions.
PROFESSIONAL DEVELOPMENT
- Employees can be reimbursed for professional development expenses such as classes, books, technical certification/testing fees, professional dues/subscriptions, and professional licenses required for their position.
PET INSURANCE
- You have two options to ensure the happiness and health of your pets.
COMPETITIVE BONUS PROGRAM
- At Next Phase, we believe in sharing our success with the employees who make it happen!
Next Phase Solutions and Services, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
"EOE, including disability/vets"
“APPLICANTS HAVE RIGHTS UNDER FEDERAL EMPLOYMENT LAWS”
KNOW YOUR RIGHTS: WORKPLACE DISCRIMINATION IS ILLEGAL
FAMILY AND MEDICAL LEAVE ACT (FMLA)
EMPLOYEE RIGHTS EMPLOYEE POLYGRAPH PROTECTION ACT
JOB SAFETY AND HEALTH: IT'S THE LAW!
EMPLOYEE RIGHTS UNDER THE FAIR LABOR STANDARDS ACT
NEED ASSISTANCE?
If you are a person with a disability requiring assistance with the electronic submission process, please contact us at HRDirector@npss-inc.com.
Our ADA Process Steps include:
1. Initiate Communication:
Our dedicated HR representatives promptly reach out to applicants to discuss their specific needs and explore how we can support them throughout the application process.
2. Offer Reasonable Accommodations:
Our HR team asks about the nature of assistance needed, ensuring we are ready to provide reasonable accommodations that enable applicants to complete the electronic submission process comfortably.
3. Engage in an Interactive Process:
We engage in open and effective communication with individuals, seeking to understand their limitations and unique requirements.
4. Document the Interaction:
We maintain detailed records of communication and any accommodations provided, ensuring compliance with the ADA and facilitating future inquiries or audits. All documentation is treated confidentially.
5. Ensure Confidentiality:
We prioritize the confidentiality of information related to an applicant's disability, sharing it only with individuals who have a legitimate need to know, such as those involved in providing accommodations.
6. Provide Assistance as Needed:
Based on the applicant's information, our HR representatives offer assistance tailored to accommodate individual disabilities, whether it be additional time, alternative formats, or other reasonable adjustments.
7. Educate Staff:
Our HR staff and relevant personnel are well-versed in ADA requirements and our commitment to providing reasonable accommodations. We provide ongoing training to ensure our team responds appropriately to similar requests, fostering an inclusive and supportive environment.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Ansible AWS Big Data CI/CD CloudFormation Computer Science Databricks Data governance DevOps Distributed Systems Docker EC2 ELK Engineering Git Grafana Hadoop Kafka Kubernetes Lambda Pipelines Python Research Security Spark Splunk Terraform Testing
Perks/benefits: 401(k) matching Career development Competitive pay Equity Flex hours Flexible spending account Flex vacation Health care Insurance Medical leave Salary bonus Startup environment Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Science Manager jobs
- Open Principal Data Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs