Data Technical Lead (Apache Spark, Pyspark and Databricks)
Dallas, TX, US
NTT DATA
NTT DATA helps clients transform through consulting, industry solutions, business process services, IT modernization and managed services.Req ID: 279237
NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Data Technical Lead (Apache Spark, Pyspark and Databricks) to join our team in Dallas, Texas (US-TX), United States (US).
Job Duties and Responsibilities:
- Technical Lead with 10+ yrs of experience as well as expertise in data engineering and analytics in
- In-depth knowledge of Apache Spark, Pyspark and Databricks architecture.
- Strong programming skills in languages such as Python or Scala.
- Experience with data engineering concepts, ETL processes, and data modeling.
- Proven experience as a Technical Lead with a focus on Databricks and big data technologies on Azure Cloud Platform.
- Design and implement scalable and efficient data processing architectures using Databricks.
- Handson experience in writing python code, Pyspark notebooks and Azure Cloud, Configure Databricks clusters and ensure adherence to best practices and coding standards.
- Make strategic decisions regarding data organization, storage, and processing.
- Lead and mentor a team of data engineers and data scientists.
- Provide technical guidance and support to ensure the team's success.
- Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks.
- Optimize the performance of big data processing tasks and analytics jobs.
- Collaborate with cross-functional teams, including data science, business intelligence, and infrastructure teams.
- Ensure seamless integration of data pipelines with various systems.
- Ensure consistency, quality, and maintainability of the codebase.
- Optimize queries and resolve technical challenges during development and production.
- Manage the technical aspects of projects, including timelines and resource allocation.
- Coordinate with stakeholders to ensure project goals are met.
- Excellent leadership and communication skills.
Basic Qualifications:
- 8+ years of experience in Databricks
#INDFSINS
#INDAPPS
About NTT DATA Services
NTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications, headquartered in Texas. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications development and management, managed edge-to-cloud infrastructure services, BPO, systems integration and global data centers. We are committed to our clients’ long-term success. Visit nttdata.com or LinkedIn to learn more.
NTT DATA Services is an equal opportunity employer and considers all applicants without regarding to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Azure Big Data Business Intelligence Consulting Databricks Data pipelines Engineering ETL Machine Learning ML models Pipelines PySpark Python Scala Spark
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Sr Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Manager, Data Engineering jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs