Data Engineer II
Canada or Remote
AccuWeather
About AccuWeather
AccuWeather is recognized and documented as the most accurate source of weather forecasts and warnings in the world, has saved more than 10,000 thousands lives, prevented 100,000 injuries, and saved tens of billions of dollars in property damage.
With global headquarters in State College, Pennsylvania; a severe weather center in Wichita, Kansas; and offices in New York City and elsewhere around the world, AccuWeather serves more than 1.5 billion people daily to help them better plan their activities and get more out of their day and keep their families safer through innovative digital media properties, such as AccuWeather.com and mobile, as well as radio, television, newspapers, digital out-of-home, the 24/7 AccuWeather Network channel and AccuWeather NOW streaming service. Additionally, AccuWeather produces and further serves more than half the Fortune 100 companies and thousands of businesses and distributes news, weather content, and video for more than 180,000 third-party websites.
POSITION SUMMARY
In this role as a Data Engineer II, you will directly impact AccuWeather’s continued focus on innovation and generating superior weather products. You will play a critical role in building and maintaining our data infrastructure, enabling efficient data processing, analysis, and reporting. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure our data pipelines and platforms' availability, reliability, and performance. Your expertise in Databricks will be essential in optimizing data workflows, ensuring data quality, and contributing to the continuous improvement of our data engineering practices.
We are open to hiring candidates to work from our global headquarters in State College, PA, USA, or remotely.
KEY RESPONSIBILITIES:
- Develop Data Pipelines: Design, develop, and maintain scalable and robust data pipelines using Databricks, Spark, and related technologies.
- Data Processing Optimization: Optimize data workflows to build performant, reliable, and efficient data solutions.
- Collaboration Excellence: Contribute positively to a highly collaborative work environment by working closely with cross-functional teams, including data scientists, analysts, and software engineers. In this role, you’ll be responsible for understanding requirements and implementing robust solutions that meet their needs. Additionally, you’ll collaborate with other data engineers to ensure the smooth deployment and operation of data solutions.
- Monitoring and Troubleshooting: Monitor, troubleshoot, and resolve issues related to data pipelines and platform performance.
- Implement Best Practices: Implement best practices for data modeling, ETL processes, and data ingestion, and enhance data engineering practices. Stay current with industry trends and advancements in data engineering, Databricks, and related technologies.
- Documentation: Create and maintain detailed documentation of data solutions for knowledge sharing and future reference.
PREFERRED QUALIFICATIONS:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 2-3 years' experience as a Data Engineer, with a strong focus on Databricks, Spark, and cloud-based data platforms (e.g., AWS, Azure, Google Cloud).
- Expertise in designing, developing, and optimizing complex ETL processes and data pipelines.
- Proficiency in programming languages like Python, Scala, or Java.
- Solid understanding of data modeling, data warehousing, and data integration concepts.
- Familiarity with DevOps practices and tools for CI/CD and infrastructure automation.
- Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues.
- Excellent communication and teamwork skills, with the ability to collaborate effectively with cross-functional teams.
- Experience with big data technologies, real-time data processing, and machine learning pipelines is a plus.
- Relevant certifications in Databricks, Spark, or cloud platforms are a strong advantage.
WHY JOIN US:
Are you passionate about working with data? Are you eager to solve challenging problems and deliver innovative solutions? Do you enjoy using the latest technology in data engineering? Then, we’d love to have you join our team. We are a passionate data team that embraces tackling some of the weather industry’s most challenging problems. Our ideal candidate thrives in a deeply collaborative, innovative, and fast-paced environment where you can transform your passion for data into building meaningful solutions that contribute to our mission of saving lives, protecting property, and helping people prosper. Successful candidates will have opportunities to advance their careers and grow as a data engineer. Join us in our journey to shape the future of data engineering and industry innovation.
BENEFITS:
- Comprehensive healthcare and dental benefits
- 401(k) retirement plan with 50% company match
- A collaborative work environment
AccuWeather is proud to be an Equal Opportunity/Affirmative Action Employer. We are committed to equal employment opportunity to all applicants and existing employees and we evaluate qualified applicants without regard to race, creed, color, national origin, sex (including pregnancy and gender identity/expression), sexual orientation, age, ancestry, physical or mental disability, marital status, political affiliation, religion, citizenship status, genetic information, veteran status, or any other basis protected under applicable federal, state, or local law. View the EEO is the Law poster here and its supplement here. The pay transparency policy is available here.
AccuWeather is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to human.resources@accuweather.com and let us know the nature of your request and your contact information.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Big Data CI/CD Computer Science Databricks Data pipelines Data quality Data Warehousing DevOps Engineering ETL GCP Google Cloud Java Machine Learning Pipelines Python Scala Spark Streaming
Perks/benefits: 401(k) matching Career development Team events Transparency
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Data Engineer II jobs
- Open Lead Data Analyst jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Data Scientist II jobs
- Open Business Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Data Engineering Manager jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Consulting-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs