Staff Software Engineer II-Big Data (REMOTE)
Austin, TX, United States
Company Description
Vericast is a premier marketing solutions company that accelerates profitable revenue growth for the thousands of businesses it serves directly by influencing consumer purchasing and transaction behavior at scale while engaging with over 120 million households daily. We are recognized as leading providers of incentives, advertising, marketing services, transaction solutions, customer data and cross-channel campaign management, and intelligent media delivery that create millions of customer touch points annually for their clients. For more information, visit http://www.vericast.com or follow Vericast on LinkedIn.
Job Description
We are looking for a Staff Software Engineer II with hands on experience in Spark and Kafka, proficiency in Java as well as Spring boot microservices framework. Valassis Digital (a division of Vericast) is seeking a highly motivated Engineer to develop services, tools, bots, and workflows for our big data processing infrastructure.
The Big Data Platform Team owns and operates the world-class big data processing infrastructure that over a dozen engineering teams use to power their 24/7 technical marketing products. We own and operate a large hadoop+spark processing cloud on which we store 6PB of data and run 30 thousand jobs every day. We write a fabric of java microservices and bots to manage all those jobs, extend hadoop's functionality, and help us operate and optimize our investment. We write custom data streaming services that ingest and curate 100TB of data each day that drives the entire advertising data ecosystem. We also participate in all our users' groundbreaking workflow projects so that we can constantly stay abreast of our developer's tooling needs.
What you're like:
This position is perfect for a far-sighted engineer who always wants to be the first to apply cutting-edge technologies to solve complex business and engineering problems. You work throughout the software lifecycle including requirements analysis, development, testing and operations. If you are energized by the thought of developing new system stacks and tools for big data processing and analytics, we want to talk to you. If you have worked on big data engineering, cloud migration, or infrastructure tooling projects, we want to talk to you. If you have ever worked on a collection of data workflows and though 'I could make this better' we want to talk to you!
What you'll do:
Design, develop, and maintain the software and systems that make up the data platform that runs our entire business.
Participate in multi-disciplinary projects with our applications and analytics teams.
Partner with the Data Science and Engineering teams who use our platform to by diagnosing, predicting and correcting scaling problems.
Contribute to our team’s growing set of development platforms, tools, and processes.
Qualifications
Your skills:
- Experience in working on big data systems and technologies with emphasis on the Hadoop platform
- Proficiency in Java programming; experience with microservices; exposure to Spring Boot.
- Hands on experience with Spark; exposure to Kafka and YARN
- Experience with migration of infrastructure from on-prem to cloud or vice versa
- Curiosity to learn and apply new technologies
- Excellent problem-solving abilities
- Excellent verbal and communication skills
- Experience with agile development methodologies
Your qualifications:
- BS in Computer Science or other technical discipline (with significant computer coursework)
- 6+ recent years of professional software development experience using Java.
- 2+ recent years working with the hadoop+spark big data platform.
Additional Information
Salary: $145,000 - $155,000
Management Bonus: 10%
The ultimate compensation offered for the position will depend upon several factors such as skill level, cost of living, experience, and responsibilities.
Vericast offers a generous total rewards benefits package that includes medical, dental and vision coverage, 401K matching and generous PTO allowance. A wide variety of additional benefits like life insurance, employee assistance and pet insurance are also available, not to mention smart and friendly coworkers!
#LI-TE1
#LI-REMOTE
Tags: Agile Big Data Computer Science Engineering Hadoop Java Kafka Microservices Spark Streaming Testing
Perks/benefits: Health care Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs