Software Engineer, Data Pipelines
United States - Remote
JW Player
JW Player is the #1 end-to-end video streaming solution to scale your video strategy, maximize engagement, & monetize your video content.About JW Player:
JW Player is the leading video software and data insights platform that gives our customers independence and control in today’s Digital Video Economy. Founded over a decade ago as an open source video player, JW Player’s technology platform now powers digital video for hundreds of thousands of businesses across NA, EMEA, APAC and LATAM. Each month, there are over 1 billion viewers across 2.7 billion unique devices consuming video on JW Player’s technology.
The Engineering Team:
JW Player’s Engineering team is responsible for building highly scalable systems that handle thousands of requests per second. Our data applications and pipelines drive monetization for our customers across billions of devices every month. We have a modern tech stack including our own Kubernetes based deployment system.
The Opportunity:
A lot of viewers means a lot of data - we process billions of data points a day, and over 3 million data points a minute - all coming from the player itself. The Data Pipelines team is responsible for processing this data at scale using cutting-edge big data tools and technologies, and providing both the company and our customers with high-quality data to empower strategic, data-driven decision making.
As a Software Engineer, you will:
- Build distributed batch & real-time pipelines using Spark, Kafka, Flink, and Airflow, with programming languages like Python, Java, and SQL
- Work to efficiently scale our pipelines out as data volume grows
- Go deep on Postgres and Snowflake, driving our data models forward and optimizing our data stores
- Follow industry-standard best practices to ensure data quality and integrity
- Enhance our end-to-end QA infrastructure
- Build and maintain APIs that serve data directly to customers
- Be part of a highly-skilled team that values kindness, open communication, and mentorship
Requirements of the role:
- You have relevant experience working with data systems and technologies
- Strong SQL skills
- Fluency in Python and potentially Java
- A strong work ethic and drive to learn new skills
- An exploratory mindset - you are driven to dig deep and develop understanding
- Experience writing unit, functional, and integration tests for your code
- Comfort working in a cloud environment - we use AWS
- A sense of humor and collaborative spirit
Bonus Points:
- Familiarity with AWS, in particular, EC2, S3, RDS, and EMR
- Understanding of Docker
- Experience with CI/CD tooling and distributed deployments, such as Buildkite
- Experience with Kubernetes
- Javascript skills, or an interest in developing them
Perks of being at JW Player, U.S
When you join JW Player, you are not just joining a company or a team but a family. Our goal is to take care of you and ensure you will be successful in your new role. Your success is our success!
As a full time employee, you will qualify for:
- Private Medical, Vision and Dental Coverage for you and your family
- Competitive Paid Time Off
- Stock Options Purchase Program
- Quarterly and Annual Team Events - because team building is important!
- Professional Career Program and Career Development Opportunities
- Bi-Annual Hack Weeks for those who are interested in using their coding knowledge
- Fireside chats with individuals in the JW Player family
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Tags: Airflow APIs AWS Big Data CI/CD Data pipelines Docker EC2 Engineering Flink JavaScript Kafka Kubernetes Open Source Pipelines PostgreSQL Python Snowflake Spark SQL
Perks/benefits: Career development Equity Health care Salary bonus Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs