Senior Backend Engineer - Big Data
Remote, Central USA
Collibra
Collibra helps organizations do more with trusted data. Our data Intelligence solutions include AI Governance, Data Catalog, Data Governance, Data Quality & Observability and more.Joining Collibra’s Backend Engineering - Big Data team:
- You will join a brand new Engineering team reporting the Senior Manager for Data Quality
- You will work on evolving our new Data Quality Product with leading minds in Data Quality detection & monitoring
- You will build large-scale batch and streaming data pipelines and data processing frameworks with predictive models
- You will design, develop, and deploy backend services in Java & Scala with a focus on high availability, robustness, and scalability
- You will be a lead engineer for this project and oversee that the designs and implementation are pragmatic and of high quality
Senior Backend Engineer's - Big Data at Collibra are responsible for:
- Developing high quality code, including participating in testing and maintenance of that code
- Collaborating with Product Management, Design, Architecture, and other Engineers to help estimate work, design scalable and performant solutions that will delight our customers, and produce high quality production-grade software
- Applying pragmatic engineering approaches to deliver value to customers
- Working closely with Data Science and Backend Engineering teams to ensure quality of product
- Being seen as leading engineer who focuses and aligns on the team objectives
- Play an active role in designing and building new, cutting-edge Data Quality management product features
You Have:
- At least 6 years of software engineering experience with some combination of the following: Java, Scala, Spark DataFrame, PySpark, and/or Database Modeling
- Knowledge of enterprise level software architecture and infrastructure such as multi-tenant DB
- Experience in designing relational database models and exposing the data to frontend as REST APIs
- Experience in using Spark or other similar distributed frameworks (e.g. Databricks, Hadoop) for processing big datasets in the cloud
- Experience with working with and safely modernizing existing, complex software
You Are:
- Agile-minded, optimistic, passionate, and pragmatic about delivering valuable software to customers
- Obsessive about data and how it impacts customer’s business processes
- Able to work productively and independently with a geographically distributed remote team and to be able to mentor and advise other engineers you work with on the scrum team
- Accustomed to a fast paced environment and able to identify and suggest solutions for gaps in software development process
- Interested in putting machine learning (ML) models in production and understand engineering trade-offs during production process
Reporting to Collibra’s Senior Manager for Data Quality measures of success are:
- Within your first month, you will get familiar with the environment we use, the way we implement software as an organization, simple business use cases and submit code to production
- Within your third month, you will implement new user stories with quality and care, and understand what value they will bring to our customers. You will start providing input on how best to move the product forward and improve the product
- Within your sixth month, you will be a lead engineer of the Data Quality team, regularly delivering quality code, participating in testing, and ensuring good, scalable, pragmatic engineering practices are followed by the team
Benefits at Collibra:
We strive to provide all Collibrians with competitive and cost-efficient benefits that are aligned to our company values. As a high-growth company, our goal is to offer flexibility and choice with our benefits programs to support the evolving needs of our changing workforce. The specific offerings will differ slightly by region but our {Be}well benefit programs encompass the following strategic pillars:
- {Be}Healthy: Healthcare for yourself and eligible dependents (inclusive of partners/domestic partners), mental health resources and care, tax-advantaged accounts, income protection, discount programs and more! Additionally, we encourage employees to treat their whole self by offering a bi-monthly calendar of events and programming dedicated to our {Be}well initiatives which focus on wellbeing areas including emotional, professional & social, financial, physical, allyship & belonging and giving back.
- {Be}With Family: We offer multiple types of leave so that you can spend time with loved ones, including parental leave, caregiver leave and our annual family day. These are all complementary to our culture in which we value output over hours!
- {Be}Kind: Collibra For Good, Unconscious Bias & Allyship training, Diversity Equity and Inclusion (DEI) Strategy, Environmental Social Governance (ESG) strategy, racial equity awareness programs and Collibra-led fundraisers.
- {Be}Unplugged: Our paid time off programs include vacation, holidays, sick time and compassionate/bereavement leave. We also offer remote-friendly meditation sessions and cooking lessons – all of which you’re actively encouraged to use!
- {Be}Informed: Competitive compensation, bonus potential, private company equity, merit reviews and promotion cycles, company pension, discounts programs, access to LinkedIn Learning, employee referral program, employee rewards & recognition, development programs and more!
- {Be}Together: Community and belonging with our Employee Resource Groups (ERGs) and personal interest groups, ERG-driven events, speaker series, and celebrations, a dedicated DEI council, the virtual Collibra cafe, trivia, bingo games and much more!
When in-person (office) life resumes, we look forward to more snacks, catered lunches, team offsites and social events (think holiday gift exchange, fundraising events, happy hours, celebrations and more)!
Equal Opportunity:
At Collibra, we’re proud to be an equal opportunity employer – which ties directly to our core value, “open, direct, and kind.” We realize the key to creating a company with a world-class culture and employee experience comes from who we hire and creating a workplace that celebrates everyone.
With this, we proudly consider qualified applicants without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, sexual orientation, pregnancy, sex, gender identity, gender expression, genetic information, physical or mental disability, HIV status, registered domestic partner status, caregiver status, marital status, veteran or military status, citizenship status or any other legally protected category.
#LI-AC1
Tags: Agile APIs Big Data Databricks Data pipelines Engineering Hadoop Machine Learning Pipelines PySpark Scala Scrum Spark Streaming Testing
Perks/benefits: Career development Competitive pay Equity Health care Parental leave Salary bonus Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open ETL Developer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open DevOps-related jobs