Big Data Manager/Lead
Asia
Binance
Binance cryptocurrency exchange - We operate the worlds biggest bitcoin exchange and altcoin crypto exchange in the world by volumeAre you looking to be a part of the most influential company in the blockchain industry and contribute to the crypto-currency revolution that is changing the world?
We are looking for an experienced Big Data Team Lead to lead our team.The candidate will build an agile and efficient big data team and implement a reliable big data platform to support various data applications that meet business needs. This person will analyze and define innovative solutions with internal stakeholders to achieve strategic business goals.
Responsibilities:
- Sort out business scenarios, lead team work closely with the data scientist, backend dev and frontend dev teams to continuously deliver data applications and data APIs, output business value.
- Lead team design and implement high performance big data platform supporting large volume real time and batched data processes.
- Plan the construction of big data platform, continuously optimize it to ensure the scalability, high availability, fault tolerance and flexibility to meet the needs of various applications.
- Lead team build a data governance platform to provide automatic, self-service, and intelligent platform support for data governance. include data model management, data standard management, metadata management, data quality management, data service management, data security management and data life cycle management.
- Establish a good learning and growth environment for team members, help them clarify their goals and implement high quality delivery, build an agile and efficient big data team.
Qualifications:
- 5+ years of experience in leading Big Data team(s).
- 5+ years experience of Big Data platform governance.
- 10+ years experience of Big Data development and architecture.
- 10+ years experience of data lake and data warehouse design and development experience.
- Extensive experience and knowledges on Big Data solution architecting.
- Proficient in Java / Scala / Python (at least one language) and SQL.
- Proficient in Big Data pipeline development including batch and streaming processing.
- Familiar with Big Data components including but not limited to Hadoop, Hive, Spark, Spark streaming, Delta lake, Hudi, Flink, Presto, Hbase, Kafka, Zookeeper, Airflow, Elasticsearch, Redis, etc.
- Experiences with AWS Big Data services is a plus.
- Have strong team collaboration attitude and develop partnership with other teams and business.
- Be optimistic, ability to adapt quickly to meet new challenges and quick to respond against incidents.
Tags: Agile Airflow APIs AWS Big Data Blockchain Crypto Elasticsearch Finance Flink Hadoop HBase Kafka Python Scala Security Spark SQL Streaming
Perks/benefits: Career development Competitive pay Flat hierarchy Flex hours Relocation support Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs