Data Engineer

• Cooperate with product, customer service and other business departments to fulfil their demand for data collection
• Daily data monitoring and data flow warning, abnormal data interpretation and solution finding
• Participated in the iteration of data products
• Provided data support for product analysis
• Integrating external or new datasets
• Independently complete the project launch, algorithm implementation and tuning, and built offline and real-time algorithm library

Requirements

• Candidate must possess at least Degree in Computer Science or equivalent related field.

• At least 3 years relevant working experience, experience in Internet industry and large-scale data processing is preferred.
• Familiar with common machine learning and data mining algorithms, able to understand algorithm principles, and capable of studying and optimizing algorithms.
• Strong sense of responsibility, fast and excellent learning ability, ability to analyze and solve problems independently

• Experienced doing ETL/ELT using MySQL, PostgreSQL, Hive with Tableau integration.
• Experienced in data pipeline/orchestration platform such as Airflow
• Proficient in programming languages such as Java/Python/Shell to perform task such as wrangling, scraping from external/internal data source
• Proficient in Hadoop/Spark/Storm/Hive and other big data tools, and rich practical experience.
• Strong communication skills, a positive attitude, a committed individual and a good team player.
• Experience in MQ, Cache, RPC, NO-SQL is a strong plus.
• Highly self-driven with the ability to learn and adapt to changes in a fast paced environment.