Data Engineer
Bengaluru, Karnataka, India
Applications have closed
Entropik Technologies
Entropik is an AI-powered Integrated Market Research platform helping brands & agencies to get faster, accurate, and unbiased insights through agile and scalable research platforms.As a Data Engineer, you have to build APIs, Backends for different products and clients using state of the art ML models developed by the Data Science team. Your responsibility will be to scale the system using Parallel processing, Scale-out techniques and robust software design. You will also be working with Data Science team to understand the specific engineering requirements and build in house tools/solutions for the Data Science team.
Responsibilities
- Identifying best practices for cloud services monitoring and management and promoting these best practices across the organisation.
- Work with the backend teams to deliver Machine Learning algorithms at scale.
- Provides database support by coding utilities, and resolving problems
- Resolve database performance issues, database capacity issues, replication, and other distributed data issues.
- Implement data encryption/decryption/masking policies to protect data
- DB and SQL performance tuning
- Design, implement and support efficient & reliable data pipelines to move data from a wide variety of data sources to our data warehouses/data lake.
- Ability to proactively follow issues through to resolution
- Contributes to innovations that fuel the growth of Entropik as a whole
- End to end engineering – design, development, testing, deployment and operations
- Ability to work in a dynamic environment, adopt to business requirements using Agile methodologies and DevOps culture
- Team Player possessing strong analytical, problem solving, communication skills and be willing to share expertise with others
Requirements
- 3 + years of experience in a software development role with a focus on data systems.
- Strong problem solving, decision-making, and analytical skills.
- ETL experience required
- Experience with multiple data formats: CSV, JSON, Avro, Parquet
- Experience with relational SQL and NoSQL databases, including DynamoDB, and MySQL
- Experience with AWS cloud services: EC2, Glue, RDS, Redshift, Lambda, Batch, Step functions, Kinesis
- Must be passionate about contributing to an organization focused on continuously improving consumer experiences, experience working in Agile environment a plus
- Advanced SQL Development (1 Year Preferred)
- Scripting Experience (Python)
- Strong Experience with Visualization Tools like Tableau, Power BI, D3 and exposure to code version control systems (git)
- Hands-on experience building scalable and reliable data pipelines based on Big Data technologies like Hadoop, MapReduce, Hive, Pig, Spark, etc.is a plus
Benefits
As per company policy.
About Entropik Technologies
Entropik Tech is the world’s leading Emotion AI company that reads Human Emotions, helping redefine experiences.
In our Mission to Humanize experiences, we have built AI technologies that understand Human Emotions by Facial Expressions, Eye Movement, Voice Tonality and Brainwaves, in a fast and scalable manner.
Our Diverse product portfolio lets you measure experiences across Media, Digital & Shopper interactions in an accurate and meaningful way.
Entropik Tech provides Emotion Insights to over 150 global brands in CPG, Retail, Media & Publishing, Telecom, and Financial Services industries amongst others. The company has a presence across North America, Europe, Middle East, India and South-East Asia.
https://yourstory.com/2020/09/funding-alert-ai-analytics-startup-entropik-tech-series-a-round/amp
Website: http://www.entropiktech.com
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Avro AWS Big Data CSV Data pipelines DevOps DynamoDB EC2 Engineering ETL Git Hadoop JSON Kinesis Lambda Machine Learning ML models MySQL NoSQL Parquet Pipelines Power BI Python Redshift Spark SQL Tableau Testing
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open LLMs-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs