Sr Data Engineer – Data & Entertainment Company
Remote, anywhere in LATAM
Truelogic Software
Truelogic Software offers premium nearshore software development services to American companies. Find the perfect solution for your company today! +1 (786) 708 4447The Role
- Build, test and maintain data pipelines that support the data sciences team and customer-facing client teams.
- Track and manage pipeline efficiency and stability.
- Evaluate, parse, clean, and integrate raw data sets including third party APIs. Help build sophisticated ETL processes around first party data such as survey data, second and third-party data sources such as IP addresses, clickstream data, movie meta data.
- Provide recommendations for data storage, configurations, data access tools and new technologies/architectures.
- Develop code-based data transformation/aggregation in data lakes, relational databases (primary use cases) and possibly non-relational databases, as well as for the purpose of BI tools such as Power BI and Tableau.
- Participate in developing data APIs for data ingestion of NRG data into client-side applications or client-side data systems.
- Assist application developers in the effective use of database query and programming languages.
- Contribute to managing data integrity, data storage efficiency and data ecosystem efficiency.
Who You Are
- Team asset who can describe data structures, relationships, and flows behind organization database servers and applications.
- Key individual that the technology team looks to for advice related to data organization and planning.
- Up to date on the latest data-related best practices and technologies and always looking to learn more.
- Currently working as database engineer with good foundational experience.
- Internally motivated self-starter who continuously strives to get things done, regardless of challenges encountered.
- Critical thinker, able to understand and respond to complex questions or issues that may arise, and able to demonstrate willingness to experiment with new technologies.
- Successfully manages time and multiple competing priorities in order to ensure deadlines are always met.
- Team player who is able to work collaboratively and initiate and drive projects to completion with minimal oversight.
Ideal Candidate.
- 3+ years of experience using Spark for building data pipelines or ETL (Pyspark is preferred).
- 3+ years of experience in AWS technologies/infrastructure.
- 3+ years of experience in SQL and database technologies.
- PostgreSQL or AWS Redshift experience required.
- A solid foundation with end-to-end development and the desire to further their technical knowledge.
- Working knowledge with Python.
- Knowledge of PII (personally identifiable information) data security standards is a plus.
- Experience in databases structured against survey data is a big plus.
Rewards
- Payment in USD.
- Free credentials for e-learning platforms.
- Remote workshops & activities.
Tags: APIs AWS Data pipelines ETL Pipelines PostgreSQL Power BI PySpark Python RDBMS Redshift Security Spark SQL Survey data Tableau
Perks/benefits: Team events
Regions:
Remote/Anywhere
South America
Country:
United States
Job stats:
1
0
0
Categories:
Deep Learning Jobs
Engineering Jobs
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs