Data Engineer 2

Company Description

When you’re one of us, you get to run with the best. For decades, we’ve been helping marketers from the world’s top brands personalize experiences for millions of people with our cutting-edge technology, solutions and services. Epsilon’s best-in-class identity gives brands a clear, privacy-safe view of their customers, which they can use across our suite of digital media, messaging and loyalty solutions. We process 400+ billion consumer actions each day and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon India is now Great Place to Work-Certified™. Epsilon has also been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Positioned at the core of Publicis Groupe, Epsilon is a global company with more than 8,000 employees around the world. For more information, visit epsilon.com/apac or our LinkedIn page.

Job Description

Organization Objective/Purpose:

This role is part of the Data Egnineering Team, within the Digital Experience organization.  The team’s core objective is to drive business growth and deepen client relationships by transforming how Epsilon’s customers use and maximize their investments around marketing data needs. As a software engineer in our fast-moving, small entrepreneurial team, you will develop segmentations required for Marketing needs. You will be responsible for solving technical challenges and deliver the project needs.  We are passionate, client-centric, business leaders who seek to deliver meaningful revenue-generating and cost-saving results.

Brief Description of Role:

Delivering integrated marketing solutions focused on relevant, personalized, and cross-channel technologies is paramount at Epsilon. This position will focus on development and integration of data onto multiple CDP platforms. The communication skill to understand the business requirement, walk through the complex design with simple examples, demonstrate why the system is working and clarify the performance outcome with the customer is equally important.

This is a highly visible position directly working with Epsilon’s client base. We are looking for a development professional to manage this initiative and important opportunity.

Below are the primary responsibilities:

System Integration:  You will need to be able to develop, and integrate decision management platforms into multiple types of marketing applications such as website, email, print, social, etc.  Below is a list of detailed responsibilities: 

• Development of API, Rest services, Web services, and other common network communication protocols
• Recommendation model development and integration
• Integration with Java, Python, .NET, HTML, and many other marketing platforms
• Development of ETL, XML, SFTP, shell script and other data transformation processes

Client Services and Support:  You will need to be able to work in a cross matrix team environment from both Epsilon and our client base including; peer developers, project managers, systems analyst, database developers, marketing teams, business managers, and executive leadership. Work closely for all IT development and integration work with the client.. Implement critical processes needs for the client. Prepare and maintain documentation including planning, analysis, design, implementation/testing, and deployment deliverables.  Execute as per timelines and coordination among sub-projects; ensure that cross-project dependencies are identified, communicated, and tracked. Refine and implement quality test plans. 

Technical/Functional Qualifications:

This position requires an individual with a combination of software engineering and data analytical skills with the desire being part of cutting-edge, high-profile projects and are motivated by delivering world-class solutions on an aggressive schedule. The candidate should have a solid foundation in computer science with well-honed skills in data engineering. 

We are looking for an experienced Azure data engineer who will develop and build a marketing data mart for a major pharmaceutical company in the market.

• Should have a comprehensive understanding of services on the Azure data platform
• Supports ADF pipelines – Builds the required dimensions, rules, segments and aggregates
• Have experience in writing SQL queries is a must
• Support all database operations: performance monitoring, pipeline ingestion, maintenance, etc.
• Experience in Pyspark programming is a must
• Develop new inbound data sources required within the Marketing Data Mart to support campaign creation
• Monitor DataMart health - data loads, extracts, failures, performance tuning
• Create/modify data structures/pipelines
• Knowledge on Salesforce Marketing Cloud and Tealium will be an added advantage
• Supports daily processing, monitoring and loading for all data updates
• Always take all software best practices into consideration. Ex. infrastructure cost, security, scalability, feature extensibility, ease of maintenance, etc.
• Develop, document, and test software and environment setup to ensure that the outcome meets the needs of end-users and achieves business goals
• Work with various business and technical people to understand the systems, data sources, business goals, technical goals, timelines on multiple projects

Qualifications

• Strong analytical, written and verbal communication skills.
• Tech Stack: ADF pipeline, Databricks, Pyspark, SQL, PL-SQL, SSIS
• Develop Azure logic apps
• Strong Experience in development of Azure Datalake solutions
• Must have experience in developing serverless applications using Azure function apps
• Experience with Azure Data Factory, Databricks, Spark, or other cloud ETL technologies preferred.
• Extensive experience in ETL and audience segmentation
• Experience in designing and building data ingestion pipelines both real-time and batch using best practices
• Connect to different source systems and collect the data in scheduled time and process them using different components like Azure Data bricks, Function Apps, Logic apps etc., and distribute it to the downstream applications or downstream locations like Azure SQL/Synapse, Amazon S3/RedShift etc.
• Knowledge on setting up automated test suites for ETL pipelines
• Experience setting up CI/CD pipelines for ETL projects
• Attention to detail in design, documentation and test coverage of what you build
• Collaborate with business stakeholders to identify and meet data requirements.
• Familiarity with software development methodology such as Agile/Scrum/Kanban
• Implementing incremental data load
• Strong experience in SQL analytic queries
• Knowledge on any of the CDP platforms will be an added advantage.

In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand.

Additional Information

Conditions of Employment

All job offers are contingent upon successful completion of background checks.

Great People, Deserve Great Benefits

We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly.  If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.  We offer associates a variety of benefits that work as hard for them as they work for us.