Data Engineer L3

Because you belong at Twilio

The Who, What, Why and Where

Twilio is growing rapidly and seeking a Data Engineer to be a key member of the Enterprise Data & Business Intelligence organization with the focus on data engineering services based in Bengaluru, India. You will be joining one of the first teams of engineers in our new Bengaluru office and as the early engineers in the Enterprise Data & BI organization in Bengaluru, you will have an opportunity to help define our technical and team culture in India. You will design and build data platforms and services, while handling our data infrastructure in cloud environments that fuels strategic business decisions across Twilio. You will partner with other engineers and product managers to translate data needs into critical information that can be used to implement scalable data platforms and self-service tools. We are looking for someone who is passionate about solving problems using engineering and data, thrives in an evolving environment, brings an enthusiastic and collaborative demeanour, and delights in making a difference. As a successful candidate, you must have a deep background in data engineering and a proven track record of solving data problems at scale leveraging distributed data systems. You are a self-starter, embody a growth demeanour, and can collaborate efficiently across the entire Twilio organization.

Who?

Twilio is looking for a Data Engineer who lives the Twilio Magic and has a proven track record of success. They also have: desire to be on the front lines of an emerging market segment at Twilio, owning data visibility for analytical sales traders and bringing insights to life. You enjoy out of the box thinking and creating scalable data solutions. Projects you work on could include creating algorithmic pricing tools, building systems to forecast revenue and profit trends or generating market elasticity recommendations. You have a proven track record of excellence in data transformation, analysis and communication.

• 3+ years of data engineering experience is a fast paced company that delivers software
• Knowledge of all phases of software development including requirements analysis, design, coding, testing, debugging, implementation, and support.
• A good understanding of designing and building highly scalable Data warehouses and Data pipelines.
• Hands on Experience in SQL, Python, & Scala programming languages.
• Good understanding of Apache Spark RDDs and building data frames. Create Scala/Spark jobs for data transformation and aggregation.
• Experience in building distributed environments using any of Kafka, Spark, Hive, Presto, Hadoop etc.
• Deep understanding of architecture and functioning of Distributed database systems like Snowflake, Presto and Redshift (any).
• Experience working with various file formats like Hudi, Parquet, Avro, ORC for large volumes of data
• Experience with one or more NoSQL databases such as Cassandra, MongoDB, DynamoDB is a plus.
• Solid understanding of engineering standard methodologies and design principles
• Experience working in agile environment and iterative development
• Collaborative demeanour and ability to work with distributed, multi-functional teams.
• Proven communication skills and the ability to clearly articulate your point of view.
• Bachelors/Master’s degree in Computer Science required, or equivalent experience
• Should have superb communication and presentation, strong analytical and problem-solving skills

What?

As a Data Engineer, you will live the Twilio Magic and:

• Design, Develop and maintain scalable data pipelines and Data warehouse to support continuing increases in data volume and complexity.
• Develop set processes for data mining, data modelling, and data production.
• Collaborates with Data Architects and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organisation.
• Implements processes and systems to supervise data quality, ensuring production data is always accurate and available for key partners and business processes that depend on it.
• Writes unit/integration tests, chips in to engineering wiki, and documents work.
• Performs data analysis required to solve data related issues and assist in the resolution of data issues.
• Works closely with a team of frontend and backend engineers, product managers, and analysts.
• Designs data integrations and data quality framework.

Be an owner

• Design and implement data management services for data trust, data compliance, data access and metadata management in the form of scalable and configurable while clearly articulating technical rationale behind your design and implementation choices
• Participate in Agile/Scrum activities including planning, standups, retrospectives; Provide point of view on user stories.

Wear the customer’s shoes

• Partner with data architects, product managers and other engineers to ensure they have the right information about our services and platforms while ensuring happy customers.
• Listen to your customers’ challenges, see opportunities, craft solutions, and deliver the right value at the right time.

Write it down

• Demonstrate excellent verbal and written communication - ensure that sophisticated ideas, thoughts, and vision can be communicated simply and effectively. You are expected to thrive in a highly collaborative environment.

Draw the owl

• You’ll build highly scalable platforms and services that support rapidly growing data needs in Twilio. There’s no instruction book, it’s yours to write. You’ll figure it out, ship it, and iterate. You’ll invent the future, but you won’t wing it.

Why?

The Enterprise Data and Business Intelligence is a central organization within Twilio that provides data infrastructure and related services in the form of data lake, data warehouse, business intelligence and data governance etc, that supports long term growth and sustainability. Our mission is to enable fact based decision-making by providing clean, governed, accurate data in scalable and easy to use systems in a timely manner. We play an integral role in shaping our business decisions that enable company’s growth and success and are the backbone of Twilio’s data driven culture.

Twilio is a company that is empowering the world’s developers with modern communication in order to build better applications. Twilio is truly unique; we are a company committed to your growth, your learning, your development, and your entire employee experience. We only win when our employees succeed, and we're dedicated to helping you develop your strengths. We have a cultural foundation built on diversity, inclusion, and innovation, and we want you and your ideas to thrive at Twilio.

Where?

This position will be located in our office in Bengaluru, India. You will enjoy our office perks: catered meals, snacks, game room, ergonomic desks, massages, bi-weekly All Hands and more. What you will also get to experience is a company that believes in small teams for maximum impact; seeks well-rounded talent to ensure a full perspective on our customers’ experience, understands that this is a marathon, not a sprint; that continuously and purposefully builds an inclusive culture where everyone is able to do and be the best version of themselves.

About Us

Millions of developers around the world have used Twilio to unlock the magic of communications to improve any human experience. Twilio has democratized communications channels like voice, text, chat, video and email by virtualizing the world’s communications infrastructure through APIs that are simple enough for any developer to use, yet robust enough to power the world’s most demanding applications. By making communications a part of every software developer’s toolkit, Twilio is enabling innovators across every industry — from emerging leaders to the world’s largest organizations — to reinvent how companies engage with their customers.