Azure Data Engineer

Launchpad, a people-first technology company, is a leader in North America´s rapidly growing tech sector. Through two solutions, Launchpad supports its clients with digital transformation:

• PaasportTM, our iPaaS solution, streamlines software integration and automates workflows.
• Nearshore Staff Augmentation, our managed IT staffing service, connects top IT talent across various geographical regions, bringing industry expertise to leading clients.

Based in Vancouver, Canada, our operational footprint spans across North and South America, with a second headquarters in Santiago, Chile.

In 2023, our unwavering dedication to innovation garnered recognition as a Deloitte Technology Fast 50™ Program Company. Our clientele boasts industry leaders such as Walmart, GM, TIME Magazine, Salesforce, Tableau, Splunk, Bolt.com, Freedom House, and more.

At Launchpad, we genuinely care about our people as individuals. If you are looking for a team that values growth, drive, and passion for your craft, if you’re seeking a place to achieve your goals and dreams with fairness and integrity, then we’d love to hear from you.

We are currently seeking a qualified Azure Data Engineer to join our team. 

Responsibilities:

Azure Databricks Optimization

• Rightsize Clusters: Optimize the size of Databricks clusters based on actual resource requirements. Scale clusters up or down based on workload demands to avoid over-provisioning.
• Auto-Scaling: Enable auto-scaling to automatically adjust the number of worker nodes in a cluster based on the workload.
• Idle Resource Management: Configure clusters for automatic shut-down.
• Use Spot Instances: Take advantage of Azure Spot Instances for worker nodes in the clusters.
• Data Storage Optimization: Optimize the data storage by removing unnecessary files, compressing data, and using appropriate storage formats.
• Monitoring and Logging: Regularly monitor the usage and performance metrics. Identify any inefficient or underutilized resources and adjust accordingly. Utilize Azure Monitor and Azure Log Analytics for insights.
• Cost Alerts: Set up cost alerts in Azure to get notified when spending exceeds predefined thresholds.
• Resource Tagging: Use resource tagging to categorize and track costs.

SQL Optimization

• Azure Cost Management: Understanding of Azure cost management principles, including the ability to monitor and optimize costs associated with Azure SQL Database usage.
• Performance Tuning: Skill in identifying and resolving performance issues in SQL databases. This includes optimizing queries, indexing strategies, and configuration settings.
• Query Optimization: Experience in analyzing and optimizing SQL queries for better performance. This involves understanding execution plans, indexing, and database statistics.
• Understanding of Azure Services: Awareness of other Azure services that may interact with or impact Azure SQL Database, such as Azure Monitor, Azure Logic Apps, or Azure Functions.
• SQL Proficiency: A strong command of SQL is essential, including the ability to write complex queries, optimize existing ones, and understand query execution plans.
• Azure SQL Database Knowledge: Familiarity with Azure SQL Database, including its architecture, features, and best practices for deployment and management.
• Database Administration: Knowledge of general database administration tasks, such as backups, restores, security management, and user access control.
• Troubleshooting Skills: Ability to diagnose and resolve issues related to database performance, connectivity, and other related problems.
• Resource Monitoring: Proficiency in using Azure monitoring tools to track and analyze resource usage, performance metrics, and other relevant data.
• Scripting Skills: Familiarity with scripting languages (e.g., PowerShell, Python) for automating routine tasks and managing Azure resources.

Preferred Qualifications:

• +5 years of experience working with Azure Databricks and Azure SQL
• Proactive attitude towards identifying opportunities for improvement and cost optimization.
• Continuous Learning: Given the dynamic nature of cloud technologies, a willingness to stay updated on the latest Azure SQL features, updates, and best practices through continuous learning.
• Communication Skills: Effective communication skills are crucial for collaborating with cross-functional teams, explaining technical concepts to non-technical stakeholders, and working closely with developers and system administrators. Advanced level of spoken English is mandatory.

Addtional Skills - Highly Valued

• Familiarity with Snowflake
• Familiarity with DevOps practices and experience in related tasks would be a significant advantage.

Why work for Launchpad?

• 100% remote
• People first culture
• Excellent compensation in US Dollars
• Hardware setup for working from home
• Work with global teams and prominent brands based in North America, Europe, and Asia
• Training allowances
• Personal time off (PTO) for vacations, study leave, personal time, etc.
• ...and more!

At Launchpad, we genuinely care about our people as individuals. If you are looking for a team that values growth, drive, and passion for your craft, if you’re seeking a place to achieve your goals and dreams with fairness and integrity, then you are the future of Launchpad. Launchpad is committed to fostering a diverse and representative workforce and an inclusive work environment where all employees are respected and treated equally.

Are you ready to elevate your career at Launchpad? We want to hear your story! Contact us today.