Data Engineer, Data Architecture & Engineering

Remote - US

Applications have closed

3Cloud

Make the cloud work for you with our Azure consulting services. With a 100% focus on Azure, our experts deliver to you the ultimate Azure experience.

View company page

Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you!

At 3Cloud, we hire people who aren’t afraid to experiment or fail. We hire people who are willing to give direct and candid feedback to their managers, leaders, and team members. We hire people who jump at those opportunities because they care about our collective growth and success. We hire people who challenge and hold each other accountable for living 3Cloud’s core values because they know that it will result in amazing experiences and solutions for our clients and each other.

3Cloud is a technology services firm helping clients transform their business through the power of the cloud. We leverage Microsoft Azure to help clients speed up innovation, operate more efficiently and be more responsive to their client’s needs. As a Microsoft partner, we specialize in Azure migration, cloud-scale custom application development, Internet of Things (IoT), analytics, and managed development (DevOps) achieved through Azure-enabled infrastructure automation. 3Cloud is headquartered in Chicago with an additional office in Dallas. Remote based, US only. 

As a consultant in the Data and Analytics Practice you will be responsible for delivering quality solutions using the Microsoft’s Azure suite of tools. You will be able to demonstrate knowledge and expertise in data engineering best practices and concepts using Databricks. You will have intermediate to advanced knowledge with Spark architecture, including the Spark DataFrames API, and use of that API to explore, preprocess, join, and ingest data in Spark. You will also know how to read source data from a variety of formats and save data in Delta tables. You will be able to work with streaming data using various streaming APIs. You will also use your skills in SQL, including syntax expertise, performance tuning, identity management, and data access control. You will also understand Azure DevOps for structured development, including task management, and managed code deployment (including CI/CD pipelines). This is a remote based role in US only. 

Responsibilities                                                                                                            

  • Support the development of high performing, reliable and scalable solutions
  • Clearly communicate technical details to business and management personnel
  • Work independently or on a team to design and develop database solutions
  • Assist business development team with pre-sales activities and RFPs

Qualifications

  • Bachelor’s Degree desired in Computer Science, Information Technology, or related field
  • Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
  • Knowledge of Databricks development, including Scala, Python, and Spark
  • Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and performance tuning for Synapse
  • Ability to develop utilizing the following technologies:
    • Data Movement (Apache Spark, plus Azure Data Factory and legacy SSIS)
    • Data Warehousing (Azure Synapse, CosmosDB)
    • Azure Storage Technologies (Data Lake, Blob Storage)
  • Expertise in Spark DataFrames API and architecture to ingest and manipulate data, including exploring, preprocessing, joining, filtering, dropping sorting, partitioning, and renaming/manipulating columns in the dataset
  • Understanding of network infrastructure and security including
    • Workspace Deployment
    • Azure Cloud Concepts
    • Network Security

Professional Skills:

  • Eagerness to contribute in a team-oriented environment
  • Desire to work in an information systems environment
  • Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
  • Passionate about learning new technologies
  • Analytical approach to problem-solving; ability to use technology to solve business problems
  • Ability to work in a fast-paced environment

Additional Preferred Experience:

  • Machine Learning/AI Practitioner expertise, including
    • Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies
    • Experience with Azure ML Studio/Services, and R programming language
    • Understanding of analysis models, including Supervised vs Unsupervised, Regression vs Classification, clustering, and cross-validation
    • Building, Tuning, and deploying analysis models with Spark ML and ML Flow
  • Knowledge of Power BI is a plus
  • Certifications are a plus

This Job Posting will expire on Monday, April 15, 2024. 

3Cloud Total Rewards Highlights Include:  

  • Flexible work location with a virtual first approach to work! 
  • 401(K) with match up to 50% of your 6% contributions of eligible pay 
  • Generous PTO providing a minimum of 15 days in addition to 9 paid company holidays and 2 floating personal days  
  • Three medical plan options to allow you the choice to elect what works best for you! 
  • Option for vision and dental coverage 
  • 100% employer premium coverage for STD and LTD 
  • Paid leave for birth parents and non-birth parents 
  • Option for FSA, HSA, HRA and Dependent Care 
  • $67.00 monthly tech and home office allowance
  • Utilization and/or discretionary bonus eligibility based on role 
  • Robust Employee Assistance Program to help with everyday challenges 
3Cloud offers competitive compensation. In addition to base pay employees are eligible to receive an annual discretionary/utilization bonus. If you are hired at 3Cloud your final base salary is based on factors such as skills, education, experience and/or geographic location. Please keep in mind that the range mentioned above includes the full base salary range for the role. It is not typical for offers to be made at or near the top of the range.Base Salary Range$90,000—$150,000 USD

Don’t meet every single requirement? At 3Cloud we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway.

At this time, we cannot sponsor applicants for work visas.

Tags: APIs Architecture Azure CI/CD Classification Clustering Computer Science Consulting Databricks Data Warehousing DevOps Engineering Machine Learning Pipelines Power BI Python R Scala Security Spark SQL SSIS Streaming

Perks/benefits: 401(k) matching Career development Competitive pay Flex vacation Health care Home office stipend Medical leave Salary bonus Startup environment Team events

Regions: Remote/Anywhere North America
Country: United States
Job stats:  15  1  0

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.