Data Engineer, Data Architecture & Engineering
Remote - US
3Cloud
Make the cloud work for you with our Azure consulting services. With a 100% focus on Azure, our experts deliver to you the ultimate Azure experience.Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you!
At 3Cloud, we hire people who aren’t afraid to experiment or fail. We hire people who are willing to give direct and candid feedback to their managers, leaders, and team members. We hire people who jump at those opportunities because they care about our collective growth and success. We hire people who challenge and hold each other accountable for living 3Cloud’s core values because they know that it will result in amazing experiences and solutions for our clients and each other.
3Cloud is a technology services firm helping clients transform their business through the power of the cloud. We leverage Microsoft Azure to help clients speed up innovation, operate more efficiently and be more responsive to their client’s needs. As a Microsoft partner, we specialize in Azure migration, cloud-scale custom application development, Internet of Things (IoT), analytics, and managed development (DevOps) achieved through Azure-enabled infrastructure automation. 3Cloud is headquartered in Chicago with an additional office in Dallas. Remote based, US only.
As a consultant in the Data and Analytics Practice you will be responsible for delivering quality solutions using the Microsoft’s Azure suite of tools. You will be able to demonstrate knowledge and expertise in data engineering best practices and concepts using Databricks. You will have intermediate to advanced knowledge with Spark architecture, including the Spark DataFrames API, and use of that API to explore, preprocess, join, and ingest data in Spark. You will also know how to read source data from a variety of formats and save data in Delta tables. You will be able to work with streaming data using various streaming APIs. You will also use your skills in SQL, including syntax expertise, performance tuning, identity management, and data access control. You will also understand Azure DevOps for structured development, including task management, and managed code deployment (including CI/CD pipelines). This is a remote based role in US only.
Responsibilities
- Support the development of high performing, reliable and scalable solutions
- Clearly communicate technical details to business and management personnel
- Work independently or on a team to design and develop database solutions
- Assist business development team with pre-sales activities and RFPs
Qualifications
- Bachelor’s Degree desired in Computer Science, Information Technology, or related field
- Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
- Knowledge of Databricks development, including Scala, Python, and Spark
- Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and performance tuning for Synapse
- Ability to develop utilizing the following technologies:
- Data Movement (Apache Spark, plus Azure Data Factory and legacy SSIS)
- Data Warehousing (Azure Synapse, CosmosDB)
- Azure Storage Technologies (Data Lake, Blob Storage)
- Expertise in Spark DataFrames API and architecture to ingest and manipulate data, including exploring, preprocessing, joining, filtering, dropping sorting, partitioning, and renaming/manipulating columns in the dataset
- Understanding of network infrastructure and security including
- Workspace Deployment
- Azure Cloud Concepts
- Network Security
Professional Skills:
- Eagerness to contribute in a team-oriented environment
- Desire to work in an information systems environment
- Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
- Passionate about learning new technologies
- Analytical approach to problem-solving; ability to use technology to solve business problems
- Ability to work in a fast-paced environment
Additional Preferred Experience:
- Machine Learning/AI Practitioner expertise, including
- Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies
- Experience with Azure ML Studio/Services, and R programming language
- Understanding of analysis models, including Supervised vs Unsupervised, Regression vs Classification, clustering, and cross-validation
- Building, Tuning, and deploying analysis models with Spark ML and ML Flow
- Knowledge of Power BI is a plus
- Certifications are a plus
This Job Posting will expire on Monday, April 15, 2024.
3Cloud Total Rewards Highlights Include:
- Flexible work location with a virtual first approach to work!
- 401(K) with match up to 50% of your 6% contributions of eligible pay
- Generous PTO providing a minimum of 15 days in addition to 9 paid company holidays and 2 floating personal days
- Three medical plan options to allow you the choice to elect what works best for you!
- Option for vision and dental coverage
- 100% employer premium coverage for STD and LTD
- Paid leave for birth parents and non-birth parents
- Option for FSA, HSA, HRA and Dependent Care
- $67.00 monthly tech and home office allowance
- Utilization and/or discretionary bonus eligibility based on role
- Robust Employee Assistance Program to help with everyday challenges
Don’t meet every single requirement? At 3Cloud we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway.
At this time, we cannot sponsor applicants for work visas.
Tags: APIs Architecture Azure CI/CD Classification Clustering Computer Science Consulting Databricks Data Warehousing DevOps Engineering Machine Learning Pipelines Power BI Python R Scala Security Spark SQL SSIS Streaming
Perks/benefits: 401(k) matching Career development Competitive pay Flex vacation Health care Home office stipend Medical leave Salary bonus Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Research Scientist jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs