AWS Cloud Data Engineer

Full Time
Minneapolis, MN 55401
Posted
Job description

Choosing a career with ECMC Group means joining a nonprofit corporation with a mission to help students succeed. With a vibrant mission and values, great benefits, and strong community involvement, ECMC Group companies are an ideal team to join.

Job Summary

The AWS Cloud Data Engineer will use a broad range of skills to design, implement and operate stable, scalable, low-cost solutions to flow data from production systems into the data lake. You will work in a team alongside Business Intelligence and Reporting analysts to build and manage data pipelines from ingestion to consumption within a big data architecture, using AWS native services or custom programming. You must be passionate about working with vast data sets and someone who loves to bring datasets together to support our AWS data platform that enables data-driven decision-making.

Essential Duties and Responsibilities

  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies
  • Understand complex business requirements and create solutions that are technically sustainable while satisfying business requirements
  • Create and maintain optimal data pipeline architecture, and identify ways to improve data reliability, efficiency, and quality
  • Use programming languages to construct and maintain the proposed architecture and enable data to be searched and retrieved efficiently
  • Communicate effectively and intentionally through active listening and thoughtful questioning. Share knowledge and complex topics clearly and concisely in a way that demonstrates patience, collaboration, and inclusiveness.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Weigh ambiguity and risk to effectively estimate work effort for both technical and non-technical tasks
  • Troubleshoot the system and solve problems across the platform and application domains, and have the soft skills to explain complex data to others in the organization
  • Create and document processes, outlining how other data professionals in the team will harvest, authenticate, and model the information
  • Actively learn while tackling new challenges; pursue new and better ways for ECMC Group to be successful
  • Perform other duties and responsibilities as assigned

Required Qualifications

  • Bachelor’s Degree
  • 5+ years work experience in data projects
  • 2+ years’ experience using AWS Analytics services in building Data Lake solutions
  • 3+ years’ coding experience in programming languages like Python and PySpark
  • Must be strong in SQL, data relationships and data lake/warehousing concepts
  • Familiarity with Software Development Life Cycle processes and best practices

Preferred Qualifications

  • Technical or Professional certifications, preferably in AWS, like Data Analytics Specialty
  • Experience with AWS Database Migration Services, AWS Glue, AWS Lambda, AWS QuickSight, AWS Data Brew, Amazon Redshift, AWS CloudFormation, AWS CDK, AWS SAM, and AWS Developer Tools
  • Experience in designing, developing, optimizing, and troubleshooting complex data pipelines
  • Experience in migrating On-Prem relational databases to AWS Aurora, Redshift (or similar)
  • Strong working knowledge of relational databases like Oracle, SQL Server, etc.
  • Experience working with disparate file formats like Parquet, CSV, JSON, etc.
  • Experience with source controls systems, DevOps, CI/CD implementations
  • Experience designing solutions that integrate with data visualization tools like QuickSight, Tableau and PowerBI

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed above are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Job Type: Full-time

Pay: $85,000.00 - $115,000.00 per year

Benefits:

  • 401(k)
  • 401(k) matching
  • Dental insurance
  • Flexible schedule
  • Health insurance
  • Life insurance
  • Paid time off
  • Relocation assistance
  • Vision insurance

Experience level:

  • 5 years

Schedule:

  • 8 hour shift
  • Monday to Friday

Ability to commute/relocate:

  • Minneapolis, MN 55401: Reliably commute or planning to relocate before starting work (Required)

Experience:

  • Informatica: 1 year (Preferred)
  • SQL: 1 year (Preferred)
  • Data warehouse: 1 year (Preferred)

Work Location: Hybrid remote in Minneapolis, MN 55401

colinoncars.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, colinoncars.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, colinoncars.com is the ideal place to find your next job.

Intrested in this job?

Related Jobs

All Related Listed jobs