Lead Data Engineer
Our client, a nine-time “Best Company to Work For,” where intelligent, talented people come together to do outstanding work—and have a lot of fun while they’re at it. We offer a solution-focused environment full of collaboration and dedication, to our goals and to each other. You’ll have the opportunity to drive your own success in a supportive, globally connected environment. From advanced tools and technology to an immersive company culture, working with our client means working on the leading edge, with a community of the right people around you.
Job Description
As a Lead Data Engineer joining the Advanced Analytics practice, you’ll help clients scale their data solutions and make data-driven decisions while driving enterprise-level innovation.
You’ll work closely with the client to understand both their business processes and analytics needs to design and build data pipelines and cloud data solutions. You will have the opportunity to guide your client through best practices in data lake, data processing, and data pipeline design to help them achieve their business goals.
You will work closely with your team including analysts, architects, and technical project managers to design solutions and work together to deliver a world-class solution.
You’ll strike a balance of technical skills and business acumen to help clients better understand their core needs and what is possible for a future state.
What you’ll do:
- Design and develop cloud ELT and data pipelines
- Develop CI/CD pipelines and other DataOps fundamentals
- Communicate at the appropriate level to both business and technology teams to understand business needs and pain points
- Be creative in meeting the client’s core needs with their technology
- Explain technical benefits and deficits to non-technical audiences
- Learn new data tools and best practices
Qualifications
Required:
- 8+ years of cloud data engineering experience
- Experience designing and developing cloud ELT and data pipelines with various technologies such as Python, SQL, Airflow, Talend, Matillion, DBT, Fivetran
- Experience with AWS: Glue, S3, Athena
- Experience in working with the business to understand the appropriate data model (relational, tabular, transactional) for their data solution
- Deep experience designing and building performant ELT jobs to move and transform data from various source types and performing exploratory data analysis, data cleansing, and aggregation
- Experience with scaling & automation to data preparation techniques
- Experience with developing and operating CI/CD pipelines and other DataOps fundamentals
- Experience developing client-facing, core design documents: data flows, source to target, requirements, data lineage, and data dictionary.
- Understanding of data modeling (such as Kimball, Inman, and Data Vault design approaches)
- Excellent foundation of consulting skills: analytical, written and verbal communication, and presentation skills
- Demonstrated ability to identify business and technical impacts of user requirements and incorporate them into the project schedule
- Excellent written and verbal English communication skills.
Preferred:
- An undergraduate degree in technology or business
- Microsoft or AWS or Snowflake Certifications (Azure Fundamentals, Azure Data Engineer Associate, MCSA [any], Power Platform, AWS Data Analytics Specialty, AWS ML, SnowPro Core, etc.)
- Experience with Big Data Technologies (Hadoop, PySpark, MongoDB)
- Experience with Power BI
- Experience and certifications with Agile, Scrum, and/or SAFe
- Department
- Talent
- Locations
- Multiple locations
About CRG Solutions
CRG is a Global provider of IT and Technology Solutions,
Managed Services, Direct Hire & Contract Staffing
We are focused on meeting our clients’ needs in IT support. We offer Support, Engineering, Consulting, Talent,
and/or Outsourcing Services to allow our customers to focus on their core business.
Lead Data Engineer
Loading application form