We are seeking a Data Engineer to join our Internal Data Engineering & Analytics (DE&A) team. In this role, you will support a variety of applications, working alongside a team of highly skilled engineers and architects. You will also be involved in strategic enterprise data projects and large-scale implementations.  

Responsibilities: 

• Support projects leveraging an agile delivery model through requirements gathering and documentation, data ingestion pipeline development, and technical testing. 

• Coordinate activities with data source application owners to understand the underlying data, ensure integration and data integrity 

• Contribute to project delivery in the following ways:   

• Gather technical requirements and develop solutions with collaboration across the DE&A team

• Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations  

• Add data quality rules  

• Connect to new data sources  

• Map multiple sources into a single output  

• Interpret error messages to troubleshoot data pipelines  

• Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI  

• Test data pipelines to ensure accuracy 

Qualifications: 

• 2+ years of hands-on professional development experience, consulting experience preferred. 

• 1+ years of experience working with DataBricks

• Experience writing complex SQL queries related to data manipulation strategies 

• Experience building or working with metadata-driven ETL / ELT patterns and concepts. 

• Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/or Lambda. 

• Exposure using ETL tools such as Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc.

• Experience in technical testing, issue identification and resolution 

• Experience with AWS a plus

• Strong verbal and written communication skills