We are seeking a detail-oriented and technically skilled Data Engineer to join our agile project delivery team. In this role, you will support end-to-end data pipeline development — from gathering requirements and integrating diverse data sources to transforming data for analytics and reporting. This position is ideal for professionals with a strong background in SQL, Databricks, and modern ETL/ELT frameworks, who are passionate about solving complex data challenges and collaborating directly with clients to deliver high-impact solutions.

Responsibilities:

· Support projects leveraging an agile delivery model through requirements gathering and documentation, data ingestion pipeline development, and technical testing.

· Contribute to project delivery in the following ways:

· Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations

· Add data quality rules

· Connect to new data sources

· Map multiple sources into a single output

· Interpret error messages to troubleshoot data pipelines

· Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI

· Test data pipelines to ensure accuracy

· Work closely with our clients as part of the development team to gather technical requirements and develop solutions

· Coordinate activities with data source application owners to understand the underlying data, ensure integration and data integrity

· Build relationships with clients through written and verbal communication

Qualifications:

· 3+ years of hands-on professional development experience, consulting experience preferred.

· 2+ years of experience working with DataBricks

· Experience writing complex SQL queries related to data manipulation strategies

· Experience building or working with metadata-driven ETL / ELT patterns and concepts.

· Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/or Lambda.

· Exposure using ETL tools such as Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc.

· Experience in technical testing, issue identification and resolution

· Experience with AWS a plus

· Strong verbal and written communication skills