We are looking for an experienced Data Engineer to join a project focused on building and developing modern cloud-based data solutions. You will work primarily with Microsoft Azure, Azure Data Factory and Snowflake, designing end-to-end data pipelines and transforming data into reliable, scalable datasets for reporting and analytics.
The role combines hands-on data engineering, data modelling and cloud integration, with a strong focus on performance, automation and data quality.
Your responsibilities:
- Design, build and maintain batch and incremental ETL/ELT pipelines from source systems to Snowflake.
- Develop and orchestrate data pipelines using Azure Data Factory, including linked services, datasets, data flows, triggers and reusable parameterised pipelines.
- Design and maintain data models in Snowflake, covering staging, core and data mart layers.
- Manage Snowflake warehouses, schemas, roles and data-loading mechanisms such as COPY INTO, Snowpipe and stages.
- Write, optimise and maintain complex SQL queries for data transformations, reporting and data quality validation.
- Integrate Azure services, including Azure Data Lake Storage Gen2, Azure Key Vault, Azure SQL and Azure Functions.
- Monitor data pipelines, troubleshoot failures and optimise solutions for both performance and cost.
- Apply CI/CD and Git-based version control, supporting controlled promotion of data solutions between environments.
- Create and maintain technical documentation for pipelines and data models.
- Collaborate with stakeholders to understand business needs and translate them into scalable data solutions.